Max level shown:
1 [ Jun 25 00:59:25 Enabled. ]
2 [ Jun 25 00:59:25 Rereading configuration. ]
3 [ Jun 25 00:59:25 Rereading configuration. ]
4 [ Jun 25 00:59:37 Rereading configuration. ]
5 [ Jun 25 00:59:37 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dendrite/bin/tfportd --sync-only &"). ]
6 [ Jun 25 00:59:37 Method "start" exited with status 0. ]
72026-06-25T00:59:37.739ZINFOtfportd: connecting to dpd host = [::1] port = 12224
82026-06-25T00:59:37.741ZERROtfportd: Failed to connect to dpd. Retrying...
92026-06-25T00:59:38.742ZINFOtfportd: connected to dpd running softnpu-cc0c307c-dirty
102026-06-25T00:59:38.742ZINFOtfportd: running in sync-only mode
112026-06-25T00:59:38.743ZINFOtfportd: found suitable IPv6 address for oximeter producer server address = fd00:1122:3344:101::2 unit = oximeter
122026-06-25T00:59:38.744ZINFOtfportd: refreshing SMF config prior to waiting on signals unit = signal_handler
132026-06-25T00:59:38.745ZDEBGtfportd: extracted oximeter configuration data config = OximeterConfig { listen_address: fd00:1122:3344:101::2, sled_identifiers: SledIdentifiers { rack_id: 2e6570ca-70d0-4f49-8528-7b3bd934a48d, sled_id: ce28e392-9635-47ed-95e5-80356dae8250, model: "i86pc", revision: 0, serial: "sock" }, switch_identifiers: SwitchIdentifiers { asic_backend: "softnpu", fab: None, fuse: Some(FuseData { chip_rev: ChipRevision { device_id: 272, rev: "B1", rev_num: 2 }, disabled: DisabledFeatures { bsync: false, mau: [0, 0, 0, 0], pgen: false, pipes: 0, ports: 0, resub: false, speeds: 0, tm_mem: 0 }, frequency: FrequencySettings { bps: 3, bps_ext: 0, cpu_speed_dis: 0, disabled: false, pcie_dis: 0, pps: 3, pps_ext: 0 }, manufacturing: ManufacturingData { core_repair: false, die_rotation: false, pmro_and_skew: 0, silent_spin: 0, soft_pipe_dis: 0, tile_repair: false, voltage_scaling: 0, wf_core_repair: false }, part: PartInfo { part_num: 4660, pkg_id: 1, version: 2 } }), lot: None, lotnum: None, model: "FAKE_SIM_SIDECAR", revision: 0, serial: "SimSidecar0", sidecar_id: 27a62a0f-e3cd-462d-b9c9-cbbb66a56880, slot: 0, wafer: None, wafer_loc: None } } unit = oximeter
142026-06-25T00:59:38.745ZDEBGtfportd: created producer ID producer_id = c7ebb957-0528-4e89-a904-30b5d23f4e5d unit = oximeter
152026-06-25T00:59:38.746ZINFOtfportd: refreshed config: Config { log_file: None, log_format: Json, listen_addresses: [ [fd00:1122:3344:101::2]:12231, [::1]:12231, ], pkt_source: None, dpd_host: "[::1]", dpd_port: 12224, vlan_link: None, vlan_data: None, techport0_prefix: None, techport1_prefix: None, rack_id: Some( 2e6570ca-70d0-4f49-8528-7b3bd934a48d, ), sled_id: Some( ce28e392-9635-47ed-95e5-80356dae8250, ), sled_model: Some( "i86pc", ), sled_revision: Some( 0, ), sled_serial: Some( "sock", ), }
162026-06-25T00:59:38.753ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
172026-06-25T00:59:38.755ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::e0db:f3ff:fe59:b0df->e2:db:f3:59:b0:df interface = tfportrear0_0
182026-06-25T00:59:38.755ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::140c:dbff:fe45:1d4d->16:0c:db:45:1d:4d interface = tfportrear0_0
192026-06-25T00:59:38.758ZDEBGtfportd: registered DTrace probes unit = producer-server
202026-06-25T00:59:38.759ZDEBGtfportd (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::2]:34062 method = GET path = /{producer_id} unit = producer-server versions = all
212026-06-25T00:59:38.759ZINFOtfportd (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:328 local_addr = [fd00:1122:3344:101::2]:34062 unit = producer-server
222026-06-25T00:59:38.759ZDEBGtfportd (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::2]:34062 unit = producer-server
232026-06-25T00:59:38.759ZDEBGtfportd: Requested any available port, Dropshot server has been bound to [fd00:1122:3344:101::2]:34062 unit = producer-server
242026-06-25T00:59:38.759ZDEBGtfportd: Nexus IP not provided, will use DNS to resolve it unit = producer-server
252026-06-25T00:59:38.759ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::140c:dbff:fe45:1d4d]
262026-06-25T00:59:38.760ZINFOtfportd (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/internal-dns/resolver/src/resolver.rs:144 unit = producer-server
272026-06-25T00:59:38.760ZDEBGtfportd: starting producer registration task unit = producer-server
282026-06-25T00:59:38.760ZINFOtfportd: starting oximeter metric producer server address = [fd00:1122:3344:101::2]:34062 file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:279 interval = 30s producer_id = c7ebb957-0528-4e89-a904-30b5d23f4e5d unit = producer-server
292026-06-25T00:59:38.760ZINFOtfportd: created oximeter producer server unit = oximeter
302026-06-25T00:59:38.760ZDEBGtfportd (producer-registration-task): registering as oximeter producer with Nexus registration_count = 0 unit = producer-server
312026-06-25T00:59:38.760ZDEBGtfportd (kstat-sampler): adding new target unit = oximeter
322026-06-25T00:59:38.762ZDEBGtfportd (kstat-sampler-worker): storing new creation time for tracked target creation_time = 2026-06-25T00:59:20.485037254Z path = KstatPath { module: "link", instance: 0, name: "tfportrear0_0" } unit = oximeter
332026-06-25T00:59:38.762ZDEBGtfportd (kstat-sampler-worker): inserted empty per-target sample queue id = 17634179368976516224 unit = oximeter
342026-06-25T00:59:38.762ZDEBGtfportd: added new link to kstat sampler link_kind = switch-port-control link_name = tfportrear0_0 unit = metrics-task-tracker
352026-06-25T00:59:38.762ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("0be0d2d1-8178-4030-942a-fc81c46750cb.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("78533b6b-75a8-4644-8b50-93a5214e511e.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("9e973996-ba72-427b-97f9-396b117956a7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("9e973996-ba72-427b-97f9-396b117956a7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 671, tv_nsec: 118797614 } }) unit = producer-server
362026-06-25T00:59:38.763ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
372026-06-25T00:59:38.779ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
382026-06-25T00:59:38.780ZWARNtfportd: tfportqsfp0_0 has no addrs
392026-06-25T00:59:39.927ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
402026-06-25T00:59:39.934ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::140c:dbff:fe45:1d4d]
412026-06-25T00:59:39.937ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
422026-06-25T00:59:39.937ZDEBGtfportd (kstat-sampler): adding new target unit = oximeter
432026-06-25T00:59:39.938ZDEBGtfportd (kstat-sampler-worker): storing new creation time for tracked target creation_time = 2026-06-25T00:59:20.484901091Z path = KstatPath { module: "link", instance: 0, name: "tfportqsfp0_0" } unit = oximeter
442026-06-25T00:59:39.938ZDEBGtfportd (kstat-sampler-worker): inserted empty per-target sample queue id = 1167971102433430089 unit = oximeter
452026-06-25T00:59:39.938ZDEBGtfportd: added new link to kstat sampler link_kind = switch-port-control link_name = tfportqsfp0_0 unit = metrics-task-tracker
462026-06-25T00:59:40.111ZINFOtfportd: added new ARP entry entry = 10.151.2.174->7e:df:33:d2:92:26 interface = tfportqsfp0_0
472026-06-25T00:59:41.287ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
482026-06-25T00:59:41.292ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::140c:dbff:fe45:1d4d]
492026-06-25T00:59:41.295ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
502026-06-25T00:59:42.419ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
512026-06-25T00:59:42.425ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::140c:dbff:fe45:1d4d]
522026-06-25T00:59:42.428ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
532026-06-25T00:59:43.293ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
542026-06-25T00:59:43.298ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::140c:dbff:fe45:1d4d]
552026-06-25T00:59:43.301ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
562026-06-25T00:59:44.564ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
572026-06-25T00:59:44.569ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::140c:dbff:fe45:1d4d]
582026-06-25T00:59:44.573ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
592026-06-25T00:59:45.823ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
602026-06-25T00:59:45.828ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::140c:dbff:fe45:1d4d]
612026-06-25T00:59:45.830ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
622026-06-25T00:59:46.856ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
632026-06-25T00:59:46.861ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::140c:dbff:fe45:1d4d]
642026-06-25T00:59:46.864ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
652026-06-25T00:59:48.342ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
662026-06-25T00:59:48.347ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::140c:dbff:fe45:1d4d]
672026-06-25T00:59:48.350ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
682026-06-25T00:59:48.766ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 17634179368976516224 n_samples = 6 unit = oximeter
692026-06-25T00:59:49.695ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
702026-06-25T00:59:49.699ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::140c:dbff:fe45:1d4d]
712026-06-25T00:59:49.702ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
722026-06-25T00:59:49.940ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 1167971102433430089 n_samples = 6 unit = oximeter
732026-06-25T00:59:50.818ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
742026-06-25T00:59:50.823ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::140c:dbff:fe45:1d4d]
752026-06-25T00:59:50.826ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
762026-06-25T00:59:51.659ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
772026-06-25T00:59:51.663ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::140c:dbff:fe45:1d4d]
782026-06-25T00:59:51.667ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
792026-06-25T00:59:52.418ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
802026-06-25T00:59:52.422ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::140c:dbff:fe45:1d4d]
812026-06-25T00:59:52.425ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
822026-06-25T00:59:53.414ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
832026-06-25T00:59:53.419ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::140c:dbff:fe45:1d4d]
842026-06-25T00:59:53.422ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
852026-06-25T00:59:53.780ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
862026-06-25T00:59:53.781ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 0 delay = 15.021004052s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
872026-06-25T00:59:54.012ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
882026-06-25T00:59:54.017ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::140c:dbff:fe45:1d4d]
892026-06-25T00:59:54.019ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
902026-06-25T00:59:54.157ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("0be0d2d1-8178-4030-942a-fc81c46750cb.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("78533b6b-75a8-4644-8b50-93a5214e511e.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("9e973996-ba72-427b-97f9-396b117956a7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("9e973996-ba72-427b-97f9-396b117956a7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 686, tv_nsec: 513115825 } }) unit = producer-server
912026-06-25T00:59:54.157ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
922026-06-25T00:59:54.165ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
932026-06-25T00:59:54.878ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
942026-06-25T00:59:54.883ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::140c:dbff:fe45:1d4d]
952026-06-25T00:59:54.886ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
962026-06-25T00:59:55.769ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
972026-06-25T00:59:55.774ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::140c:dbff:fe45:1d4d]
982026-06-25T00:59:55.777ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
992026-06-25T00:59:56.674ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1002026-06-25T00:59:56.678ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::140c:dbff:fe45:1d4d]
1012026-06-25T00:59:56.681ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1022026-06-25T00:59:57.462ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1032026-06-25T00:59:57.466ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::140c:dbff:fe45:1d4d]
1042026-06-25T00:59:57.470ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1052026-06-25T00:59:58.310ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1062026-06-25T00:59:58.315ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::140c:dbff:fe45:1d4d]
1072026-06-25T00:59:58.318ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1082026-06-25T00:59:58.548ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 17634179368976516224 n_samples = 6 unit = oximeter
1092026-06-25T00:59:59.107ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1102026-06-25T00:59:59.112ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::140c:dbff:fe45:1d4d]
1112026-06-25T00:59:59.115ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1122026-06-25T00:59:59.718ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 1167971102433430089 n_samples = 6 unit = oximeter
1132026-06-25T00:59:59.746ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1142026-06-25T00:59:59.750ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::140c:dbff:fe45:1d4d]
1152026-06-25T00:59:59.753ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1162026-06-25T01:00:00.949ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1172026-06-25T01:00:00.955ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::140c:dbff:fe45:1d4d]
1182026-06-25T01:00:00.959ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]