Max level shown:
1 [ Mar 25 00:13:57 Enabled. ]
2 [ Mar 25 00:13:57 Rereading configuration. ]
3 [ Mar 25 00:13:58 Rereading configuration. ]
4 [ Mar 25 00:14:09 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dendrite/bin/tfportd --sync-only &"). ]
5 [ Mar 25 00:14:09 Method "start" exited with status 0. ]
6 No non-localhost IPv6 addresses found in SMF properties
72026-03-25T00:14:09.343ZINFOtfportd: connecting to dpd host = [::1] port = 12224
82026-03-25T00:14:09.345ZINFOtfportd: connected to dpd running softnpu-b31ba90d
92026-03-25T00:14:09.346ZINFOtfportd: running in sync-only mode
102026-03-25T00:14:09.346ZINFOtfportd: no non-localhost IPv6 listen address available, waiting for SMF update unit = oximeter
112026-03-25T00:14:09.348ZINFOtfportd: refreshing SMF config prior to waiting on signals unit = signal_handler
12 No non-localhost IPv6 addresses found in SMF properties
132026-03-25T00:14:09.349ZINFOtfportd: refreshed config: Config { log_file: None, log_format: Json, listen_addresses: [ [::1]:12231, ], pkt_source: None, dpd_host: "[::1]", dpd_port: 12224, vlan_link: None, vlan_data: None, techport0_prefix: None, techport1_prefix: None, rack_id: Some( e6cff9c8-35b2-4079-b7ac-cfaccb797307, ), sled_id: Some( f5cb8ff0-ce50-4cdf-b28f-32fd89620867, ), sled_model: Some( "i86pc", ), sled_revision: Some( 0, ), sled_serial: Some( "buskin", ), }
142026-03-25T00:14:09.349ZINFOtfportd: no non-localhost IPv6 listen address available, waiting for SMF update unit = oximeter
152026-03-25T00:14:09.354ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::ec3c:f8ff:fea9:b1a1->ee:3c:f8:a9:b1:a1 interface = tfportrear0_0
162026-03-25T00:14:09.355ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
172026-03-25T00:14:09.360ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec3c:f8ff:fea9:b1a1]
182026-03-25T00:14:09.364ZWARNtfportd: tfportqsfp0_0 has no addrs
19 [ Mar 25 00:14:09 Rereading configuration. ]
20 [ Mar 25 00:14:09 Executing refresh method (:kill). ]
21 [ Mar 25 00:14:09 Stopping because all processes in service exited. ]
22 [ Mar 25 00:14:09 Executing stop method (:kill). ]
23 [ Mar 25 00:14:09 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dendrite/bin/tfportd --sync-only &"). ]
24 [ Mar 25 00:14:09 Method "start" exited with status 0. ]
252026-03-25T00:14:09.954ZINFOtfportd: connecting to dpd host = [::1] port = 12224
262026-03-25T00:14:09.955ZINFOtfportd: connected to dpd running softnpu-b31ba90d
272026-03-25T00:14:09.955ZINFOtfportd: running in sync-only mode
282026-03-25T00:14:09.955ZINFOtfportd: found suitable IPv6 address for oximeter producer server address = fd00:1122:3344:101::2 unit = oximeter
292026-03-25T00:14:09.957ZINFOtfportd: refreshing SMF config prior to waiting on signals unit = signal_handler
302026-03-25T00:14:09.957ZDEBGtfportd: extracted oximeter configuration data config = OximeterConfig { listen_address: fd00:1122:3344:101::2, sled_identifiers: SledIdentifiers { rack_id: e6cff9c8-35b2-4079-b7ac-cfaccb797307, sled_id: f5cb8ff0-ce50-4cdf-b28f-32fd89620867, model: "i86pc", revision: 0, serial: "buskin" }, switch_identifiers: SwitchIdentifiers { asic_backend: "softnpu", fab: None, fuse: Some(FuseData { chip_rev: ChipRevision { device_id: 272, rev: "B1", rev_num: 2 }, disabled: DisabledFeatures { bsync: false, mau: [0, 0, 0, 0], pgen: false, pipes: 0, ports: 0, resub: false, speeds: 0, tm_mem: 0 }, frequency: FrequencySettings { bps: 3, bps_ext: 0, cpu_speed_dis: 0, disabled: false, pcie_dis: 0, pps: 3, pps_ext: 0 }, manufacturing: ManufacturingData { core_repair: false, die_rotation: false, pmro_and_skew: 0, silent_spin: 0, soft_pipe_dis: 0, tile_repair: false, voltage_scaling: 0, wf_core_repair: false }, part: PartInfo { part_num: 4660, pkg_id: 1, version: 2 } }), lot: None, lotnum: None, model: "FAKE_SIM_SIDECAR", revision: 0, serial: "SimSidecar0", sidecar_id: 3331774d-47f7-4cb6-bc93-6be7ff97885b, slot: 0, wafer: None, wafer_loc: None } } unit = oximeter
312026-03-25T00:14:09.957ZDEBGtfportd: created producer ID producer_id = 20350175-bc15-4010-b9b0-96b6bd8cf33b unit = oximeter
322026-03-25T00:14:09.958ZINFOtfportd: refreshed config: Config { log_file: None, log_format: Json, listen_addresses: [ [fd00:1122:3344:101::2]:12231, [::1]:12231, ], pkt_source: None, dpd_host: "[::1]", dpd_port: 12224, vlan_link: None, vlan_data: None, techport0_prefix: None, techport1_prefix: None, rack_id: Some( e6cff9c8-35b2-4079-b7ac-cfaccb797307, ), sled_id: Some( f5cb8ff0-ce50-4cdf-b28f-32fd89620867, ), sled_model: Some( "i86pc", ), sled_revision: Some( 0, ), sled_serial: Some( "buskin", ), }
332026-03-25T00:14:09.964ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
342026-03-25T00:14:09.966ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::ec3c:f8ff:fea9:b1a1->ee:3c:f8:a9:b1:a1 interface = tfportrear0_0
352026-03-25T00:14:09.966ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::9082:2eff:fe91:1bb->92:82:2e:91:01:bb interface = tfportrear0_0
362026-03-25T00:14:09.967ZDEBGtfportd: registered DTrace probes unit = producer-server
372026-03-25T00:14:09.968ZDEBGtfportd (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::2]:42302 method = GET path = /{producer_id} unit = producer-server versions = all
382026-03-25T00:14:09.968ZINFOtfportd (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:328 local_addr = [fd00:1122:3344:101::2]:42302 unit = producer-server
392026-03-25T00:14:09.968ZDEBGtfportd (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::2]:42302 unit = producer-server
402026-03-25T00:14:09.968ZDEBGtfportd: Requested any available port, Dropshot server has been bound to [fd00:1122:3344:101::2]:42302 unit = producer-server
412026-03-25T00:14:09.968ZDEBGtfportd: Nexus IP not provided, will use DNS to resolve it unit = producer-server
422026-03-25T00:14:09.969ZINFOtfportd (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/internal-dns/resolver/src/resolver.rs:144 unit = producer-server
432026-03-25T00:14:09.969ZDEBGtfportd: starting producer registration task unit = producer-server
442026-03-25T00:14:09.969ZINFOtfportd: starting oximeter metric producer server address = [fd00:1122:3344:101::2]:42302 file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:279 interval = 30s producer_id = 20350175-bc15-4010-b9b0-96b6bd8cf33b unit = producer-server
452026-03-25T00:14:09.969ZINFOtfportd: created oximeter producer server unit = oximeter
462026-03-25T00:14:09.969ZDEBGtfportd (producer-registration-task): registering as oximeter producer with Nexus registration_count = 0 unit = producer-server
472026-03-25T00:14:09.970ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec3c:f8ff:fea9:b1a1]
482026-03-25T00:14:09.970ZDEBGtfportd (kstat-sampler): adding new target unit = oximeter
492026-03-25T00:14:09.971ZDEBGtfportd (kstat-sampler-worker): storing new creation time for tracked target creation_time = 2026-03-25T00:13:53.385912853Z path = KstatPath { module: "link", instance: 0, name: "tfportrear0_0" } unit = oximeter
502026-03-25T00:14:09.971ZDEBGtfportd (kstat-sampler-worker): inserted empty per-target sample queue id = 12991995245108756510 unit = oximeter
512026-03-25T00:14:09.972ZDEBGtfportd: added new link to kstat sampler link_kind = switch-port-control link_name = tfportrear0_0 unit = metrics-task-tracker
522026-03-25T00:14:09.973ZWARNtfportd: tfportqsfp0_0 has no addrs
532026-03-25T00:14:10.537ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
542026-03-25T00:14:10.542ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec3c:f8ff:fea9:b1a1]
552026-03-25T00:14:10.545ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
562026-03-25T00:14:10.545ZDEBGtfportd (kstat-sampler): adding new target unit = oximeter
572026-03-25T00:14:10.546ZDEBGtfportd (kstat-sampler-worker): storing new creation time for tracked target creation_time = 2026-03-25T00:13:53.385782800Z path = KstatPath { module: "link", instance: 0, name: "tfportqsfp0_0" } unit = oximeter
582026-03-25T00:14:10.546ZDEBGtfportd (kstat-sampler-worker): inserted empty per-target sample queue id = 16689004723095666093 unit = oximeter
592026-03-25T00:14:10.546ZDEBGtfportd: added new link to kstat sampler link_kind = switch-port-control link_name = tfportqsfp0_0 unit = metrics-task-tracker
602026-03-25T00:14:10.983ZINFOtfportd: added new ARP entry entry = 10.151.1.174->36:df:9a:e3:1a:3d interface = tfportqsfp0_0
612026-03-25T00:14:11.306ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
622026-03-25T00:14:11.312ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec3c:f8ff:fea9:b1a1]
632026-03-25T00:14:11.316ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
642026-03-25T00:14:12.343ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
652026-03-25T00:14:12.349ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec3c:f8ff:fea9:b1a1]
662026-03-25T00:14:12.352ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
672026-03-25T00:14:13.509ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
682026-03-25T00:14:13.514ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec3c:f8ff:fea9:b1a1]
692026-03-25T00:14:13.516ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
702026-03-25T00:14:14.348ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
712026-03-25T00:14:14.353ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec3c:f8ff:fea9:b1a1]
722026-03-25T00:14:14.357ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
732026-03-25T00:14:14.971ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("0aa4d04b-e2c7-4b43-8ce5-0b7def52d2a7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("26ed5338-0fd8-4f7f-9098-54a055136b93.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("95b33527-e16f-4f9c-af59-b7e2b9bd67fa.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("95b33527-e16f-4f9c-af59-b7e2b9bd67fa.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 647, tv_nsec: 748831064 } }) unit = producer-server
742026-03-25T00:14:14.972ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221 unit = producer-server
752026-03-25T00:14:15.014ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
762026-03-25T00:14:15.702ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
772026-03-25T00:14:15.707ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec3c:f8ff:fea9:b1a1]
782026-03-25T00:14:15.710ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
792026-03-25T00:14:16.684ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
802026-03-25T00:14:16.691ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec3c:f8ff:fea9:b1a1]
812026-03-25T00:14:16.695ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
822026-03-25T00:14:17.277ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
832026-03-25T00:14:17.281ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec3c:f8ff:fea9:b1a1]
842026-03-25T00:14:17.283ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
852026-03-25T00:14:18.562ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
862026-03-25T00:14:18.566ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec3c:f8ff:fea9:b1a1]
872026-03-25T00:14:18.569ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
882026-03-25T00:14:19.888ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
892026-03-25T00:14:19.893ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec3c:f8ff:fea9:b1a1]
902026-03-25T00:14:19.896ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
912026-03-25T00:14:19.976ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 12991995245108756510 n_samples = 6 unit = oximeter
922026-03-25T00:14:20.549ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 16689004723095666093 n_samples = 6 unit = oximeter
932026-03-25T00:14:20.851ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
942026-03-25T00:14:20.856ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec3c:f8ff:fea9:b1a1]
952026-03-25T00:14:20.859ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
962026-03-25T00:14:22.236ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
972026-03-25T00:14:22.240ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec3c:f8ff:fea9:b1a1]
982026-03-25T00:14:22.243ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
992026-03-25T00:14:23.064ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1002026-03-25T00:14:23.067ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec3c:f8ff:fea9:b1a1]
1012026-03-25T00:14:23.070ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1022026-03-25T00:14:24.045ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1032026-03-25T00:14:24.048ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec3c:f8ff:fea9:b1a1]
1042026-03-25T00:14:24.051ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1052026-03-25T00:14:25.173ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1062026-03-25T00:14:25.178ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec3c:f8ff:fea9:b1a1]
1072026-03-25T00:14:25.180ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1082026-03-25T00:14:25.876ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1092026-03-25T00:14:25.881ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec3c:f8ff:fea9:b1a1]
1102026-03-25T00:14:25.883ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1112026-03-25T00:14:26.747ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1122026-03-25T00:14:26.752ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec3c:f8ff:fea9:b1a1]
1132026-03-25T00:14:26.754ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1142026-03-25T00:14:28.121ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1152026-03-25T00:14:28.126ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec3c:f8ff:fea9:b1a1]
1162026-03-25T00:14:28.129ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1172026-03-25T00:14:29.607ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1182026-03-25T00:14:29.615ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec3c:f8ff:fea9:b1a1]
1192026-03-25T00:14:29.620ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1202026-03-25T00:14:30.210ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 12991995245108756510 n_samples = 6 unit = oximeter
1212026-03-25T00:14:30.246ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }) unit = producer-server
1222026-03-25T00:14:30.247ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 0 delay = 20.04636189s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
1232026-03-25T00:14:30.358ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1242026-03-25T00:14:30.364ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec3c:f8ff:fea9:b1a1]
1252026-03-25T00:14:30.369ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1262026-03-25T00:14:30.525ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("0aa4d04b-e2c7-4b43-8ce5-0b7def52d2a7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("26ed5338-0fd8-4f7f-9098-54a055136b93.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("95b33527-e16f-4f9c-af59-b7e2b9bd67fa.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("95b33527-e16f-4f9c-af59-b7e2b9bd67fa.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 663, tv_nsec: 69669114 } }) unit = producer-server
1272026-03-25T00:14:30.525ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221 unit = producer-server
1282026-03-25T00:14:30.557ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
1292026-03-25T00:14:30.783ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 16689004723095666093 n_samples = 6 unit = oximeter
1302026-03-25T00:14:30.995ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1312026-03-25T00:14:31.001ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec3c:f8ff:fea9:b1a1]
1322026-03-25T00:14:31.004ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1332026-03-25T00:14:32.115ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1342026-03-25T00:14:32.124ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec3c:f8ff:fea9:b1a1]
1352026-03-25T00:14:32.127ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1362026-03-25T00:14:33.587ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1372026-03-25T00:14:33.596ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec3c:f8ff:fea9:b1a1]
1382026-03-25T00:14:33.602ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1392026-03-25T00:14:34.722ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1402026-03-25T00:14:34.729ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec3c:f8ff:fea9:b1a1]
1412026-03-25T00:14:34.733ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1422026-03-25T00:14:35.294ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1432026-03-25T00:14:35.300ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec3c:f8ff:fea9:b1a1]
1442026-03-25T00:14:35.304ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1452026-03-25T00:14:36.742ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1462026-03-25T00:14:36.747ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec3c:f8ff:fea9:b1a1]
1472026-03-25T00:14:36.750ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1482026-03-25T00:14:38.255ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1492026-03-25T00:14:38.260ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec3c:f8ff:fea9:b1a1]
1502026-03-25T00:14:38.263ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1512026-03-25T00:14:38.799ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1522026-03-25T00:14:38.804ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec3c:f8ff:fea9:b1a1]
1532026-03-25T00:14:38.807ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1542026-03-25T00:14:39.439ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1552026-03-25T00:14:39.444ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec3c:f8ff:fea9:b1a1]
1562026-03-25T00:14:39.446ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1572026-03-25T00:14:40.168ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1582026-03-25T00:14:40.173ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec3c:f8ff:fea9:b1a1]
1592026-03-25T00:14:40.176ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1602026-03-25T00:14:40.239ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 12991995245108756510 n_samples = 6 unit = oximeter
1612026-03-25T00:14:40.814ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 16689004723095666093 n_samples = 6 unit = oximeter
1622026-03-25T00:14:41.136ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1632026-03-25T00:14:41.141ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec3c:f8ff:fea9:b1a1]
1642026-03-25T00:14:41.144ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1652026-03-25T00:14:42.518ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1662026-03-25T00:14:42.523ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec3c:f8ff:fea9:b1a1]
1672026-03-25T00:14:42.526ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1682026-03-25T00:14:43.211ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1692026-03-25T00:14:43.218ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec3c:f8ff:fea9:b1a1]
1702026-03-25T00:14:43.222ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1712026-03-25T00:14:47.642ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1722026-03-25T00:14:47.650ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec3c:f8ff:fea9:b1a1]
1732026-03-25T00:14:47.651ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }) unit = producer-server
1742026-03-25T00:14:47.669ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 1 delay = 37.426978694s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
1752026-03-25T00:14:47.697ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1762026-03-25T00:14:47.961ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("0aa4d04b-e2c7-4b43-8ce5-0b7def52d2a7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("26ed5338-0fd8-4f7f-9098-54a055136b93.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("95b33527-e16f-4f9c-af59-b7e2b9bd67fa.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("95b33527-e16f-4f9c-af59-b7e2b9bd67fa.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 680, tv_nsec: 465182970 } }) unit = producer-server
1772026-03-25T00:14:47.962ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221 unit = producer-server
1782026-03-25T00:14:48.021ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
1792026-03-25T00:14:48.549ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1802026-03-25T00:14:48.624ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec3c:f8ff:fea9:b1a1]
1812026-03-25T00:14:48.700ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1822026-03-25T00:14:49.957ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1832026-03-25T00:14:49.964ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec3c:f8ff:fea9:b1a1]
1842026-03-25T00:14:49.970ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1852026-03-25T00:14:50.275ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 12991995245108756510 n_samples = 6 unit = oximeter
1862026-03-25T00:14:50.755ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1872026-03-25T00:14:50.761ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec3c:f8ff:fea9:b1a1]
1882026-03-25T00:14:50.766ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1892026-03-25T00:14:50.828ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 16689004723095666093 n_samples = 6 unit = oximeter
1902026-03-25T00:14:52.156ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1912026-03-25T00:14:52.162ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec3c:f8ff:fea9:b1a1]
1922026-03-25T00:14:52.167ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1932026-03-25T00:14:53.322ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1942026-03-25T00:14:53.328ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec3c:f8ff:fea9:b1a1]
1952026-03-25T00:14:53.331ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1962026-03-25T00:14:54.625ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1972026-03-25T00:14:54.631ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec3c:f8ff:fea9:b1a1]
1982026-03-25T00:14:54.634ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1992026-03-25T00:14:55.183ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2002026-03-25T00:14:55.189ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec3c:f8ff:fea9:b1a1]
2012026-03-25T00:14:55.193ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2022026-03-25T00:14:56.329ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2032026-03-25T00:14:56.334ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec3c:f8ff:fea9:b1a1]
2042026-03-25T00:14:56.337ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2052026-03-25T00:14:57.341ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2062026-03-25T00:14:57.346ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec3c:f8ff:fea9:b1a1]
2072026-03-25T00:14:57.349ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2082026-03-25T00:14:58.133ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2092026-03-25T00:14:58.138ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec3c:f8ff:fea9:b1a1]
2102026-03-25T00:14:58.141ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2112026-03-25T00:14:58.764ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2122026-03-25T00:14:58.770ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec3c:f8ff:fea9:b1a1]
2132026-03-25T00:14:58.773ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2142026-03-25T00:15:00.185ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2152026-03-25T00:15:00.190ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec3c:f8ff:fea9:b1a1]
2162026-03-25T00:15:00.193ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2172026-03-25T00:15:00.278ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 12991995245108756510 n_samples = 6 unit = oximeter
2182026-03-25T00:15:00.802ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2192026-03-25T00:15:00.807ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec3c:f8ff:fea9:b1a1]
2202026-03-25T00:15:00.811ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2212026-03-25T00:15:00.831ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 16689004723095666093 n_samples = 6 unit = oximeter