Max level shown:
1 [ Feb 24 15:42:05 Enabled. ]
2 [ Feb 24 15:42:05 Rereading configuration. ]
3 [ Feb 24 15:42:06 Rereading configuration. ]
4 [ Feb 24 15:42:17 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dendrite/bin/tfportd --sync-only &"). ]
5 [ Feb 24 15:42:17 Method "start" exited with status 0. ]
6 No non-localhost IPv6 addresses found in SMF properties
72026-02-24T15:42:17.275ZINFOtfportd: connecting to dpd host = [::1] port = 12224
82026-02-24T15:42:17.319ZINFOtfportd: connected to dpd running softnpu-37992295
92026-02-24T15:42:17.319ZINFOtfportd: running in sync-only mode
102026-02-24T15:42:17.321ZINFOtfportd: no non-localhost IPv6 listen address available, waiting for SMF update unit = oximeter
112026-02-24T15:42:17.322ZINFOtfportd: refreshing SMF config prior to waiting on signals unit = signal_handler
12 No non-localhost IPv6 addresses found in SMF properties
132026-02-24T15:42:17.323ZINFOtfportd: refreshed config: Config { log_file: None, log_format: Json, listen_addresses: [ [::1]:12231, ], pkt_source: None, dpd_host: "[::1]", dpd_port: 12224, vlan_link: None, vlan_data: None, techport0_prefix: None, techport1_prefix: None, rack_id: Some( e12d7487-e41f-4973-8cea-08c4c98f3617, ), sled_id: Some( 99f44d15-5a62-437d-9ab9-8e00a801b589, ), sled_model: Some( "i86pc", ), sled_revision: Some( 0, ), sled_serial: Some( "buskin", ), }
142026-02-24T15:42:17.323ZINFOtfportd: no non-localhost IPv6 listen address available, waiting for SMF update unit = oximeter
152026-02-24T15:42:17.327ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::8c72:21ff:fe51:f53e->8e:72:21:51:f5:3e interface = tfportrear0_0
162026-02-24T15:42:17.329ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
172026-02-24T15:42:17.334ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
182026-02-24T15:42:17.339ZWARNtfportd: tfportqsfp0_0 has no addrs
19 [ Feb 24 15:42:17 Rereading configuration. ]
20 [ Feb 24 15:42:17 Executing refresh method (:kill). ]
21 [ Feb 24 15:42:17 Stopping because all processes in service exited. ]
22 [ Feb 24 15:42:17 Executing stop method (:kill). ]
23 [ Feb 24 15:42:17 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dendrite/bin/tfportd --sync-only &"). ]
24 [ Feb 24 15:42:17 Method "start" exited with status 0. ]
252026-02-24T15:42:17.888ZINFOtfportd: connecting to dpd host = [::1] port = 12224
262026-02-24T15:42:17.942ZINFOtfportd: connected to dpd running softnpu-37992295
272026-02-24T15:42:17.943ZINFOtfportd: running in sync-only mode
282026-02-24T15:42:17.943ZINFOtfportd: found suitable IPv6 address for oximeter producer server address = fd00:1122:3344:101::2 unit = oximeter
292026-02-24T15:42:17.944ZINFOtfportd: refreshing SMF config prior to waiting on signals unit = signal_handler
302026-02-24T15:42:17.944ZDEBGtfportd: extracted oximeter configuration data config = OximeterConfig { listen_address: fd00:1122:3344:101::2, sled_identifiers: SledIdentifiers { rack_id: e12d7487-e41f-4973-8cea-08c4c98f3617, sled_id: 99f44d15-5a62-437d-9ab9-8e00a801b589, model: "i86pc", revision: 0, serial: "buskin" }, switch_identifiers: SwitchIdentifiers { asic_backend: "softnpu", fab: None, lot: None, model: "FAKE_SIM_SIDECAR", revision: 0, serial: "SimSidecar0", sidecar_id: fefd21b7-00c8-4c47-b3c7-d0a88ac2cda7, slot: 0, wafer: None, wafer_loc: None } } unit = oximeter
312026-02-24T15:42:17.945ZDEBGtfportd: created producer ID producer_id = 86241825-beb5-4649-a594-566ceb4c4e39 unit = oximeter
322026-02-24T15:42:17.947ZINFOtfportd: refreshed config: Config { log_file: None, log_format: Json, listen_addresses: [ [fd00:1122:3344:101::2]:12231, [::1]:12231, ], pkt_source: None, dpd_host: "[::1]", dpd_port: 12224, vlan_link: None, vlan_data: None, techport0_prefix: None, techport1_prefix: None, rack_id: Some( e12d7487-e41f-4973-8cea-08c4c98f3617, ), sled_id: Some( 99f44d15-5a62-437d-9ab9-8e00a801b589, ), sled_model: Some( "i86pc", ), sled_revision: Some( 0, ), sled_serial: Some( "buskin", ), }
332026-02-24T15:42:17.952ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
342026-02-24T15:42:17.954ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::8c72:21ff:fe51:f53e->8e:72:21:51:f5:3e interface = tfportrear0_0
352026-02-24T15:42:17.954ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::2cc5:40ff:fea8:3f02->2e:c5:40:a8:3f:02 interface = tfportrear0_0
362026-02-24T15:42:17.956ZDEBGtfportd: registered DTrace probes unit = producer-server
372026-02-24T15:42:17.957ZDEBGtfportd (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::2]:37571 method = GET path = /{producer_id} unit = producer-server versions = all
382026-02-24T15:42:17.957ZINFOtfportd (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:328 local_addr = [fd00:1122:3344:101::2]:37571 unit = producer-server
392026-02-24T15:42:17.957ZDEBGtfportd (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::2]:37571 unit = producer-server
402026-02-24T15:42:17.957ZDEBGtfportd: Requested any available port, Dropshot server has been bound to [fd00:1122:3344:101::2]:37571 unit = producer-server
412026-02-24T15:42:17.957ZDEBGtfportd: Nexus IP not provided, will use DNS to resolve it unit = producer-server
422026-02-24T15:42:17.957ZINFOtfportd (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/internal-dns/resolver/src/resolver.rs:144 unit = producer-server
432026-02-24T15:42:17.958ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
442026-02-24T15:42:17.958ZDEBGtfportd: starting producer registration task unit = producer-server
452026-02-24T15:42:17.958ZINFOtfportd: starting oximeter metric producer server address = [fd00:1122:3344:101::2]:37571 file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:279 interval = 30s producer_id = 86241825-beb5-4649-a594-566ceb4c4e39 unit = producer-server
462026-02-24T15:42:17.958ZINFOtfportd: created oximeter producer server unit = oximeter
472026-02-24T15:42:17.958ZDEBGtfportd (producer-registration-task): registering as oximeter producer with Nexus registration_count = 0 unit = producer-server
482026-02-24T15:42:17.958ZDEBGtfportd (kstat-sampler): adding new target unit = oximeter
492026-02-24T15:42:17.958ZDEBGtfportd (kstat-sampler-worker): storing new creation time for tracked target creation_time = 2026-02-24T15:42:01.240661968Z path = KstatPath { module: "link", instance: 0, name: "tfportrear0_0" } unit = oximeter
502026-02-24T15:42:17.958ZDEBGtfportd (kstat-sampler-worker): inserted empty per-target sample queue id = 6786708133723474624 unit = oximeter
512026-02-24T15:42:17.958ZDEBGtfportd: added new link to kstat sampler link_kind = switch-port-control link_name = tfportrear0_0 unit = metrics-task-tracker
522026-02-24T15:42:17.961ZWARNtfportd: tfportqsfp0_0 has no addrs
532026-02-24T15:42:18.637ZINFOtfportd: added new ARP entry entry = 10.151.1.174->e6:ef:ab:0e:5b:72 interface = tfportqsfp0_0
542026-02-24T15:42:19.343ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
552026-02-24T15:42:19.349ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
562026-02-24T15:42:19.351ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
572026-02-24T15:42:19.352ZDEBGtfportd (kstat-sampler): adding new target unit = oximeter
582026-02-24T15:42:19.353ZDEBGtfportd (kstat-sampler-worker): storing new creation time for tracked target creation_time = 2026-02-24T15:42:01.240530225Z path = KstatPath { module: "link", instance: 0, name: "tfportqsfp0_0" } unit = oximeter
592026-02-24T15:42:19.353ZDEBGtfportd (kstat-sampler-worker): inserted empty per-target sample queue id = 8798779307421456225 unit = oximeter
602026-02-24T15:42:19.353ZDEBGtfportd: added new link to kstat sampler link_kind = switch-port-control link_name = tfportqsfp0_0 unit = metrics-task-tracker
612026-02-24T15:42:20.013ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
622026-02-24T15:42:20.018ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
632026-02-24T15:42:20.022ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
642026-02-24T15:42:20.723ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
652026-02-24T15:42:20.728ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
662026-02-24T15:42:20.730ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
672026-02-24T15:42:21.982ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
682026-02-24T15:42:21.986ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
692026-02-24T15:42:21.989ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
702026-02-24T15:42:22.961ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("195695a2-3340-4078-83ac-2b01bd06e64f.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("3e2caf2f-ac6b-4ba7-9a22-2b19e9eb8ad9.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("9d517f13-d3fc-4874-8f9c-627cd5595d8e.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("9d517f13-d3fc-4874-8f9c-627cd5595d8e.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 664, tv_nsec: 728199222 } }) unit = producer-server
712026-02-24T15:42:22.962ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
722026-02-24T15:42:22.995ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
732026-02-24T15:42:23.054ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
742026-02-24T15:42:23.060ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
752026-02-24T15:42:23.064ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
762026-02-24T15:42:24.071ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
772026-02-24T15:42:24.076ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
782026-02-24T15:42:24.079ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
792026-02-24T15:42:25.205ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
802026-02-24T15:42:25.210ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
812026-02-24T15:42:25.213ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
822026-02-24T15:42:26.165ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
832026-02-24T15:42:26.169ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
842026-02-24T15:42:26.172ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
852026-02-24T15:42:27.295ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
862026-02-24T15:42:27.300ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
872026-02-24T15:42:27.302ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
882026-02-24T15:42:27.961ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 6786708133723474624 n_samples = 6 unit = oximeter
892026-02-24T15:42:28.481ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
902026-02-24T15:42:28.485ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
912026-02-24T15:42:28.488ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
922026-02-24T15:42:29.356ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 8798779307421456225 n_samples = 6 unit = oximeter
932026-02-24T15:42:29.727ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
942026-02-24T15:42:29.732ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
952026-02-24T15:42:29.735ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
962026-02-24T15:42:30.765ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
972026-02-24T15:42:30.771ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
982026-02-24T15:42:30.774ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
992026-02-24T15:42:32.112ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1002026-02-24T15:42:32.118ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
1012026-02-24T15:42:32.120ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1022026-02-24T15:42:33.425ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1032026-02-24T15:42:33.430ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
1042026-02-24T15:42:33.432ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1052026-02-24T15:42:34.255ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1062026-02-24T15:42:34.259ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
1072026-02-24T15:42:34.262ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1082026-02-24T15:42:35.767ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1092026-02-24T15:42:35.772ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
1102026-02-24T15:42:35.775ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1112026-02-24T15:42:36.904ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1122026-02-24T15:42:36.909ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
1132026-02-24T15:42:36.912ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1142026-02-24T15:42:37.443ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1152026-02-24T15:42:37.449ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
1162026-02-24T15:42:37.451ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1172026-02-24T15:42:37.963ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 6786708133723474624 n_samples = 6 unit = oximeter
1182026-02-24T15:42:37.996ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
1192026-02-24T15:42:37.997ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 0 delay = 20.039348605s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
1202026-02-24T15:42:38.189ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1212026-02-24T15:42:38.193ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
1222026-02-24T15:42:38.196ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1232026-02-24T15:42:38.305ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("195695a2-3340-4078-83ac-2b01bd06e64f.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("3e2caf2f-ac6b-4ba7-9a22-2b19e9eb8ad9.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("9d517f13-d3fc-4874-8f9c-627cd5595d8e.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("9d517f13-d3fc-4874-8f9c-627cd5595d8e.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 680, tv_nsec: 72725101 } }) unit = producer-server
1242026-02-24T15:42:38.306ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
1252026-02-24T15:42:38.339ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
1262026-02-24T15:42:39.358ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 8798779307421456225 n_samples = 6 unit = oximeter
1272026-02-24T15:42:39.397ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1282026-02-24T15:42:39.402ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
1292026-02-24T15:42:39.405ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1302026-02-24T15:42:40.184ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1312026-02-24T15:42:40.190ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
1322026-02-24T15:42:40.192ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1332026-02-24T15:42:41.070ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1342026-02-24T15:42:41.077ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
1352026-02-24T15:42:41.080ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1362026-02-24T15:42:42.508ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1372026-02-24T15:42:42.518ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
1382026-02-24T15:42:42.527ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1392026-02-24T15:42:43.102ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1402026-02-24T15:42:43.107ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
1412026-02-24T15:42:43.112ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1422026-02-24T15:42:44.432ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1432026-02-24T15:42:44.438ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
1442026-02-24T15:42:44.442ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1452026-02-24T15:42:45.370ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1462026-02-24T15:42:45.539ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
1472026-02-24T15:42:45.545ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1482026-02-24T15:42:46.076ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1492026-02-24T15:42:46.084ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
1502026-02-24T15:42:46.101ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1512026-02-24T15:42:47.261ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1522026-02-24T15:42:47.266ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
1532026-02-24T15:42:47.269ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1542026-02-24T15:42:47.774ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 6786708133723474624 n_samples = 6 unit = oximeter
1552026-02-24T15:42:48.240ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1562026-02-24T15:42:48.246ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
1572026-02-24T15:42:48.249ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1582026-02-24T15:42:49.158ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 8798779307421456225 n_samples = 6 unit = oximeter
1592026-02-24T15:42:49.422ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1602026-02-24T15:42:49.427ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
1612026-02-24T15:42:49.430ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1622026-02-24T15:42:50.348ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1632026-02-24T15:42:50.353ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
1642026-02-24T15:42:50.356ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1652026-02-24T15:42:51.672ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1662026-02-24T15:42:51.677ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
1672026-02-24T15:42:51.680ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1682026-02-24T15:42:52.636ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1692026-02-24T15:42:52.646ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
1702026-02-24T15:42:52.649ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1712026-02-24T15:42:53.131ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
1722026-02-24T15:42:53.136ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 1 delay = 35.388187716s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
1732026-02-24T15:42:53.625ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("195695a2-3340-4078-83ac-2b01bd06e64f.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("3e2caf2f-ac6b-4ba7-9a22-2b19e9eb8ad9.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("9d517f13-d3fc-4874-8f9c-627cd5595d8e.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("9d517f13-d3fc-4874-8f9c-627cd5595d8e.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 695, tv_nsec: 601103713 } }) unit = producer-server
1742026-02-24T15:42:53.626ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
1752026-02-24T15:42:53.661ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
1762026-02-24T15:42:53.831ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1772026-02-24T15:42:53.837ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
1782026-02-24T15:42:53.841ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1792026-02-24T15:42:55.786ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1802026-02-24T15:42:55.791ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
1812026-02-24T15:42:55.794ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1822026-02-24T15:42:56.461ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1832026-02-24T15:42:56.469ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
1842026-02-24T15:42:56.473ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1852026-02-24T15:42:57.535ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1862026-02-24T15:42:57.543ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
1872026-02-24T15:42:57.547ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1882026-02-24T15:42:57.771ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 6786708133723474624 n_samples = 6 unit = oximeter
1892026-02-24T15:42:58.558ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1902026-02-24T15:42:58.565ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
1912026-02-24T15:42:58.569ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1922026-02-24T15:42:59.157ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 8798779307421456225 n_samples = 6 unit = oximeter
1932026-02-24T15:42:59.658ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1942026-02-24T15:42:59.662ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
1952026-02-24T15:42:59.665ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1962026-02-24T15:43:00.680ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1972026-02-24T15:43:00.687ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
1982026-02-24T15:43:00.690ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1992026-02-24T15:43:01.231ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2002026-02-24T15:43:01.237ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
2012026-02-24T15:43:01.240ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2022026-02-24T15:43:02.739ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2032026-02-24T15:43:02.743ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
2042026-02-24T15:43:02.746ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2052026-02-24T15:43:04.131ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2062026-02-24T15:43:04.136ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
2072026-02-24T15:43:04.139ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2082026-02-24T15:43:05.469ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2092026-02-24T15:43:05.476ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
2102026-02-24T15:43:05.480ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2112026-02-24T15:43:06.800ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2122026-02-24T15:43:06.807ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
2132026-02-24T15:43:06.811ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2142026-02-24T15:43:07.771ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 6786708133723474624 n_samples = 6 unit = oximeter
2152026-02-24T15:43:07.884ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2162026-02-24T15:43:07.890ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
2172026-02-24T15:43:07.892ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2182026-02-24T15:43:08.663ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
2192026-02-24T15:43:08.665ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 2 delay = 50.91378114s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
2202026-02-24T15:43:09.156ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 8798779307421456225 n_samples = 6 unit = oximeter
2212026-02-24T15:43:09.231ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2222026-02-24T15:43:09.238ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
2232026-02-24T15:43:09.242ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2242026-02-24T15:43:09.778ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2252026-02-24T15:43:09.784ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
2262026-02-24T15:43:09.788ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2272026-02-24T15:43:09.804ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("195695a2-3340-4078-83ac-2b01bd06e64f.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("3e2caf2f-ac6b-4ba7-9a22-2b19e9eb8ad9.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("9d517f13-d3fc-4874-8f9c-627cd5595d8e.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("9d517f13-d3fc-4874-8f9c-627cd5595d8e.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 711, tv_nsec: 777989503 } }) unit = producer-server
2282026-02-24T15:43:09.805ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
2292026-02-24T15:43:09.844ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
2302026-02-24T15:43:11.112ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2312026-02-24T15:43:11.120ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
2322026-02-24T15:43:11.124ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2332026-02-24T15:43:12.268ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2342026-02-24T15:43:12.273ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
2352026-02-24T15:43:12.277ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2362026-02-24T15:43:13.411ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2372026-02-24T15:43:13.416ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
2382026-02-24T15:43:13.419ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2392026-02-24T15:43:14.802ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2402026-02-24T15:43:14.808ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
2412026-02-24T15:43:14.811ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2422026-02-24T15:43:16.266ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2432026-02-24T15:43:16.271ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
2442026-02-24T15:43:16.275ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2452026-02-24T15:43:17.666ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2462026-02-24T15:43:17.677ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
2472026-02-24T15:43:17.683ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2482026-02-24T15:43:17.772ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 6786708133723474624 n_samples = 6 unit = oximeter
2492026-02-24T15:43:18.720ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2502026-02-24T15:43:18.727ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
2512026-02-24T15:43:18.731ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2522026-02-24T15:43:19.346ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 8798779307421456225 n_samples = 6 unit = oximeter
2532026-02-24T15:43:19.667ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2542026-02-24T15:43:19.686ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
2552026-02-24T15:43:19.694ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2562026-02-24T15:43:24.563ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2572026-02-24T15:43:24.749ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
2582026-02-24T15:43:24.757ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2592026-02-24T15:43:24.848ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
2602026-02-24T15:43:25.716ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 3 delay = 67.965363612s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
2612026-02-24T15:43:25.951ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2622026-02-24T15:43:25.957ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
2632026-02-24T15:43:25.961ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2642026-02-24T15:43:26.664ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2652026-02-24T15:43:26.672ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
2662026-02-24T15:43:26.676ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2672026-02-24T15:43:27.834ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 6786708133723474624 n_samples = 6 unit = oximeter
2682026-02-24T15:43:27.884ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("195695a2-3340-4078-83ac-2b01bd06e64f.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("3e2caf2f-ac6b-4ba7-9a22-2b19e9eb8ad9.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("9d517f13-d3fc-4874-8f9c-627cd5595d8e.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("9d517f13-d3fc-4874-8f9c-627cd5595d8e.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 729, tv_nsec: 857280410 } }) unit = producer-server
2692026-02-24T15:43:27.886ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
2702026-02-24T15:43:28.069ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
2712026-02-24T15:43:28.082ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2722026-02-24T15:43:28.094ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
2732026-02-24T15:43:28.098ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2742026-02-24T15:43:28.642ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2752026-02-24T15:43:28.653ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
2762026-02-24T15:43:29.168ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2772026-02-24T15:43:29.478ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 8798779307421456225 n_samples = 6 unit = oximeter
2782026-02-24T15:43:30.375ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2792026-02-24T15:43:30.383ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
2802026-02-24T15:43:30.387ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2812026-02-24T15:43:31.761ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2822026-02-24T15:43:31.767ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
2832026-02-24T15:43:31.770ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2842026-02-24T15:43:33.197ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2852026-02-24T15:43:33.203ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
2862026-02-24T15:43:33.254ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2872026-02-24T15:43:34.337ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2882026-02-24T15:43:34.343ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
2892026-02-24T15:43:34.346ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2902026-02-24T15:43:35.218ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2912026-02-24T15:43:35.223ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
2922026-02-24T15:43:35.227ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2932026-02-24T15:43:36.106ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2942026-02-24T15:43:36.111ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
2952026-02-24T15:43:36.114ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2962026-02-24T15:43:37.184ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2972026-02-24T15:43:37.189ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
2982026-02-24T15:43:37.192ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2992026-02-24T15:43:37.840ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 6786708133723474624 n_samples = 6 unit = oximeter
3002026-02-24T15:43:38.628ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3012026-02-24T15:43:38.633ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
3022026-02-24T15:43:38.636ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3032026-02-24T15:43:39.483ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 8798779307421456225 n_samples = 6 unit = oximeter
3042026-02-24T15:43:39.872ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3052026-02-24T15:43:39.884ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
3062026-02-24T15:43:39.895ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3072026-02-24T15:43:40.753ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3082026-02-24T15:43:40.760ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
3092026-02-24T15:43:40.764ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3102026-02-24T15:43:41.420ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3112026-02-24T15:43:41.427ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
3122026-02-24T15:43:41.431ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3132026-02-24T15:43:42.291ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3142026-02-24T15:43:42.297ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
3152026-02-24T15:43:42.301ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3162026-02-24T15:43:43.043ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3172026-02-24T15:43:43.048ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
3182026-02-24T15:43:43.051ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3192026-02-24T15:43:43.071ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
3202026-02-24T15:43:43.073ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 4 delay = 85.322219183s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
3212026-02-24T15:43:43.582ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3222026-02-24T15:43:43.587ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
3232026-02-24T15:43:43.590ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3242026-02-24T15:43:44.646ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3252026-02-24T15:43:44.653ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
3262026-02-24T15:43:44.657ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3272026-02-24T15:43:45.255ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("195695a2-3340-4078-83ac-2b01bd06e64f.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("3e2caf2f-ac6b-4ba7-9a22-2b19e9eb8ad9.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("9d517f13-d3fc-4874-8f9c-627cd5595d8e.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("9d517f13-d3fc-4874-8f9c-627cd5595d8e.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 747, tv_nsec: 228721618 } }) unit = producer-server
3282026-02-24T15:43:45.255ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
3292026-02-24T15:43:45.292ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
3302026-02-24T15:43:45.471ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3312026-02-24T15:43:45.477ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
3322026-02-24T15:43:45.480ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3332026-02-24T15:43:46.321ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3342026-02-24T15:43:46.327ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
3352026-02-24T15:43:46.331ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3362026-02-24T15:43:46.857ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3372026-02-24T15:43:46.864ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
3382026-02-24T15:43:46.868ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3392026-02-24T15:43:47.545ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3402026-02-24T15:43:47.551ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
3412026-02-24T15:43:47.554ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3422026-02-24T15:43:47.842ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 6786708133723474624 n_samples = 6 unit = oximeter
3432026-02-24T15:43:48.845ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3442026-02-24T15:43:48.851ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
3452026-02-24T15:43:48.854ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3462026-02-24T15:43:49.485ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 8798779307421456225 n_samples = 6 unit = oximeter
3472026-02-24T15:43:50.245ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3482026-02-24T15:43:50.249ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
3492026-02-24T15:43:50.252ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3502026-02-24T15:43:50.850ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3512026-02-24T15:43:50.857ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
3522026-02-24T15:43:50.862ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3532026-02-24T15:43:51.491ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3542026-02-24T15:43:51.498ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
3552026-02-24T15:43:51.502ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3562026-02-24T15:43:52.048ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3572026-02-24T15:43:52.056ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
3582026-02-24T15:43:52.060ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3592026-02-24T15:43:52.933ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3602026-02-24T15:43:52.937ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
3612026-02-24T15:43:52.940ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3622026-02-24T15:43:54.349ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3632026-02-24T15:43:54.354ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
3642026-02-24T15:43:54.357ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3652026-02-24T15:43:55.704ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3662026-02-24T15:43:55.714ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
3672026-02-24T15:43:55.720ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3682026-02-24T15:43:56.914ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3692026-02-24T15:43:56.928ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
3702026-02-24T15:43:56.933ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3712026-02-24T15:43:57.844ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 6786708133723474624 n_samples = 6 unit = oximeter
3722026-02-24T15:43:57.904ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3732026-02-24T15:43:57.913ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
3742026-02-24T15:43:57.918ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3752026-02-24T15:43:58.575ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3762026-02-24T15:43:58.582ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
3772026-02-24T15:43:58.587ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3782026-02-24T15:43:59.489ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 8798779307421456225 n_samples = 6 unit = oximeter
3792026-02-24T15:44:00.051ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3802026-02-24T15:44:00.056ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
3812026-02-24T15:44:00.059ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3822026-02-24T15:44:00.293ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
3832026-02-24T15:44:00.294ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 5 delay = 102.542776555s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
3842026-02-24T15:44:01.498ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3852026-02-24T15:44:01.503ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
3862026-02-24T15:44:01.506ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3872026-02-24T15:44:02.779ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3882026-02-24T15:44:02.785ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
3892026-02-24T15:44:02.788ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3902026-02-24T15:44:04.122ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3912026-02-24T15:44:04.128ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
3922026-02-24T15:44:04.132ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3932026-02-24T15:44:05.372ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3942026-02-24T15:44:05.378ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
3952026-02-24T15:44:05.382ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3962026-02-24T15:44:05.637ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("195695a2-3340-4078-83ac-2b01bd06e64f.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("3e2caf2f-ac6b-4ba7-9a22-2b19e9eb8ad9.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("9d517f13-d3fc-4874-8f9c-627cd5595d8e.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("9d517f13-d3fc-4874-8f9c-627cd5595d8e.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 767, tv_nsec: 610424835 } }) unit = producer-server
3972026-02-24T15:44:05.638ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
3982026-02-24T15:44:05.671ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
3992026-02-24T15:44:05.770ZDEBGtfportd (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 503, headers: {"content-type": "application/json", "x-request-id": "aa24c8d3-cfc5-44d1-a780-41a72fca2167", "content-length": "133", "date": "Tue, 24 Feb 2026 15:44:05 GMT"} }) unit = producer-server
4002026-02-24T15:44:05.773ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 6 delay = 108.02119802s error = "Error Response: status: 503 Service Unavailable; headers: {\\"content-type\\": \\"application/json\\", \\"x-request-id\\": \\"aa24c8d3-cfc5-44d1-a780-41a72fca2167\\", \\"content-length\\": \\"133\\", \\"date\\": \\"Tue, 24 Feb 2026 15:44:05 GMT\\"}; value: Error { error_code: Some(\\"ServiceNotAvailable\\"), message: \\"Service Unavailable\\", request_id: \\"aa24c8d3-cfc5-44d1-a780-41a72fca2167\\" }" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
4012026-02-24T15:44:06.247ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4022026-02-24T15:44:06.255ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
4032026-02-24T15:44:06.261ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4042026-02-24T15:44:06.790ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4052026-02-24T15:44:06.796ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
4062026-02-24T15:44:06.800ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4072026-02-24T15:44:07.618ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4082026-02-24T15:44:07.627ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
4092026-02-24T15:44:07.632ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4102026-02-24T15:44:07.849ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 6786708133723474624 n_samples = 6 unit = oximeter
4112026-02-24T15:44:08.288ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4122026-02-24T15:44:08.294ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
4132026-02-24T15:44:08.297ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4142026-02-24T15:44:09.001ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4152026-02-24T15:44:09.008ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
4162026-02-24T15:44:09.011ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4172026-02-24T15:44:09.493ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 8798779307421456225 n_samples = 6 unit = oximeter
4182026-02-24T15:44:10.094ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4192026-02-24T15:44:10.099ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
4202026-02-24T15:44:10.102ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4212026-02-24T15:44:10.798ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4222026-02-24T15:44:10.804ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
4232026-02-24T15:44:10.807ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4242026-02-24T15:44:11.919ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4252026-02-24T15:44:11.925ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
4262026-02-24T15:44:11.929ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4272026-02-24T15:44:13.042ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4282026-02-24T15:44:13.048ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
4292026-02-24T15:44:13.051ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4302026-02-24T15:44:13.642ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4312026-02-24T15:44:13.648ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
4322026-02-24T15:44:13.652ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4332026-02-24T15:44:15.070ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4342026-02-24T15:44:15.077ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
4352026-02-24T15:44:15.080ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4362026-02-24T15:44:16.347ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4372026-02-24T15:44:16.352ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
4382026-02-24T15:44:16.355ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4392026-02-24T15:44:17.127ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4402026-02-24T15:44:17.131ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
4412026-02-24T15:44:17.134ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4422026-02-24T15:44:17.851ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 6786708133723474624 n_samples = 6 unit = oximeter
4432026-02-24T15:44:18.495ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4442026-02-24T15:44:18.501ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
4452026-02-24T15:44:18.504ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4462026-02-24T15:44:19.463ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4472026-02-24T15:44:19.469ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
4482026-02-24T15:44:19.472ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4492026-02-24T15:44:19.495ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 8798779307421456225 n_samples = 6 unit = oximeter
4502026-02-24T15:44:20.350ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4512026-02-24T15:44:20.356ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
4522026-02-24T15:44:20.359ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4532026-02-24T15:44:20.440ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("195695a2-3340-4078-83ac-2b01bd06e64f.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("3e2caf2f-ac6b-4ba7-9a22-2b19e9eb8ad9.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("9d517f13-d3fc-4874-8f9c-627cd5595d8e.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("9d517f13-d3fc-4874-8f9c-627cd5595d8e.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 782, tv_nsec: 414172123 } }) unit = producer-server
4542026-02-24T15:44:20.441ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
4552026-02-24T15:44:20.474ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
4562026-02-24T15:44:20.537ZDEBGtfportd (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "bb9fb3cc-c6c8-451f-8a24-00cb79b99710", "content-length": "41", "date": "Tue, 24 Feb 2026 15:44:20 GMT"} }) unit = producer-server
4572026-02-24T15:44:20.539ZDEBGtfportd (producer-registration-task): successfully registered with Nexus, pausing until time to renew lease lease_duration = 600s unit = producer-server wait_period = 150s
4582026-02-24T15:44:21.128ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4592026-02-24T15:44:21.134ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
4602026-02-24T15:44:21.137ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4612026-02-24T15:44:21.777ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4622026-02-24T15:44:21.783ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
4632026-02-24T15:44:21.786ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4642026-02-24T15:44:23.092ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4652026-02-24T15:44:23.097ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
4662026-02-24T15:44:23.100ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4672026-02-24T15:44:23.903ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4682026-02-24T15:44:23.908ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
4692026-02-24T15:44:23.911ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4702026-02-24T15:44:25.258ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4712026-02-24T15:44:25.264ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
4722026-02-24T15:44:25.268ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4732026-02-24T15:44:26.280ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4742026-02-24T15:44:26.286ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
4752026-02-24T15:44:26.289ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4762026-02-24T15:44:27.223ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4772026-02-24T15:44:27.228ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
4782026-02-24T15:44:27.231ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4792026-02-24T15:44:27.859ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 6786708133723474624 n_samples = 6 unit = oximeter
4802026-02-24T15:44:28.361ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4812026-02-24T15:44:28.366ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
4822026-02-24T15:44:28.369ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4832026-02-24T15:44:29.497ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 8798779307421456225 n_samples = 6 unit = oximeter
4842026-02-24T15:44:29.794ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4852026-02-24T15:44:29.800ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
4862026-02-24T15:44:29.804ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4872026-02-24T15:44:30.337ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4882026-02-24T15:44:30.341ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
4892026-02-24T15:44:30.344ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4902026-02-24T15:44:31.134ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4912026-02-24T15:44:31.139ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
4922026-02-24T15:44:31.142ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4932026-02-24T15:44:32.333ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4942026-02-24T15:44:32.338ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
4952026-02-24T15:44:32.341ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4962026-02-24T15:44:33.622ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4972026-02-24T15:44:33.628ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
4982026-02-24T15:44:33.631ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4992026-02-24T15:44:34.171ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5002026-02-24T15:44:34.177ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
5012026-02-24T15:44:34.180ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5022026-02-24T15:44:34.724ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5032026-02-24T15:44:34.730ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
5042026-02-24T15:44:34.733ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5052026-02-24T15:44:36.110ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5062026-02-24T15:44:36.117ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
5072026-02-24T15:44:36.121ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5082026-02-24T15:44:37.527ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5092026-02-24T15:44:37.533ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
5102026-02-24T15:44:37.536ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5112026-02-24T15:44:37.860ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 6786708133723474624 n_samples = 6 unit = oximeter
5122026-02-24T15:44:38.880ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5132026-02-24T15:44:38.886ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
5142026-02-24T15:44:38.889ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5152026-02-24T15:44:39.500ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 8798779307421456225 n_samples = 6 unit = oximeter
5162026-02-24T15:44:40.203ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5172026-02-24T15:44:40.209ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
5182026-02-24T15:44:40.212ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5192026-02-24T15:44:41.655ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5202026-02-24T15:44:41.661ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
5212026-02-24T15:44:41.664ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5222026-02-24T15:44:42.711ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5232026-02-24T15:44:42.717ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
5242026-02-24T15:44:42.719ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5252026-02-24T15:44:43.715ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5262026-02-24T15:44:43.720ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
5272026-02-24T15:44:43.722ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5282026-02-24T15:44:44.901ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5292026-02-24T15:44:44.907ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
5302026-02-24T15:44:44.911ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5312026-02-24T15:44:45.846ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5322026-02-24T15:44:45.853ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
5332026-02-24T15:44:45.856ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5342026-02-24T15:44:46.833ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5352026-02-24T15:44:46.840ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
5362026-02-24T15:44:46.845ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5372026-02-24T15:44:47.690ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5382026-02-24T15:44:47.697ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
5392026-02-24T15:44:47.700ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5402026-02-24T15:44:47.864ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 6786708133723474624 n_samples = 6 unit = oximeter
5412026-02-24T15:44:48.891ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5422026-02-24T15:44:48.895ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
5432026-02-24T15:44:48.899ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5442026-02-24T15:44:49.504ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 8798779307421456225 n_samples = 6 unit = oximeter
5452026-02-24T15:44:50.241ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5462026-02-24T15:44:50.248ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
5472026-02-24T15:44:50.251ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5482026-02-24T15:44:51.532ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5492026-02-24T15:44:51.537ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
5502026-02-24T15:44:51.541ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5512026-02-24T15:44:52.926ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5522026-02-24T15:44:52.931ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
5532026-02-24T15:44:52.934ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5542026-02-24T15:44:53.900ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5552026-02-24T15:44:53.906ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
5562026-02-24T15:44:53.910ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5572026-02-24T15:44:55.135ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5582026-02-24T15:44:55.141ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
5592026-02-24T15:44:55.145ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5602026-02-24T15:44:56.600ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5612026-02-24T15:44:56.605ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
5622026-02-24T15:44:56.608ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5632026-02-24T15:44:57.723ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5642026-02-24T15:44:57.729ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
5652026-02-24T15:44:57.732ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5662026-02-24T15:44:57.867ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 6786708133723474624 n_samples = 6 unit = oximeter
5672026-02-24T15:44:58.846ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5682026-02-24T15:44:58.851ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
5692026-02-24T15:44:58.855ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5702026-02-24T15:44:59.479ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5712026-02-24T15:44:59.485ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
5722026-02-24T15:44:59.489ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5732026-02-24T15:44:59.506ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 8798779307421456225 n_samples = 6 unit = oximeter
5742026-02-24T15:45:00.689ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5752026-02-24T15:45:00.697ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
5762026-02-24T15:45:00.702ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5772026-02-24T15:45:01.499ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5782026-02-24T15:45:01.508ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::8c72:21ff:fe51:f53e]
5792026-02-24T15:45:01.513ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]