Max level shown:
1 [ Feb 14 05:12:14 Enabled. ]
2 [ Feb 14 05:12:14 Rereading configuration. ]
3 [ Feb 14 05:12:14 Rereading configuration. ]
4 [ Feb 14 05:12:35 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dendrite/bin/tfportd --sync-only &"). ]
5 [ Feb 14 05:12:35 Method "start" exited with status 0. ]
6 No non-localhost IPv6 addresses found in SMF properties
72026-02-14T05:12:35.921ZINFOtfportd: connecting to dpd host = [::1] port = 12224
82026-02-14T05:12:35.975ZINFOtfportd: connected to dpd running softnpu-37992295
92026-02-14T05:12:35.975ZINFOtfportd: running in sync-only mode
102026-02-14T05:12:35.976ZINFOtfportd: no non-localhost IPv6 listen address available, waiting for SMF update unit = oximeter
112026-02-14T05:12:35.977ZINFOtfportd: refreshing SMF config prior to waiting on signals unit = signal_handler
12 No non-localhost IPv6 addresses found in SMF properties
132026-02-14T05:12:35.979ZINFOtfportd: refreshed config: Config { log_file: None, log_format: Json, listen_addresses: [ [::1]:12231, ], pkt_source: None, dpd_host: "[::1]", dpd_port: 12224, vlan_link: None, vlan_data: None, techport0_prefix: None, techport1_prefix: None, rack_id: Some( c6244b46-9fce-408d-94b2-e1f9b9033e58, ), sled_id: Some( a15c8e19-6464-440c-bfd7-5668c00f271e, ), sled_model: Some( "i86pc", ), sled_revision: Some( 0, ), sled_serial: Some( "sock", ), }
142026-02-14T05:12:35.979ZINFOtfportd: no non-localhost IPv6 listen address available, waiting for SMF update unit = oximeter
152026-02-14T05:12:35.985ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::989d:6ff:fe74:75d7->9a:9d:06:74:75:d7 interface = tfportrear0_0
162026-02-14T05:12:35.985ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
172026-02-14T05:12:35.985ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::6013:5aff:fe23:a7e1->62:13:5a:23:a7:e1 interface = tfportrear0_0
182026-02-14T05:12:35.991ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
192026-02-14T05:12:35.996ZWARNtfportd: tfportqsfp0_0 has no addrs
20 [ Feb 14 05:12:36 Rereading configuration. ]
21 [ Feb 14 05:12:36 Executing refresh method (:kill). ]
22 [ Feb 14 05:12:36 Stopping because all processes in service exited. ]
23 [ Feb 14 05:12:36 Executing stop method (:kill). ]
24 [ Feb 14 05:12:36 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dendrite/bin/tfportd --sync-only &"). ]
25 [ Feb 14 05:12:36 Method "start" exited with status 0. ]
262026-02-14T05:12:36.557ZINFOtfportd: connecting to dpd host = [::1] port = 12224
272026-02-14T05:12:36.607ZINFOtfportd: connected to dpd running softnpu-37992295
282026-02-14T05:12:36.607ZINFOtfportd: running in sync-only mode
292026-02-14T05:12:36.607ZINFOtfportd: found suitable IPv6 address for oximeter producer server address = fd00:1122:3344:101::2 unit = oximeter
302026-02-14T05:12:36.609ZINFOtfportd: refreshing SMF config prior to waiting on signals unit = signal_handler
312026-02-14T05:12:36.609ZDEBGtfportd: extracted oximeter configuration data config = OximeterConfig { listen_address: fd00:1122:3344:101::2, sled_identifiers: SledIdentifiers { rack_id: c6244b46-9fce-408d-94b2-e1f9b9033e58, sled_id: a15c8e19-6464-440c-bfd7-5668c00f271e, model: "i86pc", revision: 0, serial: "sock" }, switch_identifiers: SwitchIdentifiers { asic_backend: "softnpu", fab: None, lot: None, model: "FAKE_SIM_SIDECAR", revision: 0, serial: "SimSidecar0", sidecar_id: a671489e-c1a0-4df0-a424-07cee9579c68, slot: 0, wafer: None, wafer_loc: None } } unit = oximeter
322026-02-14T05:12:36.609ZDEBGtfportd: created producer ID producer_id = c1098dc1-3a0a-4971-8f41-b05f905b852e unit = oximeter
332026-02-14T05:12:36.611ZINFOtfportd: refreshed config: Config { log_file: None, log_format: Json, listen_addresses: [ [fd00:1122:3344:101::2]:12231, [::1]:12231, ], pkt_source: None, dpd_host: "[::1]", dpd_port: 12224, vlan_link: None, vlan_data: None, techport0_prefix: None, techport1_prefix: None, rack_id: Some( c6244b46-9fce-408d-94b2-e1f9b9033e58, ), sled_id: Some( a15c8e19-6464-440c-bfd7-5668c00f271e, ), sled_model: Some( "i86pc", ), sled_revision: Some( 0, ), sled_serial: Some( "sock", ), }
342026-02-14T05:12:36.619ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
352026-02-14T05:12:36.620ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::989d:6ff:fe74:75d7->9a:9d:06:74:75:d7 interface = tfportrear0_0
362026-02-14T05:12:36.620ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::6013:5aff:fe23:a7e1->62:13:5a:23:a7:e1 interface = tfportrear0_0
372026-02-14T05:12:36.622ZDEBGtfportd: registered DTrace probes unit = producer-server
382026-02-14T05:12:36.624ZDEBGtfportd (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::2]:39931 method = GET path = /{producer_id} unit = producer-server versions = all
392026-02-14T05:12:36.624ZINFOtfportd (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:328 local_addr = [fd00:1122:3344:101::2]:39931 unit = producer-server
402026-02-14T05:12:36.624ZDEBGtfportd (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::2]:39931 unit = producer-server
412026-02-14T05:12:36.624ZDEBGtfportd: Requested any available port, Dropshot server has been bound to [fd00:1122:3344:101::2]:39931 unit = producer-server
422026-02-14T05:12:36.624ZDEBGtfportd: Nexus IP not provided, will use DNS to resolve it unit = producer-server
432026-02-14T05:12:36.624ZINFOtfportd (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/internal-dns/resolver/src/resolver.rs:144 unit = producer-server
442026-02-14T05:12:36.625ZDEBGtfportd: starting producer registration task unit = producer-server
452026-02-14T05:12:36.625ZINFOtfportd: starting oximeter metric producer server address = [fd00:1122:3344:101::2]:39931 file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:279 interval = 30s producer_id = c1098dc1-3a0a-4971-8f41-b05f905b852e unit = producer-server
462026-02-14T05:12:36.625ZINFOtfportd: created oximeter producer server unit = oximeter
472026-02-14T05:12:36.625ZDEBGtfportd (producer-registration-task): registering as oximeter producer with Nexus registration_count = 0 unit = producer-server
482026-02-14T05:12:36.626ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
492026-02-14T05:12:36.626ZDEBGtfportd (kstat-sampler): adding new target unit = oximeter
502026-02-14T05:12:36.628ZDEBGtfportd (kstat-sampler-worker): storing new creation time for tracked target creation_time = 2026-02-14T05:12:09.801336837Z path = KstatPath { module: "link", instance: 0, name: "tfportrear0_0" } unit = oximeter
512026-02-14T05:12:36.628ZDEBGtfportd (kstat-sampler-worker): inserted empty per-target sample queue id = 5600952849460923443 unit = oximeter
522026-02-14T05:12:36.628ZDEBGtfportd: added new link to kstat sampler link_kind = switch-port-control link_name = tfportrear0_0 unit = metrics-task-tracker
532026-02-14T05:12:36.630ZWARNtfportd: tfportqsfp0_0 has no addrs
542026-02-14T05:12:37.658ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
552026-02-14T05:12:37.664ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
562026-02-14T05:12:37.667ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
572026-02-14T05:12:37.667ZDEBGtfportd (kstat-sampler): adding new target unit = oximeter
582026-02-14T05:12:37.668ZDEBGtfportd (kstat-sampler-worker): storing new creation time for tracked target creation_time = 2026-02-14T05:12:09.801204724Z path = KstatPath { module: "link", instance: 0, name: "tfportqsfp0_0" } unit = oximeter
592026-02-14T05:12:37.668ZDEBGtfportd (kstat-sampler-worker): inserted empty per-target sample queue id = 16955136234713264223 unit = oximeter
602026-02-14T05:12:37.668ZDEBGtfportd: added new link to kstat sampler link_kind = switch-port-control link_name = tfportqsfp0_0 unit = metrics-task-tracker
612026-02-14T05:12:37.762ZINFOtfportd: added new ARP entry entry = 10.151.2.174->32:e6:b2:ff:79:f5 interface = tfportqsfp0_0
622026-02-14T05:12:38.592ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
632026-02-14T05:12:38.599ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
642026-02-14T05:12:38.602ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
652026-02-14T05:12:39.209ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
662026-02-14T05:12:39.215ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
672026-02-14T05:12:39.218ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
682026-02-14T05:12:40.638ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
692026-02-14T05:12:40.643ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
702026-02-14T05:12:40.646ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
712026-02-14T05:12:41.628ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("054da191-a178-41f7-88a3-dc0bff867820.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("092896e9-df71-4acb-97cc-7af5dc187ed9.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("0cfdae07-f989-48d2-9467-216be9ce6ae4.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("0cfdae07-f989-48d2-9467-216be9ce6ae4.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 8250, tv_nsec: 381798716 } }) unit = producer-server
722026-02-14T05:12:41.628ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::a]:12221 unit = producer-server
732026-02-14T05:12:41.661ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
742026-02-14T05:12:41.737ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
752026-02-14T05:12:41.742ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
762026-02-14T05:12:41.745ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
772026-02-14T05:12:42.260ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
782026-02-14T05:12:42.265ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
792026-02-14T05:12:42.268ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
802026-02-14T05:12:42.880ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
812026-02-14T05:12:42.885ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
822026-02-14T05:12:42.887ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
832026-02-14T05:12:43.964ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
842026-02-14T05:12:43.970ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
852026-02-14T05:12:43.973ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
862026-02-14T05:12:45.020ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
872026-02-14T05:12:45.025ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
882026-02-14T05:12:45.028ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
892026-02-14T05:12:45.698ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
902026-02-14T05:12:45.703ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
912026-02-14T05:12:45.706ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
922026-02-14T05:12:46.632ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5600952849460923443 n_samples = 6 unit = oximeter
932026-02-14T05:12:46.676ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
942026-02-14T05:12:46.681ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
952026-02-14T05:12:46.683ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
962026-02-14T05:12:47.670ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 16955136234713264223 n_samples = 6 unit = oximeter
972026-02-14T05:12:48.047ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
982026-02-14T05:12:48.052ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
992026-02-14T05:12:48.055ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1002026-02-14T05:12:48.841ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1012026-02-14T05:12:48.845ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
1022026-02-14T05:12:48.848ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1032026-02-14T05:12:49.793ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1042026-02-14T05:12:49.798ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
1052026-02-14T05:12:49.800ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1062026-02-14T05:12:51.069ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1072026-02-14T05:12:51.074ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
1082026-02-14T05:12:51.076ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1092026-02-14T05:12:52.315ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1102026-02-14T05:12:52.320ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
1112026-02-14T05:12:52.323ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1122026-02-14T05:12:53.182ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1132026-02-14T05:12:53.187ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
1142026-02-14T05:12:53.189ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1152026-02-14T05:12:54.464ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1162026-02-14T05:12:54.469ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
1172026-02-14T05:12:54.471ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1182026-02-14T05:12:55.844ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1192026-02-14T05:12:55.850ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
1202026-02-14T05:12:55.853ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1212026-02-14T05:12:56.428ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1222026-02-14T05:12:56.433ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
1232026-02-14T05:12:56.437ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1242026-02-14T05:12:56.620ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5600952849460923443 n_samples = 6 unit = oximeter
1252026-02-14T05:12:56.648ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", source: TimedOut }) unit = producer-server
1262026-02-14T05:12:56.649ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 0 delay = 20.038751253s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
1272026-02-14T05:12:57.009ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("054da191-a178-41f7-88a3-dc0bff867820.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("092896e9-df71-4acb-97cc-7af5dc187ed9.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("0cfdae07-f989-48d2-9467-216be9ce6ae4.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("0cfdae07-f989-48d2-9467-216be9ce6ae4.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 8265, tv_nsec: 778475091 } }) unit = producer-server
1282026-02-14T05:12:57.009ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::a]:12221 unit = producer-server
1292026-02-14T05:12:57.042ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
1302026-02-14T05:12:57.207ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1312026-02-14T05:12:57.211ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
1322026-02-14T05:12:57.214ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1332026-02-14T05:12:57.654ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 16955136234713264223 n_samples = 6 unit = oximeter
1342026-02-14T05:12:58.635ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1352026-02-14T05:12:58.646ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
1362026-02-14T05:12:58.655ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1372026-02-14T05:13:00.160ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1382026-02-14T05:13:00.168ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
1392026-02-14T05:13:00.174ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1402026-02-14T05:13:01.583ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1412026-02-14T05:13:01.589ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
1422026-02-14T05:13:01.592ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1432026-02-14T05:13:02.284ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1442026-02-14T05:13:02.289ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
1452026-02-14T05:13:02.292ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1462026-02-14T05:13:03.568ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1472026-02-14T05:13:03.573ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
1482026-02-14T05:13:03.576ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1492026-02-14T05:13:05.055ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1502026-02-14T05:13:05.060ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
1512026-02-14T05:13:05.063ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1522026-02-14T05:13:05.791ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1532026-02-14T05:13:05.795ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
1542026-02-14T05:13:05.798ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1552026-02-14T05:13:06.597ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5600952849460923443 n_samples = 6 unit = oximeter
1562026-02-14T05:13:06.726ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1572026-02-14T05:13:06.732ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
1582026-02-14T05:13:06.735ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1592026-02-14T05:13:07.471ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1602026-02-14T05:13:07.475ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
1612026-02-14T05:13:07.477ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1622026-02-14T05:13:07.629ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 16955136234713264223 n_samples = 6 unit = oximeter
1632026-02-14T05:13:08.167ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1642026-02-14T05:13:08.172ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
1652026-02-14T05:13:08.175ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1662026-02-14T05:13:09.583ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1672026-02-14T05:13:09.591ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
1682026-02-14T05:13:09.596ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1692026-02-14T05:13:10.141ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1702026-02-14T05:13:10.146ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
1712026-02-14T05:13:10.149ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1722026-02-14T05:13:10.736ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1732026-02-14T05:13:10.741ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
1742026-02-14T05:13:10.744ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1752026-02-14T05:13:12.013ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", source: TimedOut }) unit = producer-server
1762026-02-14T05:13:12.015ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 1 delay = 35.439116597s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
1772026-02-14T05:13:12.140ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1782026-02-14T05:13:12.145ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
1792026-02-14T05:13:12.148ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1802026-02-14T05:13:12.715ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("054da191-a178-41f7-88a3-dc0bff867820.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("092896e9-df71-4acb-97cc-7af5dc187ed9.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("0cfdae07-f989-48d2-9467-216be9ce6ae4.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("0cfdae07-f989-48d2-9467-216be9ce6ae4.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 8281, tv_nsec: 517777091 } }) unit = producer-server
1812026-02-14T05:13:12.715ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::a]:12221 unit = producer-server
1822026-02-14T05:13:12.751ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
1832026-02-14T05:13:12.949ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1842026-02-14T05:13:12.953ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
1852026-02-14T05:13:12.957ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1862026-02-14T05:13:14.099ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1872026-02-14T05:13:14.104ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
1882026-02-14T05:13:14.107ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1892026-02-14T05:13:15.327ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1902026-02-14T05:13:15.331ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
1912026-02-14T05:13:15.334ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1922026-02-14T05:13:16.592ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5600952849460923443 n_samples = 6 unit = oximeter
1932026-02-14T05:13:16.637ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1942026-02-14T05:13:16.642ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
1952026-02-14T05:13:16.645ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1962026-02-14T05:13:17.627ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 16955136234713264223 n_samples = 6 unit = oximeter
1972026-02-14T05:13:17.757ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1982026-02-14T05:13:17.763ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
1992026-02-14T05:13:17.767ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2002026-02-14T05:13:19.220ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2012026-02-14T05:13:19.228ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
2022026-02-14T05:13:19.232ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2032026-02-14T05:13:19.942ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2042026-02-14T05:13:19.949ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
2052026-02-14T05:13:19.953ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2062026-02-14T05:13:21.196ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2072026-02-14T05:13:21.200ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
2082026-02-14T05:13:21.203ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2092026-02-14T05:13:22.466ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2102026-02-14T05:13:22.477ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
2112026-02-14T05:13:22.480ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2122026-02-14T05:13:23.633ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2132026-02-14T05:13:23.639ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
2142026-02-14T05:13:23.642ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2152026-02-14T05:13:24.503ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2162026-02-14T05:13:24.507ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
2172026-02-14T05:13:24.510ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2182026-02-14T05:13:25.469ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2192026-02-14T05:13:25.474ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
2202026-02-14T05:13:25.477ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2212026-02-14T05:13:26.180ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2222026-02-14T05:13:26.184ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
2232026-02-14T05:13:26.187ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2242026-02-14T05:13:26.593ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5600952849460923443 n_samples = 6 unit = oximeter
2252026-02-14T05:13:27.338ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2262026-02-14T05:13:27.343ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
2272026-02-14T05:13:27.346ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2282026-02-14T05:13:27.628ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 16955136234713264223 n_samples = 6 unit = oximeter
2292026-02-14T05:13:27.752ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", source: TimedOut }) unit = producer-server
2302026-02-14T05:13:27.753ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 2 delay = 51.177990855s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
2312026-02-14T05:13:28.297ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2322026-02-14T05:13:28.303ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
2332026-02-14T05:13:28.306ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2342026-02-14T05:13:29.098ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2352026-02-14T05:13:29.104ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
2362026-02-14T05:13:29.107ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2372026-02-14T05:13:29.172ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("054da191-a178-41f7-88a3-dc0bff867820.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("092896e9-df71-4acb-97cc-7af5dc187ed9.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("0cfdae07-f989-48d2-9467-216be9ce6ae4.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("0cfdae07-f989-48d2-9467-216be9ce6ae4.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 8297, tv_nsec: 977037506 } }) unit = producer-server
2382026-02-14T05:13:29.173ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::a]:12221 unit = producer-server
2392026-02-14T05:13:29.205ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
2402026-02-14T05:13:29.969ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2412026-02-14T05:13:29.975ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
2422026-02-14T05:13:29.979ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2432026-02-14T05:13:30.697ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2442026-02-14T05:13:30.702ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
2452026-02-14T05:13:30.705ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2462026-02-14T05:13:31.340ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2472026-02-14T05:13:31.345ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
2482026-02-14T05:13:31.348ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2492026-02-14T05:13:32.019ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2502026-02-14T05:13:32.025ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
2512026-02-14T05:13:32.028ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2522026-02-14T05:13:32.998ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2532026-02-14T05:13:33.003ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
2542026-02-14T05:13:33.006ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2552026-02-14T05:13:34.140ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2562026-02-14T05:13:34.146ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
2572026-02-14T05:13:34.149ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2582026-02-14T05:13:35.153ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2592026-02-14T05:13:35.158ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
2602026-02-14T05:13:35.161ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2612026-02-14T05:13:36.276ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2622026-02-14T05:13:36.282ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
2632026-02-14T05:13:36.286ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2642026-02-14T05:13:36.594ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5600952849460923443 n_samples = 6 unit = oximeter
2652026-02-14T05:13:36.846ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2662026-02-14T05:13:36.852ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
2672026-02-14T05:13:36.856ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2682026-02-14T05:13:37.629ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 16955136234713264223 n_samples = 6 unit = oximeter
2692026-02-14T05:13:37.707ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2702026-02-14T05:13:37.713ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
2712026-02-14T05:13:37.717ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2722026-02-14T05:13:39.150ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2732026-02-14T05:13:39.156ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
2742026-02-14T05:13:39.159ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2752026-02-14T05:13:40.187ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2762026-02-14T05:13:40.192ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
2772026-02-14T05:13:40.196ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2782026-02-14T05:13:41.271ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2792026-02-14T05:13:41.279ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
2802026-02-14T05:13:41.284ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2812026-02-14T05:13:42.652ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2822026-02-14T05:13:42.661ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
2832026-02-14T05:13:42.670ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2842026-02-14T05:13:43.481ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2852026-02-14T05:13:43.578ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
2862026-02-14T05:13:43.644ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2872026-02-14T05:13:44.232ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", source: TimedOut }) unit = producer-server
2882026-02-14T05:13:44.237ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 3 delay = 67.660875457s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
2892026-02-14T05:13:47.593ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("054da191-a178-41f7-88a3-dc0bff867820.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("092896e9-df71-4acb-97cc-7af5dc187ed9.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("0cfdae07-f989-48d2-9467-216be9ce6ae4.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("0cfdae07-f989-48d2-9467-216be9ce6ae4.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 8316, tv_nsec: 388759622 } }) unit = producer-server
2902026-02-14T05:13:47.668ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::a]:12221 unit = producer-server
2912026-02-14T05:13:47.670ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5600952849460923443 n_samples = 6 unit = oximeter
2922026-02-14T05:13:47.671ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 16955136234713264223 n_samples = 6 unit = oximeter
2932026-02-14T05:13:47.739ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2942026-02-14T05:13:48.787ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
2952026-02-14T05:13:48.797ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
2962026-02-14T05:13:48.823ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2972026-02-14T05:13:50.779ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2982026-02-14T05:13:50.789ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
2992026-02-14T05:13:50.794ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3002026-02-14T05:13:52.194ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3012026-02-14T05:13:52.241ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
3022026-02-14T05:13:52.407ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3032026-02-14T05:13:53.832ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3042026-02-14T05:13:53.839ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
3052026-02-14T05:13:53.846ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3062026-02-14T05:13:54.617ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3072026-02-14T05:13:54.624ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
3082026-02-14T05:13:54.629ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3092026-02-14T05:13:57.136ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3102026-02-14T05:13:57.167ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
3112026-02-14T05:13:57.771ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3122026-02-14T05:13:57.975ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5600952849460923443 n_samples = 6 unit = oximeter
3132026-02-14T05:13:57.978ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 16955136234713264223 n_samples = 6 unit = oximeter
3142026-02-14T05:13:58.937ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3152026-02-14T05:13:58.945ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
3162026-02-14T05:13:58.949ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3172026-02-14T05:14:00.008ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3182026-02-14T05:14:00.016ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
3192026-02-14T05:14:00.020ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3202026-02-14T05:14:00.964ZINFOtfportd: removed stale NDP entry :fe80::6013:5aff:fe23:a7e1->62:13:5a:23:a7:e1
3212026-02-14T05:14:01.209ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3222026-02-14T05:14:01.215ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
3232026-02-14T05:14:01.219ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3242026-02-14T05:14:01.889ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3252026-02-14T05:14:01.896ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
3262026-02-14T05:14:01.900ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3272026-02-14T05:14:02.551ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3282026-02-14T05:14:02.552ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::6013:5aff:fe23:a7e1->62:13:5a:23:a7:e1 interface = tfportrear0_0
3292026-02-14T05:14:02.575ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
3302026-02-14T05:14:02.589ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3312026-02-14T05:14:03.605ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3322026-02-14T05:14:03.612ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
3332026-02-14T05:14:03.617ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3342026-02-14T05:14:03.796ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", source: TimedOut }) unit = producer-server
3352026-02-14T05:14:03.801ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 4 delay = 87.228164801s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
3362026-02-14T05:14:04.953ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3372026-02-14T05:14:04.958ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
3382026-02-14T05:14:05.017ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3392026-02-14T05:14:06.040ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3402026-02-14T05:14:06.044ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
3412026-02-14T05:14:06.046ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3422026-02-14T05:14:06.950ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3432026-02-14T05:14:06.955ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
3442026-02-14T05:14:06.958ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3452026-02-14T05:14:07.979ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5600952849460923443 n_samples = 6 unit = oximeter
3462026-02-14T05:14:08.025ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 16955136234713264223 n_samples = 6 unit = oximeter
3472026-02-14T05:14:08.110ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3482026-02-14T05:14:08.116ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
3492026-02-14T05:14:08.120ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3502026-02-14T05:14:09.232ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("054da191-a178-41f7-88a3-dc0bff867820.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("092896e9-df71-4acb-97cc-7af5dc187ed9.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("0cfdae07-f989-48d2-9467-216be9ce6ae4.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("0cfdae07-f989-48d2-9467-216be9ce6ae4.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 8338, tv_nsec: 36757267 } }) unit = producer-server
3512026-02-14T05:14:09.279ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::a]:12221 unit = producer-server
3522026-02-14T05:14:09.786ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
3532026-02-14T05:14:09.795ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3542026-02-14T05:14:09.801ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
3552026-02-14T05:14:09.804ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3562026-02-14T05:14:10.698ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3572026-02-14T05:14:10.703ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
3582026-02-14T05:14:10.706ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3592026-02-14T05:14:11.733ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3602026-02-14T05:14:11.739ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
3612026-02-14T05:14:11.742ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3622026-02-14T05:14:12.720ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3632026-02-14T05:14:12.726ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
3642026-02-14T05:14:12.729ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3652026-02-14T05:14:13.690ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3662026-02-14T05:14:13.695ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
3672026-02-14T05:14:13.751ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3682026-02-14T05:14:14.500ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3692026-02-14T05:14:14.506ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
3702026-02-14T05:14:14.510ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3712026-02-14T05:14:15.158ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3722026-02-14T05:14:15.163ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
3732026-02-14T05:14:15.166ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3742026-02-14T05:14:16.433ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3752026-02-14T05:14:16.438ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
3762026-02-14T05:14:16.441ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3772026-02-14T05:14:17.389ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3782026-02-14T05:14:17.394ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
3792026-02-14T05:14:17.398ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3802026-02-14T05:14:18.028ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5600952849460923443 n_samples = 6 unit = oximeter
3812026-02-14T05:14:18.030ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 16955136234713264223 n_samples = 6 unit = oximeter
3822026-02-14T05:14:18.790ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3832026-02-14T05:14:18.796ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
3842026-02-14T05:14:18.800ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3852026-02-14T05:14:19.342ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3862026-02-14T05:14:19.348ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
3872026-02-14T05:14:19.351ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3882026-02-14T05:14:20.286ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3892026-02-14T05:14:20.294ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
3902026-02-14T05:14:20.298ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3912026-02-14T05:14:21.408ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3922026-02-14T05:14:21.415ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
3932026-02-14T05:14:21.439ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3942026-02-14T05:14:22.392ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3952026-02-14T05:14:22.399ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
3962026-02-14T05:14:22.403ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3972026-02-14T05:14:23.074ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3982026-02-14T05:14:23.079ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
3992026-02-14T05:14:23.082ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4002026-02-14T05:14:23.614ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4012026-02-14T05:14:23.623ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
4022026-02-14T05:14:23.627ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4032026-02-14T05:14:24.368ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4042026-02-14T05:14:24.377ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
4052026-02-14T05:14:24.383ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4062026-02-14T05:14:24.786ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", source: TimedOut }) unit = producer-server
4072026-02-14T05:14:24.787ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 5 delay = 108.214638777s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
4082026-02-14T05:14:25.793ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4092026-02-14T05:14:25.801ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
4102026-02-14T05:14:25.805ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4112026-02-14T05:14:27.316ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4122026-02-14T05:14:27.323ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
4132026-02-14T05:14:27.326ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4142026-02-14T05:14:28.030ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5600952849460923443 n_samples = 6 unit = oximeter
4152026-02-14T05:14:28.031ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 16955136234713264223 n_samples = 6 unit = oximeter
4162026-02-14T05:14:28.749ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4172026-02-14T05:14:28.755ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
4182026-02-14T05:14:28.758ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4192026-02-14T05:14:29.603ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4202026-02-14T05:14:29.610ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
4212026-02-14T05:14:29.610ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("054da191-a178-41f7-88a3-dc0bff867820.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("092896e9-df71-4acb-97cc-7af5dc187ed9.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("0cfdae07-f989-48d2-9467-216be9ce6ae4.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("0cfdae07-f989-48d2-9467-216be9ce6ae4.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 8358, tv_nsec: 416280479 } }) unit = producer-server
4222026-02-14T05:14:29.611ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::a]:12221 unit = producer-server
4232026-02-14T05:14:29.651ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
4242026-02-14T05:14:29.655ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4252026-02-14T05:14:31.010ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4262026-02-14T05:14:31.021ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
4272026-02-14T05:14:31.026ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4282026-02-14T05:14:32.005ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4292026-02-14T05:14:32.014ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
4302026-02-14T05:14:32.018ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4312026-02-14T05:14:32.983ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4322026-02-14T05:14:32.990ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
4332026-02-14T05:14:32.994ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4342026-02-14T05:14:33.206ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [fd00:1122:3344:101::a]:12221, Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) }) unit = producer-server
4352026-02-14T05:14:33.207ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 6 delay = 116.634193471s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
4362026-02-14T05:14:33.980ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4372026-02-14T05:14:33.986ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
4382026-02-14T05:14:34.008ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4392026-02-14T05:14:35.374ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4402026-02-14T05:14:35.380ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
4412026-02-14T05:14:35.383ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4422026-02-14T05:14:36.413ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4432026-02-14T05:14:36.419ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
4442026-02-14T05:14:36.422ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4452026-02-14T05:14:37.687ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4462026-02-14T05:14:37.693ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
4472026-02-14T05:14:37.696ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4482026-02-14T05:14:38.033ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5600952849460923443 n_samples = 6 unit = oximeter
4492026-02-14T05:14:38.034ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 16955136234713264223 n_samples = 6 unit = oximeter
4502026-02-14T05:14:39.038ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4512026-02-14T05:14:39.044ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
4522026-02-14T05:14:39.048ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4532026-02-14T05:14:40.155ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4542026-02-14T05:14:40.161ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
4552026-02-14T05:14:40.165ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4562026-02-14T05:14:41.280ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4572026-02-14T05:14:41.287ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
4582026-02-14T05:14:41.290ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4592026-02-14T05:14:42.404ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4602026-02-14T05:14:42.413ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
4612026-02-14T05:14:42.418ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4622026-02-14T05:14:43.091ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4632026-02-14T05:14:43.097ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
4642026-02-14T05:14:43.101ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4652026-02-14T05:14:44.610ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4662026-02-14T05:14:44.615ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
4672026-02-14T05:14:44.619ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4682026-02-14T05:14:45.405ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4692026-02-14T05:14:45.412ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
4702026-02-14T05:14:45.416ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4712026-02-14T05:14:46.272ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4722026-02-14T05:14:46.277ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
4732026-02-14T05:14:46.281ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4742026-02-14T05:14:47.720ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4752026-02-14T05:14:47.726ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
4762026-02-14T05:14:47.729ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4772026-02-14T05:14:48.036ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5600952849460923443 n_samples = 6 unit = oximeter
4782026-02-14T05:14:48.036ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 16955136234713264223 n_samples = 6 unit = oximeter
4792026-02-14T05:14:48.926ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4802026-02-14T05:14:48.932ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
4812026-02-14T05:14:48.936ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4822026-02-14T05:14:49.245ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("054da191-a178-41f7-88a3-dc0bff867820.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("092896e9-df71-4acb-97cc-7af5dc187ed9.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("0cfdae07-f989-48d2-9467-216be9ce6ae4.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("0cfdae07-f989-48d2-9467-216be9ce6ae4.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 8378, tv_nsec: 51421298 } }) unit = producer-server
4832026-02-14T05:14:49.246ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::a]:12221 unit = producer-server
4842026-02-14T05:14:49.278ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
4852026-02-14T05:14:49.339ZDEBGtfportd (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "ddc6a65e-bc5b-41cb-9bb2-72ea6fae9a93", "content-length": "41", "date": "Sat, 14 Feb 2026 05:14:49 GMT"} }) unit = producer-server
4862026-02-14T05:14:49.340ZDEBGtfportd (producer-registration-task): successfully registered with Nexus, pausing until time to renew lease lease_duration = 600s unit = producer-server wait_period = 150s
4872026-02-14T05:14:50.200ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4882026-02-14T05:14:50.205ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
4892026-02-14T05:14:50.208ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4902026-02-14T05:14:51.334ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4912026-02-14T05:14:51.340ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
4922026-02-14T05:14:51.343ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4932026-02-14T05:14:52.432ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4942026-02-14T05:14:52.438ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
4952026-02-14T05:14:52.441ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4962026-02-14T05:14:53.021ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4972026-02-14T05:14:53.028ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
4982026-02-14T05:14:53.032ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4992026-02-14T05:14:53.618ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5002026-02-14T05:14:53.624ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
5012026-02-14T05:14:53.627ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5022026-02-14T05:14:54.861ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5032026-02-14T05:14:54.867ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
5042026-02-14T05:14:54.870ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5052026-02-14T05:14:55.573ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5062026-02-14T05:14:55.689ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
5072026-02-14T05:14:55.693ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5082026-02-14T05:14:56.047ZINFOtfportd (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:1025 local_addr = [fd00:1122:3344:101::2]:39931 remote_addr = [fd00:1122:3344:101::d]:43802 unit = producer-server
5092026-02-14T05:14:56.063ZINFOtfportd (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 6815 local_addr = [fd00:1122:3344:101::2]:39931 method = GET remote_addr = [fd00:1122:3344:101::d]:43802 req_id = e80c0e8a-db50-4c8a-9964-ade96275989d response_code = 200 unit = producer-server uri = /c1098dc1-3a0a-4971-8f41-b05f905b852e
5102026-02-14T05:14:56.375ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5112026-02-14T05:14:56.380ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
5122026-02-14T05:14:56.383ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5132026-02-14T05:14:57.149ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5142026-02-14T05:14:57.156ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
5152026-02-14T05:14:57.159ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5162026-02-14T05:14:57.729ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5172026-02-14T05:14:57.735ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
5182026-02-14T05:14:57.739ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5192026-02-14T05:14:58.038ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5600952849460923443 n_samples = 6 unit = oximeter
5202026-02-14T05:14:58.038ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 16955136234713264223 n_samples = 6 unit = oximeter
5212026-02-14T05:14:58.575ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5222026-02-14T05:14:58.583ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
5232026-02-14T05:14:58.587ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5242026-02-14T05:14:59.938ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5252026-02-14T05:14:59.945ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]
5262026-02-14T05:14:59.948ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5272026-02-14T05:15:00.762ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5282026-02-14T05:15:00.771ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::989d:6ff:fe74:75d7]