Max level shown:
1 [ Aug 19 01:27:14 Enabled. ]
2 [ Aug 19 01:27:14 Rereading configuration. ]
3 [ Aug 19 01:27:16 Rereading configuration. ]
4 [ Aug 19 01:27:27 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dendrite/bin/tfportd --sync-only &"). ]
5 [ Aug 19 01:27:27 Method "start" exited with status 0. ]
6 No non-localhost IPv6 addresses found in SMF properties
72026-08-19T01:27:27.150ZINFOtfportd: connecting to dpd host = [::1] port = 12224
82026-08-19T01:27:27.152ZINFOtfportd: connected to dpd running softnpu-5cb3f22d
92026-08-19T01:27:27.152ZINFOtfportd: running in sync-only mode
102026-08-19T01:27:27.152ZINFOtfportd: no non-localhost IPv6 listen address available, waiting for SMF update unit = oximeter
112026-08-19T01:27:27.155ZINFOtfportd: refreshing SMF config prior to waiting on signals unit = signal_handler
12 No non-localhost IPv6 addresses found in SMF properties
132026-08-19T01:27:27.156ZINFOtfportd: refreshed config: Config { log_file: None, log_format: Json, listen_addresses: [ [::1]:12231, ], pkt_source: None, dpd_host: "[::1]", dpd_port: 12224, vlan_link: None, vlan_data: None, techport0_prefix: None, techport1_prefix: None, rack_id: Some( b706a547-7588-4637-b96a-521c32237f14, ), sled_id: Some( 2aefd8f3-870b-40a5-97dc-fb0444f4130e, ), sled_model: Some( "i86pc", ), sled_revision: Some( 0, ), sled_serial: Some( "buskin", ), }
142026-08-19T01:27:27.156ZINFOtfportd: no non-localhost IPv6 listen address available, waiting for SMF update unit = oximeter
152026-08-19T01:27:27.161ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::f442:3bff:fe5f:dcbf->f6:42:3b:5f:dc:bf interface = tfportrear0_0
162026-08-19T01:27:27.164ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
172026-08-19T01:27:27.170ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
182026-08-19T01:27:27.176ZWARNtfportd: tfportqsfp0_0 has no addrs
19 [ Aug 19 01:27:27 Rereading configuration. ]
20 [ Aug 19 01:27:27 Executing refresh method (:kill). ]
21 [ Aug 19 01:27:27 Stopping because all processes in service exited. ]
22 [ Aug 19 01:27:27 Executing stop method (:kill). ]
23 [ Aug 19 01:27:27 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dendrite/bin/tfportd --sync-only &"). ]
24 [ Aug 19 01:27:27 Method "start" exited with status 0. ]
252026-08-19T01:27:27.919ZINFOtfportd: connecting to dpd host = [::1] port = 12224
262026-08-19T01:27:27.921ZINFOtfportd: connected to dpd running softnpu-5cb3f22d
272026-08-19T01:27:27.922ZINFOtfportd: running in sync-only mode
282026-08-19T01:27:27.922ZINFOtfportd: found suitable IPv6 address for oximeter producer server address = fd00:1122:3344:101::2 unit = oximeter
292026-08-19T01:27:27.924ZINFOtfportd: refreshing SMF config prior to waiting on signals unit = signal_handler
302026-08-19T01:27:27.924ZDEBGtfportd: extracted oximeter configuration data config = OximeterConfig { listen_address: fd00:1122:3344:101::2, sled_identifiers: SledIdentifiers { rack_id: b706a547-7588-4637-b96a-521c32237f14, sled_id: 2aefd8f3-870b-40a5-97dc-fb0444f4130e, model: "i86pc", revision: 0, serial: "buskin" }, switch_identifiers: SwitchIdentifiers { asic_backend: "softnpu", fab: None, fuse: Some(FuseData { chip_rev: ChipRevision { device_id: 272, rev: "B1", rev_num: 2 }, disabled: DisabledFeatures { bsync: false, mau: [0, 0, 0, 0], pgen: false, pipes: 0, ports: 0, resub: false, speeds: 0, tm_mem: 0 }, frequency: FrequencySettings { bps: 3, bps_ext: 0, cpu_speed_dis: 0, disabled: false, pcie_dis: 0, pps: 3, pps_ext: 0 }, manufacturing: ManufacturingData { core_repair: false, die_rotation: false, pmro_and_skew: 0, silent_spin: 0, soft_pipe_dis: 0, tile_repair: false, voltage_scaling: 0, wf_core_repair: false }, part: PartInfo { part_num: 4660, pkg_id: 1, version: 2 } }), lot: None, lotnum: None, model: "FAKE_SIM_SIDECAR", revision: 0, serial: "SimSidecar0", sidecar_id: 27ac2ecb-fba4-4872-a20d-777c57138927, slot: 0, wafer: None, wafer_loc: None } } unit = oximeter
312026-08-19T01:27:27.924ZDEBGtfportd: created producer ID producer_id = ba45537f-0927-4ee0-8cbb-de6421c4e53d unit = oximeter
322026-08-19T01:27:27.926ZINFOtfportd: refreshed config: Config { log_file: None, log_format: Json, listen_addresses: [ [fd00:1122:3344:101::2]:12231, [::1]:12231, ], pkt_source: None, dpd_host: "[::1]", dpd_port: 12224, vlan_link: None, vlan_data: None, techport0_prefix: None, techport1_prefix: None, rack_id: Some( b706a547-7588-4637-b96a-521c32237f14, ), sled_id: Some( 2aefd8f3-870b-40a5-97dc-fb0444f4130e, ), sled_model: Some( "i86pc", ), sled_revision: Some( 0, ), sled_serial: Some( "buskin", ), }
332026-08-19T01:27:27.942ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
342026-08-19T01:27:27.944ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::f442:3bff:fe5f:dcbf->f6:42:3b:5f:dc:bf interface = tfportrear0_0
352026-08-19T01:27:27.944ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::3cc1:b0ff:fe35:ffc9->3e:c1:b0:35:ff:c9 interface = tfportrear0_0
362026-08-19T01:27:27.946ZDEBGtfportd: registered DTrace probes unit = producer-server
372026-08-19T01:27:27.948ZDEBGtfportd (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::2]:57102 method = GET path = /{producer_id} unit = producer-server versions = all
382026-08-19T01:27:27.948ZINFOtfportd (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:328 local_addr = [fd00:1122:3344:101::2]:57102 unit = producer-server
392026-08-19T01:27:27.948ZDEBGtfportd (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::2]:57102 unit = producer-server
402026-08-19T01:27:27.948ZDEBGtfportd: Requested any available port, Dropshot server has been bound to [fd00:1122:3344:101::2]:57102 unit = producer-server
412026-08-19T01:27:27.948ZDEBGtfportd: Nexus IP not provided, will use DNS to resolve it unit = producer-server
422026-08-19T01:27:27.948ZINFOtfportd (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/internal-dns/resolver/src/resolver.rs:144 unit = producer-server
432026-08-19T01:27:27.948ZDEBGtfportd: starting producer registration task unit = producer-server
442026-08-19T01:27:27.948ZINFOtfportd: starting oximeter metric producer server address = [fd00:1122:3344:101::2]:57102 file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:279 interval = 30s producer_id = ba45537f-0927-4ee0-8cbb-de6421c4e53d unit = producer-server
452026-08-19T01:27:27.948ZINFOtfportd: created oximeter producer server unit = oximeter
462026-08-19T01:27:27.948ZDEBGtfportd (producer-registration-task): registering as oximeter producer with Nexus registration_count = 0 unit = producer-server
472026-08-19T01:27:27.949ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
482026-08-19T01:27:27.949ZDEBGtfportd (kstat-sampler): adding new target unit = oximeter
492026-08-19T01:27:27.951ZDEBGtfportd (kstat-sampler-worker): storing new creation time for tracked target creation_time = 2026-08-19T01:27:10.975675225Z path = KstatPath { module: "link", instance: 0, name: "tfportrear0_0" } unit = oximeter
502026-08-19T01:27:27.951ZDEBGtfportd (kstat-sampler-worker): inserted empty per-target sample queue id = 4139359394960884251 unit = oximeter
512026-08-19T01:27:27.951ZDEBGtfportd: added new link to kstat sampler link_kind = switch-port-control link_name = tfportrear0_0 unit = metrics-task-tracker
522026-08-19T01:27:27.952ZWARNtfportd: tfportqsfp0_0 has no addrs
532026-08-19T01:27:29.380ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
542026-08-19T01:27:29.384ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
552026-08-19T01:27:29.388ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
562026-08-19T01:27:29.388ZDEBGtfportd (kstat-sampler): adding new target unit = oximeter
572026-08-19T01:27:29.389ZDEBGtfportd (kstat-sampler-worker): storing new creation time for tracked target creation_time = 2026-08-19T01:27:10.975544912Z path = KstatPath { module: "link", instance: 0, name: "tfportqsfp0_0" } unit = oximeter
582026-08-19T01:27:29.389ZDEBGtfportd (kstat-sampler-worker): inserted empty per-target sample queue id = 13751880429528148393 unit = oximeter
592026-08-19T01:27:29.389ZDEBGtfportd: added new link to kstat sampler link_kind = switch-port-control link_name = tfportqsfp0_0 unit = metrics-task-tracker
602026-08-19T01:27:30.011ZINFOtfportd: added new ARP entry entry = 10.151.1.174->f6:fa:b2:06:24:de interface = tfportqsfp0_0
612026-08-19T01:27:30.311ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
622026-08-19T01:27:30.316ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
632026-08-19T01:27:30.320ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
642026-08-19T01:27:31.499ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
652026-08-19T01:27:31.505ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
662026-08-19T01:27:31.509ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
672026-08-19T01:27:32.433ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
682026-08-19T01:27:32.438ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
692026-08-19T01:27:32.441ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
702026-08-19T01:27:32.952ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("17ffdb4a-85b0-4b1d-acfc-47bb52614c41.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("c2e70d79-4814-495d-afef-c95218851a84.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("d02398e9-71d7-48ae-8de5-e781b0797ff1.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("d02398e9-71d7-48ae-8de5-e781b0797ff1.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 1609, tv_nsec: 251027808 } }) unit = producer-server
712026-08-19T01:27:32.953ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
722026-08-19T01:27:32.970ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
732026-08-19T01:27:33.759ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
742026-08-19T01:27:33.764ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
752026-08-19T01:27:33.767ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
762026-08-19T01:27:34.937ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
772026-08-19T01:27:34.942ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
782026-08-19T01:27:34.945ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
792026-08-19T01:27:35.989ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
802026-08-19T01:27:35.994ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
812026-08-19T01:27:35.997ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
822026-08-19T01:27:37.504ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
832026-08-19T01:27:37.509ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
842026-08-19T01:27:37.512ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
852026-08-19T01:27:37.955ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 4139359394960884251 n_samples = 6 unit = oximeter
862026-08-19T01:27:38.740ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
872026-08-19T01:27:38.744ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
882026-08-19T01:27:38.748ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
892026-08-19T01:27:39.393ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 13751880429528148393 n_samples = 6 unit = oximeter
902026-08-19T01:27:39.962ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
912026-08-19T01:27:39.967ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
922026-08-19T01:27:39.971ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
932026-08-19T01:27:40.723ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
942026-08-19T01:27:40.728ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
952026-08-19T01:27:40.731ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
962026-08-19T01:27:42.214ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
972026-08-19T01:27:42.219ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
982026-08-19T01:27:42.223ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
992026-08-19T01:27:43.247ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1002026-08-19T01:27:43.252ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
1012026-08-19T01:27:43.256ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1022026-08-19T01:27:44.935ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1032026-08-19T01:27:44.940ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
1042026-08-19T01:27:44.943ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1052026-08-19T01:27:46.427ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1062026-08-19T01:27:46.433ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
1072026-08-19T01:27:46.436ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1082026-08-19T01:27:47.066ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1092026-08-19T01:27:47.071ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
1102026-08-19T01:27:47.074ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1112026-08-19T01:27:47.812ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 4139359394960884251 n_samples = 6 unit = oximeter
1122026-08-19T01:27:47.826ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
1132026-08-19T01:27:47.828ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 0 delay = 20.023785907s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
1142026-08-19T01:27:48.181ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("17ffdb4a-85b0-4b1d-acfc-47bb52614c41.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("c2e70d79-4814-495d-afef-c95218851a84.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("d02398e9-71d7-48ae-8de5-e781b0797ff1.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("d02398e9-71d7-48ae-8de5-e781b0797ff1.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 1624, tv_nsec: 625617647 } }) unit = producer-server
1152026-08-19T01:27:48.181ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
1162026-08-19T01:27:48.188ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
1172026-08-19T01:27:48.202ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1182026-08-19T01:27:48.207ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
1192026-08-19T01:27:48.211ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1202026-08-19T01:27:49.118ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1212026-08-19T01:27:49.123ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
1222026-08-19T01:27:49.126ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1232026-08-19T01:27:49.247ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 13751880429528148393 n_samples = 6 unit = oximeter
1242026-08-19T01:27:49.798ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1252026-08-19T01:27:49.801ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
1262026-08-19T01:27:49.805ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1272026-08-19T01:27:50.650ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1282026-08-19T01:27:50.654ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
1292026-08-19T01:27:50.657ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1302026-08-19T01:27:51.605ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1312026-08-19T01:27:51.610ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
1322026-08-19T01:27:51.614ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1332026-08-19T01:27:52.245ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1342026-08-19T01:27:52.253ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
1352026-08-19T01:27:52.257ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1362026-08-19T01:27:52.884ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1372026-08-19T01:27:52.891ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
1382026-08-19T01:27:52.894ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1392026-08-19T01:27:53.830ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1402026-08-19T01:27:53.835ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
1412026-08-19T01:27:53.839ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1422026-08-19T01:27:54.956ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1432026-08-19T01:27:54.973ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
1442026-08-19T01:27:54.978ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1452026-08-19T01:27:56.355ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1462026-08-19T01:27:56.362ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
1472026-08-19T01:27:56.373ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1482026-08-19T01:27:57.332ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1492026-08-19T01:27:57.338ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
1502026-08-19T01:27:57.342ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1512026-08-19T01:27:57.805ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 4139359394960884251 n_samples = 6 unit = oximeter
1522026-08-19T01:27:58.180ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1532026-08-19T01:27:58.184ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
1542026-08-19T01:27:58.187ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1552026-08-19T01:27:58.948ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1562026-08-19T01:27:58.952ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
1572026-08-19T01:27:58.955ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1582026-08-19T01:27:59.243ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 13751880429528148393 n_samples = 6 unit = oximeter
1592026-08-19T01:27:59.881ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1602026-08-19T01:27:59.889ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
1612026-08-19T01:27:59.893ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1622026-08-19T01:28:01.045ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1632026-08-19T01:28:01.050ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
1642026-08-19T01:28:01.053ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1652026-08-19T01:28:01.902ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1662026-08-19T01:28:01.908ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
1672026-08-19T01:28:01.911ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1682026-08-19T01:28:02.865ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1692026-08-19T01:28:02.871ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
1702026-08-19T01:28:02.874ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1712026-08-19T01:28:03.177ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
1722026-08-19T01:28:03.178ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 1 delay = 35.386699969s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
1732026-08-19T01:28:03.449ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("17ffdb4a-85b0-4b1d-acfc-47bb52614c41.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("c2e70d79-4814-495d-afef-c95218851a84.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("d02398e9-71d7-48ae-8de5-e781b0797ff1.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("d02398e9-71d7-48ae-8de5-e781b0797ff1.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 1639, tv_nsec: 905543070 } }) unit = producer-server
1742026-08-19T01:28:03.449ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
1752026-08-19T01:28:03.458ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
1762026-08-19T01:28:04.230ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1772026-08-19T01:28:04.236ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
1782026-08-19T01:28:04.239ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1792026-08-19T01:28:05.563ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1802026-08-19T01:28:05.569ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
1812026-08-19T01:28:05.573ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1822026-08-19T01:28:06.769ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1832026-08-19T01:28:06.775ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
1842026-08-19T01:28:06.778ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1852026-08-19T01:28:07.428ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1862026-08-19T01:28:07.434ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
1872026-08-19T01:28:07.438ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1882026-08-19T01:28:07.807ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 4139359394960884251 n_samples = 6 unit = oximeter
1892026-08-19T01:28:08.668ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1902026-08-19T01:28:08.674ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
1912026-08-19T01:28:08.677ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1922026-08-19T01:28:09.244ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 13751880429528148393 n_samples = 6 unit = oximeter
1932026-08-19T01:28:09.268ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1942026-08-19T01:28:09.275ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
1952026-08-19T01:28:09.278ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1962026-08-19T01:28:10.327ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1972026-08-19T01:28:10.332ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
1982026-08-19T01:28:10.335ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1992026-08-19T01:28:11.607ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2002026-08-19T01:28:11.612ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
2012026-08-19T01:28:11.616ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2022026-08-19T01:28:12.738ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2032026-08-19T01:28:12.743ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
2042026-08-19T01:28:12.746ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2052026-08-19T01:28:13.717ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2062026-08-19T01:28:13.722ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
2072026-08-19T01:28:13.725ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2082026-08-19T01:28:14.898ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2092026-08-19T01:28:14.903ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
2102026-08-19T01:28:14.907ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2112026-08-19T01:28:15.882ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2122026-08-19T01:28:15.888ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
2132026-08-19T01:28:15.891ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2142026-08-19T01:28:17.161ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2152026-08-19T01:28:17.168ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
2162026-08-19T01:28:17.171ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2172026-08-19T01:28:17.809ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 4139359394960884251 n_samples = 6 unit = oximeter
2182026-08-19T01:28:18.460ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
2192026-08-19T01:28:18.460ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 2 delay = 50.668059037s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
2202026-08-19T01:28:18.496ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2212026-08-19T01:28:18.501ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
2222026-08-19T01:28:18.505ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2232026-08-19T01:28:23.082ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 13751880429528148393 n_samples = 6 unit = oximeter
2242026-08-19T01:28:23.093ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2252026-08-19T01:28:23.102ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
2262026-08-19T01:28:23.112ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2272026-08-19T01:28:24.097ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2282026-08-19T01:28:24.103ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
2292026-08-19T01:28:24.108ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2302026-08-19T01:28:24.559ZINFOtfportd: removed stale NDP entry :fe80::3cc1:b0ff:fe35:ffc9->3e:c1:b0:35:ff:c9
2312026-08-19T01:28:24.862ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2322026-08-19T01:28:24.874ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
2332026-08-19T01:28:24.878ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2342026-08-19T01:28:25.311ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::3cc1:b0ff:fe35:ffc9->3e:c1:b0:35:ff:c9 interface = tfportrear0_0
2352026-08-19T01:28:25.425ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("17ffdb4a-85b0-4b1d-acfc-47bb52614c41.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("c2e70d79-4814-495d-afef-c95218851a84.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("d02398e9-71d7-48ae-8de5-e781b0797ff1.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("d02398e9-71d7-48ae-8de5-e781b0797ff1.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 1661, tv_nsec: 878627333 } }) unit = producer-server
2362026-08-19T01:28:25.426ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
2372026-08-19T01:28:25.455ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
2382026-08-19T01:28:26.325ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2392026-08-19T01:28:26.334ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
2402026-08-19T01:28:26.338ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2412026-08-19T01:28:27.254ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2422026-08-19T01:28:27.258ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
2432026-08-19T01:28:27.261ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2442026-08-19T01:28:27.812ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 4139359394960884251 n_samples = 6 unit = oximeter
2452026-08-19T01:28:28.051ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2462026-08-19T01:28:28.055ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
2472026-08-19T01:28:28.058ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2482026-08-19T01:28:29.404ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2492026-08-19T01:28:29.409ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
2502026-08-19T01:28:29.412ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2512026-08-19T01:28:30.526ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2522026-08-19T01:28:30.533ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
2532026-08-19T01:28:30.536ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2542026-08-19T01:28:31.407ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2552026-08-19T01:28:31.414ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
2562026-08-19T01:28:31.417ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2572026-08-19T01:28:31.963ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2582026-08-19T01:28:31.971ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
2592026-08-19T01:28:31.976ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2602026-08-19T01:28:33.002ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2612026-08-19T01:28:33.007ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
2622026-08-19T01:28:33.009ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2632026-08-19T01:28:33.082ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 13751880429528148393 n_samples = 6 unit = oximeter
2642026-08-19T01:28:33.581ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2652026-08-19T01:28:33.585ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
2662026-08-19T01:28:33.588ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2672026-08-19T01:28:34.211ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2682026-08-19T01:28:34.216ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
2692026-08-19T01:28:34.218ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2702026-08-19T01:28:35.725ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2712026-08-19T01:28:35.729ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
2722026-08-19T01:28:35.733ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2732026-08-19T01:28:36.976ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2742026-08-19T01:28:36.981ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
2752026-08-19T01:28:36.984ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2762026-08-19T01:28:37.524ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2772026-08-19T01:28:37.530ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
2782026-08-19T01:28:37.533ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2792026-08-19T01:28:37.813ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 4139359394960884251 n_samples = 6 unit = oximeter
2802026-08-19T01:28:38.476ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2812026-08-19T01:28:38.481ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
2822026-08-19T01:28:38.484ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2832026-08-19T01:28:39.737ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2842026-08-19T01:28:39.741ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
2852026-08-19T01:28:39.744ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2862026-08-19T01:28:40.456ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
2872026-08-19T01:28:40.458ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 3 delay = 72.665128612s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
2882026-08-19T01:28:40.866ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2892026-08-19T01:28:40.872ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
2902026-08-19T01:28:40.875ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2912026-08-19T01:28:41.655ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("17ffdb4a-85b0-4b1d-acfc-47bb52614c41.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("c2e70d79-4814-495d-afef-c95218851a84.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("d02398e9-71d7-48ae-8de5-e781b0797ff1.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("d02398e9-71d7-48ae-8de5-e781b0797ff1.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 1678, tv_nsec: 110210255 } }) unit = producer-server
2922026-08-19T01:28:41.656ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
2932026-08-19T01:28:41.663ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
2942026-08-19T01:28:42.246ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2952026-08-19T01:28:42.251ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
2962026-08-19T01:28:42.254ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2972026-08-19T01:28:43.082ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2982026-08-19T01:28:43.084ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 13751880429528148393 n_samples = 6 unit = oximeter
2992026-08-19T01:28:43.087ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
3002026-08-19T01:28:43.090ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3012026-08-19T01:28:44.092ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3022026-08-19T01:28:44.097ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
3032026-08-19T01:28:44.100ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3042026-08-19T01:28:45.035ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3052026-08-19T01:28:45.040ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
3062026-08-19T01:28:45.043ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3072026-08-19T01:28:46.377ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3082026-08-19T01:28:46.383ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
3092026-08-19T01:28:46.385ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3102026-08-19T01:28:47.268ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3112026-08-19T01:28:47.274ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
3122026-08-19T01:28:47.277ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3132026-08-19T01:28:47.815ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 4139359394960884251 n_samples = 6 unit = oximeter
3142026-08-19T01:28:48.246ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3152026-08-19T01:28:48.252ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
3162026-08-19T01:28:48.255ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3172026-08-19T01:28:49.366ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3182026-08-19T01:28:49.377ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
3192026-08-19T01:28:49.380ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3202026-08-19T01:28:50.193ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3212026-08-19T01:28:50.198ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
3222026-08-19T01:28:50.201ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3232026-08-19T01:28:51.268ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3242026-08-19T01:28:51.274ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
3252026-08-19T01:28:51.278ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3262026-08-19T01:28:52.479ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3272026-08-19T01:28:52.485ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
3282026-08-19T01:28:52.489ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3292026-08-19T01:28:53.071ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3302026-08-19T01:28:53.076ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
3312026-08-19T01:28:53.080ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3322026-08-19T01:28:53.086ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 13751880429528148393 n_samples = 6 unit = oximeter
3332026-08-19T01:28:53.949ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3342026-08-19T01:28:53.956ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
3352026-08-19T01:28:53.960ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3362026-08-19T01:28:54.927ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3372026-08-19T01:28:54.936ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
3382026-08-19T01:28:54.941ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3392026-08-19T01:28:56.241ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3402026-08-19T01:28:56.249ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
3412026-08-19T01:28:56.253ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3422026-08-19T01:28:56.669ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
3432026-08-19T01:28:56.674ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 4 delay = 88.881679653s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
3442026-08-19T01:28:57.564ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3452026-08-19T01:28:57.572ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
3462026-08-19T01:28:57.576ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3472026-08-19T01:28:57.819ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 4139359394960884251 n_samples = 6 unit = oximeter
3482026-08-19T01:28:58.506ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3492026-08-19T01:28:58.515ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
3502026-08-19T01:28:58.520ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3512026-08-19T01:28:58.929ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("17ffdb4a-85b0-4b1d-acfc-47bb52614c41.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("c2e70d79-4814-495d-afef-c95218851a84.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("d02398e9-71d7-48ae-8de5-e781b0797ff1.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("d02398e9-71d7-48ae-8de5-e781b0797ff1.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 1695, tv_nsec: 383640985 } }) unit = producer-server
3522026-08-19T01:28:58.930ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
3532026-08-19T01:28:58.978ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
3542026-08-19T01:28:59.733ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3552026-08-19T01:28:59.747ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
3562026-08-19T01:28:59.808ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3572026-08-19T01:29:00.806ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3582026-08-19T01:29:00.814ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
3592026-08-19T01:29:00.819ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3602026-08-19T01:29:01.668ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3612026-08-19T01:29:01.679ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
3622026-08-19T01:29:01.685ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3632026-08-19T01:29:02.878ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3642026-08-19T01:29:02.886ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
3652026-08-19T01:29:02.890ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3662026-08-19T01:29:03.091ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 13751880429528148393 n_samples = 6 unit = oximeter
3672026-08-19T01:29:04.098ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3682026-08-19T01:29:04.105ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
3692026-08-19T01:29:04.117ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3702026-08-19T01:29:04.687ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3712026-08-19T01:29:04.694ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
3722026-08-19T01:29:04.698ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3732026-08-19T01:29:05.972ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3742026-08-19T01:29:05.980ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
3752026-08-19T01:29:05.985ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3762026-08-19T01:29:07.402ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3772026-08-19T01:29:07.407ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
3782026-08-19T01:29:07.410ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3792026-08-19T01:29:07.822ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 4139359394960884251 n_samples = 6 unit = oximeter
3802026-08-19T01:29:08.526ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3812026-08-19T01:29:08.531ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
3822026-08-19T01:29:08.534ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3832026-08-19T01:29:09.426ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3842026-08-19T01:29:09.433ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
3852026-08-19T01:29:09.438ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3862026-08-19T01:29:09.995ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3872026-08-19T01:29:10.000ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
3882026-08-19T01:29:10.004ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3892026-08-19T01:29:10.611ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3902026-08-19T01:29:10.616ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
3912026-08-19T01:29:10.620ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3922026-08-19T01:29:11.230ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3932026-08-19T01:29:11.236ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
3942026-08-19T01:29:11.239ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3952026-08-19T01:29:11.897ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3962026-08-19T01:29:11.903ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
3972026-08-19T01:29:11.906ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3982026-08-19T01:29:12.846ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3992026-08-19T01:29:12.852ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
4002026-08-19T01:29:12.856ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4012026-08-19T01:29:13.094ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 13751880429528148393 n_samples = 6 unit = oximeter
4022026-08-19T01:29:13.509ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4032026-08-19T01:29:13.514ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
4042026-08-19T01:29:13.517ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4052026-08-19T01:29:13.977ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
4062026-08-19T01:29:13.979ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 5 delay = 106.186276183s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
4072026-08-19T01:29:14.713ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4082026-08-19T01:29:14.719ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
4092026-08-19T01:29:14.731ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4102026-08-19T01:29:15.491ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4112026-08-19T01:29:15.497ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
4122026-08-19T01:29:15.502ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4132026-08-19T01:29:16.047ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4142026-08-19T01:29:16.054ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
4152026-08-19T01:29:16.057ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4162026-08-19T01:29:17.374ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4172026-08-19T01:29:17.381ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
4182026-08-19T01:29:17.385ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4192026-08-19T01:29:17.826ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 4139359394960884251 n_samples = 6 unit = oximeter
4202026-08-19T01:29:17.999ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4212026-08-19T01:29:18.006ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
4222026-08-19T01:29:18.011ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4232026-08-19T01:29:18.799ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4242026-08-19T01:29:18.806ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
4252026-08-19T01:29:18.810ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4262026-08-19T01:29:19.790ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4272026-08-19T01:29:19.798ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
4282026-08-19T01:29:19.802ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4292026-08-19T01:29:20.902ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4302026-08-19T01:29:20.911ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
4312026-08-19T01:29:20.916ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4322026-08-19T01:29:21.024ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("17ffdb4a-85b0-4b1d-acfc-47bb52614c41.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("c2e70d79-4814-495d-afef-c95218851a84.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("d02398e9-71d7-48ae-8de5-e781b0797ff1.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("d02398e9-71d7-48ae-8de5-e781b0797ff1.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 1717, tv_nsec: 478986377 } }) unit = producer-server
4332026-08-19T01:29:21.025ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
4342026-08-19T01:29:21.072ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
4352026-08-19T01:29:21.883ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4362026-08-19T01:29:21.888ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
4372026-08-19T01:29:21.892ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4382026-08-19T01:29:23.096ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 13751880429528148393 n_samples = 6 unit = oximeter
4392026-08-19T01:29:23.125ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4402026-08-19T01:29:23.132ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
4412026-08-19T01:29:23.135ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4422026-08-19T01:29:24.441ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4432026-08-19T01:29:24.446ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
4442026-08-19T01:29:24.450ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4452026-08-19T01:29:25.398ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4462026-08-19T01:29:25.404ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
4472026-08-19T01:29:25.407ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4482026-08-19T01:29:26.640ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4492026-08-19T01:29:26.646ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
4502026-08-19T01:29:26.650ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4512026-08-19T01:29:27.829ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 4139359394960884251 n_samples = 6 unit = oximeter
4522026-08-19T01:29:28.010ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4532026-08-19T01:29:28.015ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
4542026-08-19T01:29:28.019ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4552026-08-19T01:29:29.359ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4562026-08-19T01:29:29.367ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
4572026-08-19T01:29:29.370ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4582026-08-19T01:29:30.566ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4592026-08-19T01:29:30.572ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
4602026-08-19T01:29:30.575ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4612026-08-19T01:29:31.781ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4622026-08-19T01:29:31.787ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
4632026-08-19T01:29:31.790ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4642026-08-19T01:29:33.100ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 13751880429528148393 n_samples = 6 unit = oximeter
4652026-08-19T01:29:33.166ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4662026-08-19T01:29:33.172ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
4672026-08-19T01:29:33.176ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4682026-08-19T01:29:34.085ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4692026-08-19T01:29:34.091ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
4702026-08-19T01:29:34.095ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4712026-08-19T01:29:35.168ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4722026-08-19T01:29:35.174ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
4732026-08-19T01:29:35.178ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4742026-08-19T01:29:36.073ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
4752026-08-19T01:29:36.074ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 6 delay = 128.280866217s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
4762026-08-19T01:29:36.491ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4772026-08-19T01:29:36.497ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
4782026-08-19T01:29:36.499ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4792026-08-19T01:29:37.832ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 4139359394960884251 n_samples = 6 unit = oximeter
4802026-08-19T01:29:37.979ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4812026-08-19T01:29:37.984ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
4822026-08-19T01:29:37.987ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4832026-08-19T01:29:39.107ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4842026-08-19T01:29:39.113ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
4852026-08-19T01:29:39.117ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4862026-08-19T01:29:40.008ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4872026-08-19T01:29:40.015ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
4882026-08-19T01:29:40.019ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4892026-08-19T01:29:41.243ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4902026-08-19T01:29:41.248ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
4912026-08-19T01:29:41.252ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4922026-08-19T01:29:42.111ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4932026-08-19T01:29:42.117ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
4942026-08-19T01:29:42.121ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4952026-08-19T01:29:42.914ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4962026-08-19T01:29:42.919ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
4972026-08-19T01:29:42.922ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4982026-08-19T01:29:43.103ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 13751880429528148393 n_samples = 6 unit = oximeter
4992026-08-19T01:29:44.342ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5002026-08-19T01:29:44.348ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
5012026-08-19T01:29:44.352ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5022026-08-19T01:29:44.621ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("17ffdb4a-85b0-4b1d-acfc-47bb52614c41.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("c2e70d79-4814-495d-afef-c95218851a84.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("d02398e9-71d7-48ae-8de5-e781b0797ff1.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("d02398e9-71d7-48ae-8de5-e781b0797ff1.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 1741, tv_nsec: 76410772 } }) unit = producer-server
5032026-08-19T01:29:44.622ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
5042026-08-19T01:29:44.651ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
5052026-08-19T01:29:45.071ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5062026-08-19T01:29:45.080ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
5072026-08-19T01:29:45.085ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5082026-08-19T01:29:45.105ZDEBGtfportd (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "cd93417c-c660-477e-9519-5804af42c296", "content-length": "41", "date": "Wed, 19 Aug 2026 01:29:45 GMT"} }) unit = producer-server
5092026-08-19T01:29:45.110ZDEBGtfportd (producer-registration-task): successfully registered with Nexus, pausing until time to renew lease lease_duration = 600s unit = producer-server wait_period = 150s
5102026-08-19T01:29:46.469ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5112026-08-19T01:29:46.476ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
5122026-08-19T01:29:46.480ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5132026-08-19T01:29:47.418ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5142026-08-19T01:29:47.424ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
5152026-08-19T01:29:47.428ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5162026-08-19T01:29:47.834ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 4139359394960884251 n_samples = 6 unit = oximeter
5172026-08-19T01:29:48.497ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5182026-08-19T01:29:48.503ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
5192026-08-19T01:29:48.507ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5202026-08-19T01:29:49.517ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5212026-08-19T01:29:49.523ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
5222026-08-19T01:29:49.527ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5232026-08-19T01:29:50.813ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5242026-08-19T01:29:50.819ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
5252026-08-19T01:29:50.824ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5262026-08-19T01:29:52.205ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5272026-08-19T01:29:52.211ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
5282026-08-19T01:29:52.214ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5292026-08-19T01:29:52.845ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5302026-08-19T01:29:52.850ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
5312026-08-19T01:29:52.854ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5322026-08-19T01:29:53.106ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 13751880429528148393 n_samples = 6 unit = oximeter
5332026-08-19T01:29:53.584ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5342026-08-19T01:29:53.590ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
5352026-08-19T01:29:53.594ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5362026-08-19T01:29:54.214ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5372026-08-19T01:29:54.219ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
5382026-08-19T01:29:54.223ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5392026-08-19T01:29:55.383ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5402026-08-19T01:29:55.389ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
5412026-08-19T01:29:55.393ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5422026-08-19T01:29:56.671ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5432026-08-19T01:29:56.679ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
5442026-08-19T01:29:56.682ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5452026-08-19T01:29:57.307ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5462026-08-19T01:29:57.313ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
5472026-08-19T01:29:57.317ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5482026-08-19T01:29:57.836ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 4139359394960884251 n_samples = 6 unit = oximeter
5492026-08-19T01:29:57.981ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5502026-08-19T01:29:57.987ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
5512026-08-19T01:29:57.990ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5522026-08-19T01:29:58.616ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5532026-08-19T01:29:58.622ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
5542026-08-19T01:29:58.625ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5552026-08-19T01:29:59.922ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5562026-08-19T01:29:59.927ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
5572026-08-19T01:29:59.930ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5582026-08-19T01:30:01.351ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5592026-08-19T01:30:01.359ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f442:3bff:fe5f:dcbf]
5602026-08-19T01:30:01.365ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]