Max level shown:
1 [ Sep 11 20:42:18 Enabled. ]
2 [ Sep 11 20:42:18 Rereading configuration. ]
3 [ Sep 11 20:42:19 Rereading configuration. ]
4 [ Sep 11 20:42:30 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dendrite/bin/tfportd --sync-only &"). ]
5 [ Sep 11 20:42:30 Method "start" exited with status 0. ]
6 No non-localhost IPv6 addresses found in SMF properties
72026-09-11T20:42:30.204ZINFOtfportd: connecting to dpd host = [::1] port = 12224
82026-09-11T20:42:30.206ZINFOtfportd: connected to dpd running softnpu-5cb3f22d
92026-09-11T20:42:30.207ZINFOtfportd: running in sync-only mode
102026-09-11T20:42:30.208ZINFOtfportd: no non-localhost IPv6 listen address available, waiting for SMF update unit = oximeter
112026-09-11T20:42:30.209ZINFOtfportd: refreshing SMF config prior to waiting on signals unit = signal_handler
12 No non-localhost IPv6 addresses found in SMF properties
132026-09-11T20:42:30.210ZINFOtfportd: refreshed config: Config { log_file: None, log_format: Json, listen_addresses: [ [::1]:12231, ], pkt_source: None, dpd_host: "[::1]", dpd_port: 12224, vlan_link: None, vlan_data: None, techport0_prefix: None, techport1_prefix: None, rack_id: Some( be29aa99-6c29-43cc-8104-8c266738c913, ), sled_id: Some( cd652ce1-03cf-4cbd-87d3-a25d456cd7b7, ), sled_model: Some( "i86pc", ), sled_revision: Some( 0, ), sled_serial: Some( "buskin", ), }
142026-09-11T20:42:30.210ZINFOtfportd: no non-localhost IPv6 listen address available, waiting for SMF update unit = oximeter
152026-09-11T20:42:30.214ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::485c:dbff:fe77:8501->4a:5c:db:77:85:01 interface = tfportrear0_0
162026-09-11T20:42:30.216ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
172026-09-11T20:42:30.222ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
182026-09-11T20:42:30.227ZWARNtfportd: tfportqsfp0_0 has no addrs
19 [ Sep 11 20:42:30 Rereading configuration. ]
20 [ Sep 11 20:42:30 Executing refresh method (:kill). ]
21 [ Sep 11 20:42:30 Stopping because all processes in service exited. ]
22 [ Sep 11 20:42:30 Executing stop method (:kill). ]
23 [ Sep 11 20:42:30 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dendrite/bin/tfportd --sync-only &"). ]
24 [ Sep 11 20:42:30 Method "start" exited with status 0. ]
252026-09-11T20:42:30.889ZINFOtfportd: connecting to dpd host = [::1] port = 12224
262026-09-11T20:42:30.890ZINFOtfportd: connected to dpd running softnpu-5cb3f22d
272026-09-11T20:42:30.890ZINFOtfportd: running in sync-only mode
282026-09-11T20:42:30.891ZINFOtfportd: found suitable IPv6 address for oximeter producer server address = fd00:1122:3344:101::2 unit = oximeter
292026-09-11T20:42:30.892ZINFOtfportd: refreshing SMF config prior to waiting on signals unit = signal_handler
302026-09-11T20:42:30.893ZDEBGtfportd: extracted oximeter configuration data config = OximeterConfig { listen_address: fd00:1122:3344:101::2, sled_identifiers: SledIdentifiers { rack_id: be29aa99-6c29-43cc-8104-8c266738c913, sled_id: cd652ce1-03cf-4cbd-87d3-a25d456cd7b7, model: "i86pc", revision: 0, serial: "buskin" }, switch_identifiers: SwitchIdentifiers { asic_backend: "softnpu", fab: None, fuse: Some(FuseData { chip_rev: ChipRevision { device_id: 272, rev: "B1", rev_num: 2 }, disabled: DisabledFeatures { bsync: false, mau: [0, 0, 0, 0], pgen: false, pipes: 0, ports: 0, resub: false, speeds: 0, tm_mem: 0 }, frequency: FrequencySettings { bps: 3, bps_ext: 0, cpu_speed_dis: 0, disabled: false, pcie_dis: 0, pps: 3, pps_ext: 0 }, manufacturing: ManufacturingData { core_repair: false, die_rotation: false, pmro_and_skew: 0, silent_spin: 0, soft_pipe_dis: 0, tile_repair: false, voltage_scaling: 0, wf_core_repair: false }, part: PartInfo { part_num: 4660, pkg_id: 1, version: 2 } }), lot: None, lotnum: None, model: "FAKE_SIM_SIDECAR", revision: 0, serial: "SimSidecar0", sidecar_id: a6063924-246e-468f-973e-036b6a70d4f9, slot: 0, wafer: None, wafer_loc: None } } unit = oximeter
312026-09-11T20:42:30.893ZDEBGtfportd: created producer ID producer_id = d54abf5c-4b88-49fe-91e9-2d104824ca5d unit = oximeter
322026-09-11T20:42:30.894ZINFOtfportd: refreshed config: Config { log_file: None, log_format: Json, listen_addresses: [ [fd00:1122:3344:101::2]:12231, [::1]:12231, ], pkt_source: None, dpd_host: "[::1]", dpd_port: 12224, vlan_link: None, vlan_data: None, techport0_prefix: None, techport1_prefix: None, rack_id: Some( be29aa99-6c29-43cc-8104-8c266738c913, ), sled_id: Some( cd652ce1-03cf-4cbd-87d3-a25d456cd7b7, ), sled_model: Some( "i86pc", ), sled_revision: Some( 0, ), sled_serial: Some( "buskin", ), }
332026-09-11T20:42:30.901ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
342026-09-11T20:42:30.902ZINFOtfportd: added new ARP entry entry = 10.151.1.174->46:e1:7b:c9:f5:1e interface = tfportqsfp0_0
352026-09-11T20:42:30.902ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::7097:ebff:fe99:c496->72:97:eb:99:c4:96 interface = tfportrear0_0
362026-09-11T20:42:30.903ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::485c:dbff:fe77:8501->4a:5c:db:77:85:01 interface = tfportrear0_0
372026-09-11T20:42:30.904ZDEBGtfportd: registered DTrace probes unit = producer-server
382026-09-11T20:42:30.906ZDEBGtfportd (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::2]:58425 method = GET path = /{producer_id} unit = producer-server versions = all
392026-09-11T20:42:30.906ZINFOtfportd (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:328 local_addr = [fd00:1122:3344:101::2]:58425 unit = producer-server
402026-09-11T20:42:30.906ZDEBGtfportd (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::2]:58425 unit = producer-server
412026-09-11T20:42:30.906ZDEBGtfportd: Requested any available port, Dropshot server has been bound to [fd00:1122:3344:101::2]:58425 unit = producer-server
422026-09-11T20:42:30.906ZDEBGtfportd: Nexus IP not provided, will use DNS to resolve it unit = producer-server
432026-09-11T20:42:30.906ZINFOtfportd (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/internal-dns/resolver/src/resolver.rs:144 unit = producer-server
442026-09-11T20:42:30.906ZDEBGtfportd: starting producer registration task unit = producer-server
452026-09-11T20:42:30.907ZINFOtfportd: starting oximeter metric producer server address = [fd00:1122:3344:101::2]:58425 file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:279 interval = 30s producer_id = d54abf5c-4b88-49fe-91e9-2d104824ca5d unit = producer-server
462026-09-11T20:42:30.907ZINFOtfportd: created oximeter producer server unit = oximeter
472026-09-11T20:42:30.907ZDEBGtfportd (producer-registration-task): registering as oximeter producer with Nexus registration_count = 0 unit = producer-server
482026-09-11T20:42:30.907ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
492026-09-11T20:42:30.908ZDEBGtfportd (kstat-sampler): adding new target unit = oximeter
502026-09-11T20:42:30.909ZDEBGtfportd (kstat-sampler-worker): storing new creation time for tracked target creation_time = 2026-09-11T20:42:13.968796842Z path = KstatPath { module: "link", instance: 0, name: "tfportrear0_0" } unit = oximeter
512026-09-11T20:42:30.909ZDEBGtfportd (kstat-sampler-worker): inserted empty per-target sample queue id = 14367695085951877536 unit = oximeter
522026-09-11T20:42:30.909ZDEBGtfportd: added new link to kstat sampler link_kind = switch-port-control link_name = tfportrear0_0 unit = metrics-task-tracker
532026-09-11T20:42:30.910ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
542026-09-11T20:42:30.911ZDEBGtfportd (kstat-sampler): adding new target unit = oximeter
552026-09-11T20:42:30.911ZDEBGtfportd (kstat-sampler-worker): storing new creation time for tracked target creation_time = 2026-09-11T20:42:13.968664111Z path = KstatPath { module: "link", instance: 0, name: "tfportqsfp0_0" } unit = oximeter
562026-09-11T20:42:30.911ZDEBGtfportd (kstat-sampler-worker): inserted empty per-target sample queue id = 12906838021695978941 unit = oximeter
572026-09-11T20:42:30.911ZDEBGtfportd: added new link to kstat sampler link_kind = switch-port-control link_name = tfportqsfp0_0 unit = metrics-task-tracker
582026-09-11T20:42:31.942ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
592026-09-11T20:42:31.948ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
602026-09-11T20:42:31.951ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
612026-09-11T20:42:32.887ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
622026-09-11T20:42:32.892ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
632026-09-11T20:42:32.895ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
642026-09-11T20:42:33.769ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
652026-09-11T20:42:33.773ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
662026-09-11T20:42:33.776ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
672026-09-11T20:42:35.103ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
682026-09-11T20:42:35.108ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
692026-09-11T20:42:35.111ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
702026-09-11T20:42:35.909ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("30209c5e-0a4c-4818-a8a9-c7f57e5ea54a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("54fb11d9-7239-4a41-bf43-e651461a47cf.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("84f56d11-d4fb-4df4-b0cb-eef2ddad9ab8.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("84f56d11-d4fb-4df4-b0cb-eef2ddad9ab8.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::c)) }], valid_until: Instant { tv_sec: 594, tv_nsec: 608838132 } }) unit = producer-server
712026-09-11T20:42:35.909ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
722026-09-11T20:42:35.927ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
732026-09-11T20:42:36.292ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
742026-09-11T20:42:36.298ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
752026-09-11T20:42:36.302ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
762026-09-11T20:42:37.680ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
772026-09-11T20:42:37.686ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
782026-09-11T20:42:37.689ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
792026-09-11T20:42:38.953ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
802026-09-11T20:42:38.958ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
812026-09-11T20:42:38.960ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
822026-09-11T20:42:40.299ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
832026-09-11T20:42:40.303ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
842026-09-11T20:42:40.306ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
852026-09-11T20:42:40.912ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 14367695085951877536 n_samples = 6 unit = oximeter
862026-09-11T20:42:40.912ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 12906838021695978941 n_samples = 6 unit = oximeter
872026-09-11T20:42:41.632ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
882026-09-11T20:42:41.637ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
892026-09-11T20:42:41.640ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
902026-09-11T20:42:42.617ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
912026-09-11T20:42:42.622ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
922026-09-11T20:42:42.625ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
932026-09-11T20:42:43.672ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
942026-09-11T20:42:43.676ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
952026-09-11T20:42:43.679ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
962026-09-11T20:42:44.788ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
972026-09-11T20:42:44.792ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
982026-09-11T20:42:44.796ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
992026-09-11T20:42:45.721ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1002026-09-11T20:42:45.725ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
1012026-09-11T20:42:45.729ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1022026-09-11T20:42:46.386ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1032026-09-11T20:42:46.391ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
1042026-09-11T20:42:46.395ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1052026-09-11T20:42:46.926ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1062026-09-11T20:42:46.932ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
1072026-09-11T20:42:46.935ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1082026-09-11T20:42:48.256ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1092026-09-11T20:42:48.262ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
1102026-09-11T20:42:48.265ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1112026-09-11T20:42:49.428ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1122026-09-11T20:42:49.433ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
1132026-09-11T20:42:49.436ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1142026-09-11T20:42:50.823ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1152026-09-11T20:42:50.829ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
1162026-09-11T20:42:50.832ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1172026-09-11T20:42:50.914ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 14367695085951877536 n_samples = 6 unit = oximeter
1182026-09-11T20:42:50.914ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 12906838021695978941 n_samples = 6 unit = oximeter
1192026-09-11T20:42:50.929ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
1202026-09-11T20:42:50.930ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 0 delay = 20.023445344s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
1212026-09-11T20:42:51.310ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("30209c5e-0a4c-4818-a8a9-c7f57e5ea54a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("54fb11d9-7239-4a41-bf43-e651461a47cf.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("84f56d11-d4fb-4df4-b0cb-eef2ddad9ab8.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("84f56d11-d4fb-4df4-b0cb-eef2ddad9ab8.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::c)) }], valid_until: Instant { tv_sec: 609, tv_nsec: 960384314 } }) unit = producer-server
1222026-09-11T20:42:51.311ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
1232026-09-11T20:42:51.317ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
1242026-09-11T20:42:52.013ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1252026-09-11T20:42:52.018ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
1262026-09-11T20:42:52.021ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1272026-09-11T20:42:52.672ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1282026-09-11T20:42:52.677ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
1292026-09-11T20:42:52.680ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1302026-09-11T20:42:53.608ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1312026-09-11T20:42:53.612ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
1322026-09-11T20:42:53.615ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1332026-09-11T20:42:54.755ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1342026-09-11T20:42:54.760ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
1352026-09-11T20:42:54.763ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1362026-09-11T20:42:55.846ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1372026-09-11T20:42:55.851ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
1382026-09-11T20:42:55.854ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1392026-09-11T20:42:56.798ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1402026-09-11T20:42:56.802ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
1412026-09-11T20:42:56.806ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1422026-09-11T20:42:57.626ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1432026-09-11T20:42:57.631ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
1442026-09-11T20:42:57.635ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1452026-09-11T20:42:58.345ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1462026-09-11T20:42:58.349ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
1472026-09-11T20:42:58.352ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1482026-09-11T20:42:59.286ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1492026-09-11T20:42:59.291ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
1502026-09-11T20:42:59.294ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1512026-09-11T20:43:00.605ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1522026-09-11T20:43:00.609ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
1532026-09-11T20:43:00.612ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1542026-09-11T20:43:00.870ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 14367695085951877536 n_samples = 6 unit = oximeter
1552026-09-11T20:43:00.870ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 12906838021695978941 n_samples = 6 unit = oximeter
1562026-09-11T20:43:01.989ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1572026-09-11T20:43:01.995ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
1582026-09-11T20:43:01.998ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1592026-09-11T20:43:02.680ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1602026-09-11T20:43:02.685ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
1612026-09-11T20:43:02.688ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1622026-09-11T20:43:04.006ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1632026-09-11T20:43:04.010ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
1642026-09-11T20:43:04.014ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1652026-09-11T20:43:04.732ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1662026-09-11T20:43:04.737ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
1672026-09-11T20:43:04.740ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1682026-09-11T20:43:06.168ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1692026-09-11T20:43:06.173ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
1702026-09-11T20:43:06.176ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1712026-09-11T20:43:06.238ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
1722026-09-11T20:43:06.239ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 1 delay = 35.363643573s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
1732026-09-11T20:43:06.763ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("30209c5e-0a4c-4818-a8a9-c7f57e5ea54a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("54fb11d9-7239-4a41-bf43-e651461a47cf.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("84f56d11-d4fb-4df4-b0cb-eef2ddad9ab8.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("84f56d11-d4fb-4df4-b0cb-eef2ddad9ab8.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::c)) }], valid_until: Instant { tv_sec: 625, tv_nsec: 493488023 } }) unit = producer-server
1742026-09-11T20:43:06.764ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
1752026-09-11T20:43:06.772ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
1762026-09-11T20:43:07.279ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1772026-09-11T20:43:07.284ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
1782026-09-11T20:43:07.287ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1792026-09-11T20:43:08.107ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1802026-09-11T20:43:08.111ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
1812026-09-11T20:43:08.114ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1822026-09-11T20:43:08.691ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1832026-09-11T20:43:08.695ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
1842026-09-11T20:43:08.698ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1852026-09-11T20:43:09.282ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1862026-09-11T20:43:09.286ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
1872026-09-11T20:43:09.289ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1882026-09-11T20:43:09.857ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1892026-09-11T20:43:09.862ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
1902026-09-11T20:43:09.865ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1912026-09-11T20:43:10.899ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 14367695085951877536 n_samples = 6 unit = oximeter
1922026-09-11T20:43:10.899ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 12906838021695978941 n_samples = 6 unit = oximeter
1932026-09-11T20:43:11.325ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1942026-09-11T20:43:11.330ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
1952026-09-11T20:43:11.333ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1962026-09-11T20:43:12.813ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1972026-09-11T20:43:12.817ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
1982026-09-11T20:43:12.821ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1992026-09-11T20:43:13.739ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2002026-09-11T20:43:13.744ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
2012026-09-11T20:43:13.747ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2022026-09-11T20:43:14.934ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2032026-09-11T20:43:14.938ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
2042026-09-11T20:43:14.941ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2052026-09-11T20:43:16.020ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2062026-09-11T20:43:16.025ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
2072026-09-11T20:43:16.029ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2082026-09-11T20:43:16.547ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2092026-09-11T20:43:16.553ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
2102026-09-11T20:43:16.557ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2112026-09-11T20:43:17.831ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2122026-09-11T20:43:17.835ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
2132026-09-11T20:43:17.838ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2142026-09-11T20:43:19.324ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2152026-09-11T20:43:19.329ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
2162026-09-11T20:43:19.333ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2172026-09-11T20:43:20.063ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2182026-09-11T20:43:20.069ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
2192026-09-11T20:43:20.072ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2202026-09-11T20:43:20.928ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 14367695085951877536 n_samples = 6 unit = oximeter
2212026-09-11T20:43:20.929ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 12906838021695978941 n_samples = 6 unit = oximeter
2222026-09-11T20:43:21.025ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2232026-09-11T20:43:21.031ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
2242026-09-11T20:43:21.034ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2252026-09-11T20:43:21.701ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2262026-09-11T20:43:21.706ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
2272026-09-11T20:43:21.714ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2282026-09-11T20:43:21.814ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
2292026-09-11T20:43:21.815ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 2 delay = 50.897443449s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
2302026-09-11T20:43:22.757ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("30209c5e-0a4c-4818-a8a9-c7f57e5ea54a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("54fb11d9-7239-4a41-bf43-e651461a47cf.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("84f56d11-d4fb-4df4-b0cb-eef2ddad9ab8.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("84f56d11-d4fb-4df4-b0cb-eef2ddad9ab8.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::c)) }], valid_until: Instant { tv_sec: 641, tv_nsec: 443758965 } }) unit = producer-server
2312026-09-11T20:43:22.758ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
2322026-09-11T20:43:22.766ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
2332026-09-11T20:43:22.959ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2342026-09-11T20:43:22.965ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
2352026-09-11T20:43:22.968ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2362026-09-11T20:43:24.205ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2372026-09-11T20:43:24.210ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
2382026-09-11T20:43:24.213ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2392026-09-11T20:43:25.325ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2402026-09-11T20:43:25.330ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
2412026-09-11T20:43:25.332ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2422026-09-11T20:43:26.562ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2432026-09-11T20:43:26.566ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
2442026-09-11T20:43:26.570ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2452026-09-11T20:43:27.192ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2462026-09-11T20:43:27.196ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
2472026-09-11T20:43:27.200ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2482026-09-11T20:43:27.719ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2492026-09-11T20:43:27.724ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
2502026-09-11T20:43:27.727ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2512026-09-11T20:43:29.111ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2522026-09-11T20:43:29.117ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
2532026-09-11T20:43:29.119ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2542026-09-11T20:43:30.486ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2552026-09-11T20:43:30.492ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
2562026-09-11T20:43:30.495ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2572026-09-11T20:43:30.958ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 14367695085951877536 n_samples = 6 unit = oximeter
2582026-09-11T20:43:30.958ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 12906838021695978941 n_samples = 6 unit = oximeter
2592026-09-11T20:43:31.050ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2602026-09-11T20:43:31.054ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
2612026-09-11T20:43:31.058ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2622026-09-11T20:43:32.380ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2632026-09-11T20:43:32.386ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
2642026-09-11T20:43:32.389ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2652026-09-11T20:43:33.755ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2662026-09-11T20:43:33.759ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
2672026-09-11T20:43:33.763ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2682026-09-11T20:43:34.365ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2692026-09-11T20:43:34.369ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
2702026-09-11T20:43:34.372ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2712026-09-11T20:43:35.833ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2722026-09-11T20:43:35.838ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
2732026-09-11T20:43:35.840ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2742026-09-11T20:43:36.931ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2752026-09-11T20:43:36.935ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
2762026-09-11T20:43:36.939ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2772026-09-11T20:43:37.808ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
2782026-09-11T20:43:37.809ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 3 delay = 66.847492679s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
2792026-09-11T20:43:38.182ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2802026-09-11T20:43:38.186ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
2812026-09-11T20:43:38.190ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2822026-09-11T20:43:39.027ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("30209c5e-0a4c-4818-a8a9-c7f57e5ea54a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("54fb11d9-7239-4a41-bf43-e651461a47cf.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("84f56d11-d4fb-4df4-b0cb-eef2ddad9ab8.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("84f56d11-d4fb-4df4-b0cb-eef2ddad9ab8.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::c)) }], valid_until: Instant { tv_sec: 657, tv_nsec: 669086990 } }) unit = producer-server
2832026-09-11T20:43:39.027ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
2842026-09-11T20:43:39.034ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
2852026-09-11T20:43:39.438ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2862026-09-11T20:43:39.442ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
2872026-09-11T20:43:39.446ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2882026-09-11T20:43:40.677ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2892026-09-11T20:43:40.685ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
2902026-09-11T20:43:40.688ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2912026-09-11T20:43:40.987ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 14367695085951877536 n_samples = 6 unit = oximeter
2922026-09-11T20:43:40.987ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 12906838021695978941 n_samples = 6 unit = oximeter
2932026-09-11T20:43:41.520ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2942026-09-11T20:43:41.526ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
2952026-09-11T20:43:41.529ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2962026-09-11T20:43:42.235ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2972026-09-11T20:43:42.241ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
2982026-09-11T20:43:42.244ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2992026-09-11T20:43:43.697ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3002026-09-11T20:43:43.701ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
3012026-09-11T20:43:43.704ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3022026-09-11T20:43:45.026ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3032026-09-11T20:43:45.030ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
3042026-09-11T20:43:45.033ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3052026-09-11T20:43:46.146ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3062026-09-11T20:43:46.151ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
3072026-09-11T20:43:46.155ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3082026-09-11T20:43:47.338ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3092026-09-11T20:43:47.344ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
3102026-09-11T20:43:47.347ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3112026-09-11T20:43:48.346ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3122026-09-11T20:43:48.351ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
3132026-09-11T20:43:48.354ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3142026-09-11T20:43:49.325ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3152026-09-11T20:43:49.330ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
3162026-09-11T20:43:49.333ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3172026-09-11T20:43:50.191ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3182026-09-11T20:43:50.196ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
3192026-09-11T20:43:50.199ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3202026-09-11T20:43:50.829ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3212026-09-11T20:43:50.832ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
3222026-09-11T20:43:50.835ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3232026-09-11T20:43:51.017ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 14367695085951877536 n_samples = 6 unit = oximeter
3242026-09-11T20:43:51.017ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 12906838021695978941 n_samples = 6 unit = oximeter
3252026-09-11T20:43:51.774ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3262026-09-11T20:43:51.778ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
3272026-09-11T20:43:51.781ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3282026-09-11T20:43:52.401ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3292026-09-11T20:43:52.406ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
3302026-09-11T20:43:52.408ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3312026-09-11T20:43:53.555ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3322026-09-11T20:43:53.562ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
3332026-09-11T20:43:53.565ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3342026-09-11T20:43:54.076ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
3352026-09-11T20:43:54.078ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 4 delay = 83.072390669s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
3362026-09-11T20:43:54.837ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3372026-09-11T20:43:54.842ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
3382026-09-11T20:43:54.845ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3392026-09-11T20:43:56.008ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3402026-09-11T20:43:56.014ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
3412026-09-11T20:43:56.016ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3422026-09-11T20:43:56.591ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("30209c5e-0a4c-4818-a8a9-c7f57e5ea54a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("54fb11d9-7239-4a41-bf43-e651461a47cf.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("84f56d11-d4fb-4df4-b0cb-eef2ddad9ab8.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("84f56d11-d4fb-4df4-b0cb-eef2ddad9ab8.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::c)) }], valid_until: Instant { tv_sec: 675, tv_nsec: 185657193 } }) unit = producer-server
3432026-09-11T20:43:56.592ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
3442026-09-11T20:43:56.599ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
3452026-09-11T20:43:57.216ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3462026-09-11T20:43:57.220ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
3472026-09-11T20:43:57.224ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3482026-09-11T20:43:57.844ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3492026-09-11T20:43:57.849ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
3502026-09-11T20:43:57.852ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3512026-09-11T20:43:59.166ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3522026-09-11T20:43:59.171ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
3532026-09-11T20:43:59.175ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3542026-09-11T20:43:59.821ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3552026-09-11T20:43:59.827ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
3562026-09-11T20:43:59.830ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3572026-09-11T20:44:01.046ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 14367695085951877536 n_samples = 6 unit = oximeter
3582026-09-11T20:44:01.046ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 12906838021695978941 n_samples = 6 unit = oximeter
3592026-09-11T20:44:01.165ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3602026-09-11T20:44:01.170ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
3612026-09-11T20:44:01.172ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3622026-09-11T20:44:01.812ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3632026-09-11T20:44:01.818ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
3642026-09-11T20:44:01.821ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3652026-09-11T20:44:02.407ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3662026-09-11T20:44:02.411ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
3672026-09-11T20:44:02.414ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3682026-09-11T20:44:03.858ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3692026-09-11T20:44:03.863ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
3702026-09-11T20:44:03.866ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3712026-09-11T20:44:04.873ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3722026-09-11T20:44:04.877ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
3732026-09-11T20:44:04.880ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3742026-09-11T20:44:05.886ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3752026-09-11T20:44:05.890ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
3762026-09-11T20:44:05.893ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3772026-09-11T20:44:06.458ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3782026-09-11T20:44:06.463ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
3792026-09-11T20:44:06.466ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3802026-09-11T20:44:07.442ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3812026-09-11T20:44:07.447ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
3822026-09-11T20:44:07.450ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3832026-09-11T20:44:08.029ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3842026-09-11T20:44:08.034ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
3852026-09-11T20:44:08.037ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3862026-09-11T20:44:09.354ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3872026-09-11T20:44:09.359ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
3882026-09-11T20:44:09.363ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3892026-09-11T20:44:10.505ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3902026-09-11T20:44:10.510ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
3912026-09-11T20:44:10.513ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3922026-09-11T20:44:11.075ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 14367695085951877536 n_samples = 6 unit = oximeter
3932026-09-11T20:44:11.075ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 12906838021695978941 n_samples = 6 unit = oximeter
3942026-09-11T20:44:11.641ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
3952026-09-11T20:44:11.643ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 5 delay = 100.589894171s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
3962026-09-11T20:44:11.687ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3972026-09-11T20:44:11.692ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
3982026-09-11T20:44:11.695ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3992026-09-11T20:44:12.677ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4002026-09-11T20:44:12.681ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
4012026-09-11T20:44:12.684ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4022026-09-11T20:44:13.439ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4032026-09-11T20:44:13.444ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
4042026-09-11T20:44:13.447ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4052026-09-11T20:44:14.644ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4062026-09-11T20:44:14.648ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
4072026-09-11T20:44:14.652ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4082026-09-11T20:44:16.068ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4092026-09-11T20:44:16.073ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
4102026-09-11T20:44:16.076ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4112026-09-11T20:44:16.728ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("30209c5e-0a4c-4818-a8a9-c7f57e5ea54a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("54fb11d9-7239-4a41-bf43-e651461a47cf.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("84f56d11-d4fb-4df4-b0cb-eef2ddad9ab8.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("84f56d11-d4fb-4df4-b0cb-eef2ddad9ab8.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::c)) }], valid_until: Instant { tv_sec: 695, tv_nsec: 267648673 } }) unit = producer-server
4122026-09-11T20:44:16.728ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
4132026-09-11T20:44:16.735ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
4142026-09-11T20:44:17.398ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4152026-09-11T20:44:17.402ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
4162026-09-11T20:44:17.406ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4172026-09-11T20:44:17.968ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4182026-09-11T20:44:17.972ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
4192026-09-11T20:44:17.975ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4202026-09-11T20:44:18.846ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4212026-09-11T20:44:18.851ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
4222026-09-11T20:44:18.854ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4232026-09-11T20:44:20.026ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4242026-09-11T20:44:20.031ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
4252026-09-11T20:44:20.034ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4262026-09-11T20:44:20.548ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4272026-09-11T20:44:20.552ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
4282026-09-11T20:44:20.555ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4292026-09-11T20:44:21.087ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4302026-09-11T20:44:21.091ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
4312026-09-11T20:44:21.095ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4322026-09-11T20:44:21.103ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 14367695085951877536 n_samples = 6 unit = oximeter
4332026-09-11T20:44:21.103ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 12906838021695978941 n_samples = 6 unit = oximeter
4342026-09-11T20:44:22.104ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4352026-09-11T20:44:22.108ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
4362026-09-11T20:44:22.111ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4372026-09-11T20:44:23.420ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4382026-09-11T20:44:23.425ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
4392026-09-11T20:44:23.428ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4402026-09-11T20:44:23.941ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4412026-09-11T20:44:23.946ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
4422026-09-11T20:44:23.949ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4432026-09-11T20:44:24.475ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4442026-09-11T20:44:24.479ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
4452026-09-11T20:44:24.482ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4462026-09-11T20:44:25.725ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4472026-09-11T20:44:25.729ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
4482026-09-11T20:44:25.732ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4492026-09-11T20:44:27.071ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4502026-09-11T20:44:27.075ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
4512026-09-11T20:44:27.078ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4522026-09-11T20:44:27.647ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4532026-09-11T20:44:27.652ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
4542026-09-11T20:44:27.655ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4552026-09-11T20:44:28.997ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4562026-09-11T20:44:29.001ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
4572026-09-11T20:44:29.004ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4582026-09-11T20:44:29.907ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4592026-09-11T20:44:29.911ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
4602026-09-11T20:44:29.915ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4612026-09-11T20:44:30.639ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4622026-09-11T20:44:30.644ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
4632026-09-11T20:44:30.646ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4642026-09-11T20:44:31.132ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 14367695085951877536 n_samples = 6 unit = oximeter
4652026-09-11T20:44:31.132ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 12906838021695978941 n_samples = 6 unit = oximeter
4662026-09-11T20:44:31.384ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4672026-09-11T20:44:31.389ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
4682026-09-11T20:44:31.392ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4692026-09-11T20:44:31.777ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
4702026-09-11T20:44:31.779ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 6 delay = 120.67071408s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
4712026-09-11T20:44:32.417ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4722026-09-11T20:44:32.422ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
4732026-09-11T20:44:32.425ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4742026-09-11T20:44:33.857ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4752026-09-11T20:44:33.862ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
4762026-09-11T20:44:33.865ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4772026-09-11T20:44:35.245ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4782026-09-11T20:44:35.249ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
4792026-09-11T20:44:35.253ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4802026-09-11T20:44:36.408ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4812026-09-11T20:44:36.413ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
4822026-09-11T20:44:36.415ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4832026-09-11T20:44:37.490ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4842026-09-11T20:44:37.494ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
4852026-09-11T20:44:37.497ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4862026-09-11T20:44:38.311ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4872026-09-11T20:44:38.316ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
4882026-09-11T20:44:38.319ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4892026-09-11T20:44:39.729ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4902026-09-11T20:44:39.734ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
4912026-09-11T20:44:39.737ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4922026-09-11T20:44:40.973ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4932026-09-11T20:44:40.978ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
4942026-09-11T20:44:40.982ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4952026-09-11T20:44:41.161ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 14367695085951877536 n_samples = 6 unit = oximeter
4962026-09-11T20:44:41.162ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 12906838021695978941 n_samples = 6 unit = oximeter
4972026-09-11T20:44:42.464ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4982026-09-11T20:44:42.470ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
4992026-09-11T20:44:42.473ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5002026-09-11T20:44:43.637ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5012026-09-11T20:44:43.641ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
5022026-09-11T20:44:43.644ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5032026-09-11T20:44:44.306ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5042026-09-11T20:44:44.310ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
5052026-09-11T20:44:44.314ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5062026-09-11T20:44:45.168ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5072026-09-11T20:44:45.173ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
5082026-09-11T20:44:45.176ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5092026-09-11T20:44:46.652ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5102026-09-11T20:44:46.655ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
5112026-09-11T20:44:46.658ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5122026-09-11T20:44:47.267ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("30209c5e-0a4c-4818-a8a9-c7f57e5ea54a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("54fb11d9-7239-4a41-bf43-e651461a47cf.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("84f56d11-d4fb-4df4-b0cb-eef2ddad9ab8.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("84f56d11-d4fb-4df4-b0cb-eef2ddad9ab8.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::c)) }], valid_until: Instant { tv_sec: 725, tv_nsec: 723879408 } }) unit = producer-server
5132026-09-11T20:44:47.268ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
5142026-09-11T20:44:47.275ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
5152026-09-11T20:44:47.469ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5162026-09-11T20:44:47.475ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
5172026-09-11T20:44:47.479ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5182026-09-11T20:44:48.337ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5192026-09-11T20:44:48.341ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
5202026-09-11T20:44:48.344ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5212026-09-11T20:44:48.941ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5222026-09-11T20:44:48.946ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
5232026-09-11T20:44:48.949ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5242026-09-11T20:44:50.069ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5252026-09-11T20:44:50.074ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
5262026-09-11T20:44:50.077ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5272026-09-11T20:44:51.117ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5282026-09-11T20:44:51.122ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
5292026-09-11T20:44:51.125ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5302026-09-11T20:44:51.190ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 14367695085951877536 n_samples = 6 unit = oximeter
5312026-09-11T20:44:51.191ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 12906838021695978941 n_samples = 6 unit = oximeter
5322026-09-11T20:44:52.464ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5332026-09-11T20:44:52.469ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
5342026-09-11T20:44:52.472ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5352026-09-11T20:44:53.360ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5362026-09-11T20:44:53.366ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
5372026-09-11T20:44:53.369ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5382026-09-11T20:44:54.781ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5392026-09-11T20:44:54.786ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
5402026-09-11T20:44:54.789ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5412026-09-11T20:44:56.294ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5422026-09-11T20:44:56.299ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
5432026-09-11T20:44:56.302ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5442026-09-11T20:44:56.935ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5452026-09-11T20:44:56.940ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
5462026-09-11T20:44:56.943ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5472026-09-11T20:44:57.864ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5482026-09-11T20:44:57.869ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
5492026-09-11T20:44:57.873ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5502026-09-11T20:44:59.263ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5512026-09-11T20:44:59.268ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
5522026-09-11T20:44:59.271ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5532026-09-11T20:44:59.868ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5542026-09-11T20:44:59.873ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
5552026-09-11T20:44:59.876ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5562026-09-11T20:45:00.865ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5572026-09-11T20:45:00.870ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::485c:dbff:fe77:8501]
5582026-09-11T20:45:00.873ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5592026-09-11T20:45:01.219ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 14367695085951877536 n_samples = 6 unit = oximeter
5602026-09-11T20:45:01.220ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 12906838021695978941 n_samples = 6 unit = oximeter