Max level shown:
1 [ Oct 22 19:56:36 Enabled. ]
2 [ Oct 22 19:56:36 Rereading configuration. ]
3 [ Oct 22 19:56:37 Rereading configuration. ]
4 [ Oct 22 19:56:58 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dendrite/bin/tfportd --sync-only &"). ]
5 [ Oct 22 19:56:58 Method "start" exited with status 0. ]
6 No non-localhost IPv6 addresses found in SMF properties
72026-10-22T19:56:58.727ZINFOtfportd: connecting to dpd host = [::1] port = 12224
82026-10-22T19:56:58.729ZINFOtfportd: connected to dpd running softnpu-a133c73e
92026-10-22T19:56:58.730ZINFOtfportd: running in sync-only mode
102026-10-22T19:56:58.730ZINFOtfportd: no non-localhost IPv6 listen address available, waiting for SMF update unit = oximeter
112026-10-22T19:56:58.730ZINFOtfportd: refreshing SMF config prior to waiting on signals unit = signal_handler
12 No non-localhost IPv6 addresses found in SMF properties
132026-10-22T19:56:58.732ZINFOtfportd: refreshed config: Config { log_file: None, log_format: Json, listen_addresses: [ [::1]:12231, ], pkt_source: None, dpd_host: "[::1]", dpd_port: 12224, vlan_link: None, vlan_data: None, techport0_prefix: None, techport1_prefix: None, rack_id: Some( 2c1b7751-7f4c-4f60-8ac9-da52e58a4e51, ), sled_id: Some( 1ebaef66-d398-4d3f-a206-a878c8eac3e7, ), sled_model: Some( "i86pc", ), sled_revision: Some( 0, ), sled_serial: Some( "buskin", ), }
142026-10-22T19:56:58.732ZINFOtfportd: no non-localhost IPv6 listen address available, waiting for SMF update unit = oximeter
152026-10-22T19:56:58.738ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::3003:f2ff:fec6:512a->32:03:f2:c6:51:2a interface = tfportrear0_0
162026-10-22T19:56:58.738ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
172026-10-22T19:56:58.742ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
182026-10-22T19:56:58.747ZWARNtfportd: tfportqsfp0_0 has no addrs
192026-10-22T19:57:00.000ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::fc30:daff:fefd:ae43->fe:30:da:fd:ae:43 interface = tfportrear0_0
20 [ Oct 22 19:57:00 Rereading configuration. ]
21 [ Oct 22 19:57:00 Executing refresh method (:kill). ]
22 [ Oct 22 19:57:00 Stopping because all processes in service exited. ]
23 [ Oct 22 19:57:00 Executing stop method (:kill). ]
24 [ Oct 22 19:57:00 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dendrite/bin/tfportd --sync-only &"). ]
25 [ Oct 22 19:57:00 Method "start" exited with status 0. ]
262026-10-22T19:57:00.259ZINFOtfportd: connecting to dpd host = [::1] port = 12224
272026-10-22T19:57:00.260ZINFOtfportd: connected to dpd running softnpu-a133c73e
282026-10-22T19:57:00.260ZINFOtfportd: running in sync-only mode
292026-10-22T19:57:00.260ZINFOtfportd: found suitable IPv6 address for oximeter producer server address = fd00:1122:3344:101::2 unit = oximeter
302026-10-22T19:57:00.261ZINFOtfportd: refreshing SMF config prior to waiting on signals unit = signal_handler
312026-10-22T19:57:00.261ZDEBGtfportd: extracted oximeter configuration data config = OximeterConfig { listen_address: fd00:1122:3344:101::2, sled_identifiers: SledIdentifiers { rack_id: 2c1b7751-7f4c-4f60-8ac9-da52e58a4e51, sled_id: 1ebaef66-d398-4d3f-a206-a878c8eac3e7, model: "i86pc", revision: 0, serial: "buskin" }, switch_identifiers: SwitchIdentifiers { asic_backend: "softnpu", fab: None, fuse: Some(FuseData { chip_rev: ChipRevision { device_id: 272, rev: "B1", rev_num: 2 }, disabled: DisabledFeatures { bsync: false, mau: [0, 0, 0, 0], pgen: false, pipes: 0, ports: 0, resub: false, speeds: 0, tm_mem: 0 }, frequency: FrequencySettings { bps: 3, bps_ext: 0, cpu_speed_dis: 0, disabled: false, pcie_dis: 0, pps: 3, pps_ext: 0 }, manufacturing: ManufacturingData { core_repair: false, die_rotation: false, pmro_and_skew: 0, silent_spin: 0, soft_pipe_dis: 0, tile_repair: false, voltage_scaling: 0, wf_core_repair: false }, part: PartInfo { part_num: 4660, pkg_id: 1, version: 2 } }), lot: None, lotnum: None, model: "FAKE_SIM_SIDECAR", revision: 0, serial: "SimSidecar0", sidecar_id: 0b6ec17e-0234-437c-8a0e-c73dcd5bb6b8, slot: 0, wafer: None, wafer_loc: None } } unit = oximeter
322026-10-22T19:57:00.261ZDEBGtfportd: created producer ID producer_id = 39cf5949-aee0-4123-a2c1-b517e03b3b0f unit = oximeter
332026-10-22T19:57:00.262ZINFOtfportd: refreshed config: Config { log_file: None, log_format: Json, listen_addresses: [ [fd00:1122:3344:101::2]:12231, [::1]:12231, ], pkt_source: None, dpd_host: "[::1]", dpd_port: 12224, vlan_link: None, vlan_data: None, techport0_prefix: None, techport1_prefix: None, rack_id: Some( 2c1b7751-7f4c-4f60-8ac9-da52e58a4e51, ), sled_id: Some( 1ebaef66-d398-4d3f-a206-a878c8eac3e7, ), sled_model: Some( "i86pc", ), sled_revision: Some( 0, ), sled_serial: Some( "buskin", ), }
342026-10-22T19:57:00.270ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
352026-10-22T19:57:00.271ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::3003:f2ff:fec6:512a->32:03:f2:c6:51:2a interface = tfportrear0_0
362026-10-22T19:57:00.272ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::fc30:daff:fefd:ae43->fe:30:da:fd:ae:43 interface = tfportrear0_0
372026-10-22T19:57:00.274ZDEBGtfportd: registered DTrace probes unit = producer-server
382026-10-22T19:57:00.274ZDEBGtfportd (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::2]:48377 method = GET path = /{producer_id} unit = producer-server versions = all
392026-10-22T19:57:00.274ZINFOtfportd (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:328 local_addr = [fd00:1122:3344:101::2]:48377 unit = producer-server
402026-10-22T19:57:00.274ZDEBGtfportd (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::2]:48377 unit = producer-server
412026-10-22T19:57:00.274ZDEBGtfportd: Requested any available port, Dropshot server has been bound to [fd00:1122:3344:101::2]:48377 unit = producer-server
422026-10-22T19:57:00.274ZDEBGtfportd: Nexus IP not provided, will use DNS to resolve it unit = producer-server
432026-10-22T19:57:00.274ZINFOtfportd (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/internal-dns/resolver/src/resolver.rs:144 unit = producer-server
442026-10-22T19:57:00.275ZDEBGtfportd: starting producer registration task unit = producer-server
452026-10-22T19:57:00.275ZINFOtfportd: starting oximeter metric producer server address = [fd00:1122:3344:101::2]:48377 file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:279 interval = 30s producer_id = 39cf5949-aee0-4123-a2c1-b517e03b3b0f unit = producer-server
462026-10-22T19:57:00.275ZINFOtfportd: created oximeter producer server unit = oximeter
472026-10-22T19:57:00.275ZDEBGtfportd (producer-registration-task): registering as oximeter producer with Nexus registration_count = 0 unit = producer-server
482026-10-22T19:57:00.275ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
492026-10-22T19:57:00.275ZDEBGtfportd (kstat-sampler): adding new target unit = oximeter
502026-10-22T19:57:00.276ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 0 delay = 1.393431ms error = "proto error: no records found for Query { name: Name(\\"_nexus._tcp.control-plane.oxide.internal.\\"), query_type: SRV, query_class: IN }" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
512026-10-22T19:57:00.277ZDEBGtfportd (kstat-sampler-worker): storing new creation time for tracked target creation_time = 2026-10-22T19:56:32.518887740Z path = KstatPath { module: "link", instance: 0, name: "tfportrear0_0" } unit = oximeter
522026-10-22T19:57:00.277ZDEBGtfportd (kstat-sampler-worker): inserted empty per-target sample queue id = 10504522126455372507 unit = oximeter
532026-10-22T19:57:00.277ZDEBGtfportd: added new link to kstat sampler link_kind = switch-port-control link_name = tfportrear0_0 unit = metrics-task-tracker
542026-10-22T19:57:00.278ZWARNtfportd: tfportqsfp0_0 has no addrs
552026-10-22T19:57:00.523ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("6e875180-3f2c-4f0b-a878-8fed5fb9ebe3.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("73898c74-0dc4-4105-8246-fe22d2a38964.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("cdf4c94b-a076-44f6-9924-6e936644b832.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("cdf4c94b-a076-44f6-9924-6e936644b832.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 569, tv_nsec: 469148009 } }) unit = producer-server
562026-10-22T19:57:00.523ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221 unit = producer-server
572026-10-22T19:57:00.543ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
582026-10-22T19:57:00.849ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
592026-10-22T19:57:00.860ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
602026-10-22T19:57:00.862ZWARNtfportd: tfportqsfp0_0 has no addrs
612026-10-22T19:57:01.472ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
622026-10-22T19:57:01.477ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
632026-10-22T19:57:01.481ZWARNtfportd: tfportqsfp0_0 has no addrs
642026-10-22T19:57:02.387ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
652026-10-22T19:57:02.392ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
662026-10-22T19:57:02.395ZWARNtfportd: tfportqsfp0_0 has no addrs
672026-10-22T19:57:02.914ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
682026-10-22T19:57:02.919ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
692026-10-22T19:57:02.922ZWARNtfportd: tfportqsfp0_0 has no addrs
702026-10-22T19:57:03.732ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
712026-10-22T19:57:03.736ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
722026-10-22T19:57:03.740ZWARNtfportd: tfportqsfp0_0 has no addrs
732026-10-22T19:57:04.537ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
742026-10-22T19:57:04.541ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
752026-10-22T19:57:04.543ZWARNtfportd: tfportqsfp0_0 has no addrs
762026-10-22T19:57:05.225ZINFOtfportd: added new ARP entry entry = 10.151.1.174->52:17:e4:ae:db:71 interface = tfportqsfp0_0
772026-10-22T19:57:05.380ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
782026-10-22T19:57:05.385ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
792026-10-22T19:57:05.388ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
802026-10-22T19:57:05.388ZDEBGtfportd (kstat-sampler): adding new target unit = oximeter
812026-10-22T19:57:05.389ZDEBGtfportd (kstat-sampler-worker): storing new creation time for tracked target creation_time = 2026-10-22T19:56:32.518752069Z path = KstatPath { module: "link", instance: 0, name: "tfportqsfp0_0" } unit = oximeter
822026-10-22T19:57:05.389ZDEBGtfportd (kstat-sampler-worker): inserted empty per-target sample queue id = 5774364433794701276 unit = oximeter
832026-10-22T19:57:05.389ZDEBGtfportd: added new link to kstat sampler link_kind = switch-port-control link_name = tfportqsfp0_0 unit = metrics-task-tracker
842026-10-22T19:57:06.389ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
852026-10-22T19:57:06.393ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
862026-10-22T19:57:06.396ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
872026-10-22T19:57:07.785ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
882026-10-22T19:57:07.790ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
892026-10-22T19:57:07.793ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
902026-10-22T19:57:09.084ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
912026-10-22T19:57:09.088ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
922026-10-22T19:57:09.091ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
932026-10-22T19:57:10.280ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10504522126455372507 n_samples = 6 unit = oximeter
942026-10-22T19:57:10.498ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
952026-10-22T19:57:10.502ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
962026-10-22T19:57:10.505ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
972026-10-22T19:57:11.189ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
982026-10-22T19:57:11.193ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
992026-10-22T19:57:11.196ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1002026-10-22T19:57:12.650ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1012026-10-22T19:57:12.654ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
1022026-10-22T19:57:12.656ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1032026-10-22T19:57:13.250ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1042026-10-22T19:57:13.255ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
1052026-10-22T19:57:13.258ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1062026-10-22T19:57:14.031ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1072026-10-22T19:57:14.035ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
1082026-10-22T19:57:14.038ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1092026-10-22T19:57:15.149ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1102026-10-22T19:57:15.154ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
1112026-10-22T19:57:15.156ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1122026-10-22T19:57:15.395ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5774364433794701276 n_samples = 6 unit = oximeter
1132026-10-22T19:57:15.549ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }) unit = producer-server
1142026-10-22T19:57:15.550ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 1 delay = 15.270783135s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
1152026-10-22T19:57:16.160ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1162026-10-22T19:57:16.165ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
1172026-10-22T19:57:16.167ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1182026-10-22T19:57:16.202ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("6e875180-3f2c-4f0b-a878-8fed5fb9ebe3.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("73898c74-0dc4-4105-8246-fe22d2a38964.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("cdf4c94b-a076-44f6-9924-6e936644b832.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("cdf4c94b-a076-44f6-9924-6e936644b832.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 585, tv_nsec: 142830790 } }) unit = producer-server
1192026-10-22T19:57:16.203ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221 unit = producer-server
1202026-10-22T19:57:16.211ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
1212026-10-22T19:57:17.562ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1222026-10-22T19:57:17.567ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
1232026-10-22T19:57:17.570ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1242026-10-22T19:57:18.175ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1252026-10-22T19:57:18.180ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
1262026-10-22T19:57:18.183ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1272026-10-22T19:57:18.971ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1282026-10-22T19:57:18.976ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
1292026-10-22T19:57:18.978ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1302026-10-22T19:57:19.608ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1312026-10-22T19:57:19.615ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
1322026-10-22T19:57:19.619ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1332026-10-22T19:57:20.357ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10504522126455372507 n_samples = 6 unit = oximeter
1342026-10-22T19:57:20.835ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1352026-10-22T19:57:20.842ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
1362026-10-22T19:57:20.846ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1372026-10-22T19:57:21.653ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1382026-10-22T19:57:21.658ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
1392026-10-22T19:57:21.662ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1402026-10-22T19:57:22.343ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1412026-10-22T19:57:22.348ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
1422026-10-22T19:57:22.351ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1432026-10-22T19:57:23.344ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1442026-10-22T19:57:23.349ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
1452026-10-22T19:57:23.352ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1462026-10-22T19:57:24.094ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1472026-10-22T19:57:24.098ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
1482026-10-22T19:57:24.100ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1492026-10-22T19:57:25.405ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1502026-10-22T19:57:25.412ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
1512026-10-22T19:57:25.422ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1522026-10-22T19:57:25.426ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5774364433794701276 n_samples = 6 unit = oximeter
1532026-10-22T19:57:26.454ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1542026-10-22T19:57:26.460ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
1552026-10-22T19:57:26.464ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1562026-10-22T19:57:27.701ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1572026-10-22T19:57:27.706ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
1582026-10-22T19:57:27.710ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1592026-10-22T19:57:28.226ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1602026-10-22T19:57:28.232ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
1612026-10-22T19:57:28.236ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1622026-10-22T19:57:29.678ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1632026-10-22T19:57:29.682ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
1642026-10-22T19:57:29.685ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1652026-10-22T19:57:30.387ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10504522126455372507 n_samples = 6 unit = oximeter
1662026-10-22T19:57:30.464ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1672026-10-22T19:57:30.469ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
1682026-10-22T19:57:30.472ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1692026-10-22T19:57:31.254ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }) unit = producer-server
1702026-10-22T19:57:31.254ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 2 delay = 30.931918455s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
1712026-10-22T19:57:31.955ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1722026-10-22T19:57:31.961ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
1732026-10-22T19:57:31.964ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1742026-10-22T19:57:32.434ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("6e875180-3f2c-4f0b-a878-8fed5fb9ebe3.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("73898c74-0dc4-4105-8246-fe22d2a38964.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("cdf4c94b-a076-44f6-9924-6e936644b832.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("cdf4c94b-a076-44f6-9924-6e936644b832.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 601, tv_nsec: 329561533 } }) unit = producer-server
1752026-10-22T19:57:32.435ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221 unit = producer-server
1762026-10-22T19:57:32.443ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
1772026-10-22T19:57:32.929ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1782026-10-22T19:57:32.934ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
1792026-10-22T19:57:32.937ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1802026-10-22T19:57:33.700ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1812026-10-22T19:57:33.705ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
1822026-10-22T19:57:33.708ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1832026-10-22T19:57:34.854ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1842026-10-22T19:57:34.859ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
1852026-10-22T19:57:34.862ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1862026-10-22T19:57:35.456ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5774364433794701276 n_samples = 6 unit = oximeter
1872026-10-22T19:57:36.378ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1882026-10-22T19:57:36.385ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
1892026-10-22T19:57:36.389ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1902026-10-22T19:57:37.032ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1912026-10-22T19:57:37.036ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
1922026-10-22T19:57:37.038ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1932026-10-22T19:57:38.396ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1942026-10-22T19:57:38.401ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
1952026-10-22T19:57:38.404ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1962026-10-22T19:57:39.425ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1972026-10-22T19:57:39.430ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
1982026-10-22T19:57:39.432ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1992026-10-22T19:57:40.395ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2002026-10-22T19:57:40.399ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
2012026-10-22T19:57:40.403ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2022026-10-22T19:57:40.406ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10504522126455372507 n_samples = 6 unit = oximeter
2032026-10-22T19:57:41.892ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2042026-10-22T19:57:41.897ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
2052026-10-22T19:57:41.900ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2062026-10-22T19:57:42.441ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2072026-10-22T19:57:42.446ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
2082026-10-22T19:57:42.450ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2092026-10-22T19:57:43.200ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2102026-10-22T19:57:43.204ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
2112026-10-22T19:57:43.207ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2122026-10-22T19:57:44.637ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2132026-10-22T19:57:44.649ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
2142026-10-22T19:57:44.654ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2152026-10-22T19:57:45.393ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2162026-10-22T19:57:45.400ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
2172026-10-22T19:57:45.404ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2182026-10-22T19:57:45.460ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5774364433794701276 n_samples = 6 unit = oximeter
2192026-10-22T19:57:46.812ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2202026-10-22T19:57:46.818ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
2212026-10-22T19:57:46.822ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2222026-10-22T19:57:47.453ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }) unit = producer-server
2232026-10-22T19:57:47.454ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 3 delay = 47.119211602s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
2242026-10-22T19:57:47.724ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2252026-10-22T19:57:47.730ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
2262026-10-22T19:57:47.734ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2272026-10-22T19:57:49.016ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2282026-10-22T19:57:49.020ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
2292026-10-22T19:57:49.023ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2302026-10-22T19:57:49.419ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("6e875180-3f2c-4f0b-a878-8fed5fb9ebe3.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("73898c74-0dc4-4105-8246-fe22d2a38964.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("cdf4c94b-a076-44f6-9924-6e936644b832.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("cdf4c94b-a076-44f6-9924-6e936644b832.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 618, tv_nsec: 305971140 } }) unit = producer-server
2312026-10-22T19:57:49.420ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221 unit = producer-server
2322026-10-22T19:57:49.426ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
2332026-10-22T19:57:50.231ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2342026-10-22T19:57:50.236ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
2352026-10-22T19:57:50.239ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2362026-10-22T19:57:50.404ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10504522126455372507 n_samples = 6 unit = oximeter
2372026-10-22T19:57:51.641ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2382026-10-22T19:57:51.646ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
2392026-10-22T19:57:51.649ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2402026-10-22T19:57:52.406ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2412026-10-22T19:57:52.410ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
2422026-10-22T19:57:52.413ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2432026-10-22T19:57:52.961ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2442026-10-22T19:57:52.965ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
2452026-10-22T19:57:52.968ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2462026-10-22T19:57:53.694ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2472026-10-22T19:57:53.700ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
2482026-10-22T19:57:53.703ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2492026-10-22T19:57:54.229ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2502026-10-22T19:57:54.234ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
2512026-10-22T19:57:54.237ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2522026-10-22T19:57:55.462ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5774364433794701276 n_samples = 6 unit = oximeter
2532026-10-22T19:57:55.633ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2542026-10-22T19:57:55.638ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
2552026-10-22T19:57:55.640ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2562026-10-22T19:57:56.677ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2572026-10-22T19:57:56.682ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
2582026-10-22T19:57:56.685ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2592026-10-22T19:57:57.395ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2602026-10-22T19:57:57.400ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
2612026-10-22T19:57:57.403ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2622026-10-22T19:57:57.969ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2632026-10-22T19:57:57.973ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
2642026-10-22T19:57:57.976ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2652026-10-22T19:57:59.369ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2662026-10-22T19:57:59.374ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
2672026-10-22T19:57:59.376ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2682026-10-22T19:58:00.409ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10504522126455372507 n_samples = 6 unit = oximeter
2692026-10-22T19:58:00.580ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2702026-10-22T19:58:00.585ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
2712026-10-22T19:58:00.588ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2722026-10-22T19:58:01.495ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2732026-10-22T19:58:01.500ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
2742026-10-22T19:58:01.503ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2752026-10-22T19:58:02.908ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2762026-10-22T19:58:02.913ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
2772026-10-22T19:58:02.917ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2782026-10-22T19:58:03.706ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2792026-10-22T19:58:03.710ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
2802026-10-22T19:58:03.713ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2812026-10-22T19:58:04.344ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2822026-10-22T19:58:04.349ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
2832026-10-22T19:58:04.352ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2842026-10-22T19:58:04.430ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }) unit = producer-server
2852026-10-22T19:58:04.431ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 4 delay = 64.094138797s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
2862026-10-22T19:58:04.943ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2872026-10-22T19:58:04.949ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
2882026-10-22T19:58:04.952ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2892026-10-22T19:58:05.465ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5774364433794701276 n_samples = 6 unit = oximeter
2902026-10-22T19:58:06.096ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2912026-10-22T19:58:06.100ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
2922026-10-22T19:58:06.104ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2932026-10-22T19:58:06.826ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2942026-10-22T19:58:06.831ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
2952026-10-22T19:58:06.834ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2962026-10-22T19:58:08.142ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("6e875180-3f2c-4f0b-a878-8fed5fb9ebe3.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("73898c74-0dc4-4105-8246-fe22d2a38964.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("cdf4c94b-a076-44f6-9924-6e936644b832.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("cdf4c94b-a076-44f6-9924-6e936644b832.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 637, tv_nsec: 26283027 } }) unit = producer-server
2972026-10-22T19:58:08.142ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221 unit = producer-server
2982026-10-22T19:58:08.150ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
2992026-10-22T19:58:08.206ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3002026-10-22T19:58:08.211ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
3012026-10-22T19:58:08.214ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3022026-10-22T19:58:08.936ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3032026-10-22T19:58:08.940ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
3042026-10-22T19:58:08.942ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3052026-10-22T19:58:09.461ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3062026-10-22T19:58:09.466ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
3072026-10-22T19:58:09.468ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3082026-10-22T19:58:10.411ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10504522126455372507 n_samples = 6 unit = oximeter
3092026-10-22T19:58:10.806ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3102026-10-22T19:58:10.810ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
3112026-10-22T19:58:10.813ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3122026-10-22T19:58:11.827ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3132026-10-22T19:58:11.832ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
3142026-10-22T19:58:11.834ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3152026-10-22T19:58:13.289ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3162026-10-22T19:58:13.294ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
3172026-10-22T19:58:13.297ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3182026-10-22T19:58:13.962ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3192026-10-22T19:58:13.967ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
3202026-10-22T19:58:13.970ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3212026-10-22T19:58:14.908ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3222026-10-22T19:58:14.915ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
3232026-10-22T19:58:14.918ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3242026-10-22T19:58:15.467ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5774364433794701276 n_samples = 6 unit = oximeter
3252026-10-22T19:58:16.496ZINFOtfportd: removed stale NDP entry :fe80::fc30:daff:fefd:ae43->fe:30:da:fd:ae:43
3262026-10-22T19:58:21.221ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3272026-10-22T19:58:21.240ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10504522126455372507 n_samples = 6 unit = oximeter
3282026-10-22T19:58:21.242ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
3292026-10-22T19:58:21.964ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3302026-10-22T19:58:23.429ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::fc30:daff:fefd:ae43->fe:30:da:fd:ae:43 interface = tfportrear0_0
3312026-10-22T19:58:23.551ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }) unit = producer-server
3322026-10-22T19:58:24.058ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 5 delay = 83.637959134s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
3332026-10-22T19:58:25.575ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3342026-10-22T19:58:25.599ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5774364433794701276 n_samples = 6 unit = oximeter
3352026-10-22T19:58:25.630ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
3362026-10-22T19:58:25.996ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3372026-10-22T19:58:27.481ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3382026-10-22T19:58:27.488ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
3392026-10-22T19:58:27.493ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3402026-10-22T19:58:29.029ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3412026-10-22T19:58:29.037ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
3422026-10-22T19:58:29.042ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3432026-10-22T19:58:30.532ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3442026-10-22T19:58:30.538ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
3452026-10-22T19:58:30.542ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3462026-10-22T19:58:31.307ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10504522126455372507 n_samples = 6 unit = oximeter
3472026-10-22T19:58:31.858ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3482026-10-22T19:58:31.866ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
3492026-10-22T19:58:31.873ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3502026-10-22T19:58:33.283ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3512026-10-22T19:58:33.294ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
3522026-10-22T19:58:33.301ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3532026-10-22T19:58:34.462ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3542026-10-22T19:58:34.470ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
3552026-10-22T19:58:34.477ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3562026-10-22T19:58:35.354ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3572026-10-22T19:58:35.361ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
3582026-10-22T19:58:35.365ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3592026-10-22T19:58:35.439ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("6e875180-3f2c-4f0b-a878-8fed5fb9ebe3.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("73898c74-0dc4-4105-8246-fe22d2a38964.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("cdf4c94b-a076-44f6-9924-6e936644b832.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("cdf4c94b-a076-44f6-9924-6e936644b832.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 664, tv_nsec: 320948366 } }) unit = producer-server
3602026-10-22T19:58:35.440ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221 unit = producer-server
3612026-10-22T19:58:35.526ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
3622026-10-22T19:58:35.605ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5774364433794701276 n_samples = 6 unit = oximeter
3632026-10-22T19:58:36.577ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3642026-10-22T19:58:36.583ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
3652026-10-22T19:58:36.588ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3662026-10-22T19:58:37.820ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3672026-10-22T19:58:37.827ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
3682026-10-22T19:58:37.832ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3692026-10-22T19:58:39.150ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3702026-10-22T19:58:39.155ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
3712026-10-22T19:58:39.159ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3722026-10-22T19:58:39.790ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3732026-10-22T19:58:39.797ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
3742026-10-22T19:58:39.802ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3752026-10-22T19:58:40.673ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3762026-10-22T19:58:40.679ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
3772026-10-22T19:58:40.683ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3782026-10-22T19:58:41.353ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10504522126455372507 n_samples = 6 unit = oximeter
3792026-10-22T19:58:41.892ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3802026-10-22T19:58:41.899ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
3812026-10-22T19:58:41.903ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3822026-10-22T19:58:42.525ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3832026-10-22T19:58:42.532ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
3842026-10-22T19:58:42.536ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3852026-10-22T19:58:43.663ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3862026-10-22T19:58:43.673ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
3872026-10-22T19:58:43.677ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3882026-10-22T19:58:44.801ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3892026-10-22T19:58:44.806ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
3902026-10-22T19:58:44.821ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3912026-10-22T19:58:45.612ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5774364433794701276 n_samples = 6 unit = oximeter
3922026-10-22T19:58:46.190ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3932026-10-22T19:58:46.196ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
3942026-10-22T19:58:46.199ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3952026-10-22T19:58:47.110ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3962026-10-22T19:58:47.116ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
3972026-10-22T19:58:47.125ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3982026-10-22T19:58:48.489ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3992026-10-22T19:58:48.494ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
4002026-10-22T19:58:48.497ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4012026-10-22T19:58:49.834ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4022026-10-22T19:58:49.840ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
4032026-10-22T19:58:49.844ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4042026-10-22T19:58:50.529ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }) unit = producer-server
4052026-10-22T19:58:50.532ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 6 delay = 110.193150534s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
4062026-10-22T19:58:51.300ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4072026-10-22T19:58:51.306ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
4082026-10-22T19:58:51.310ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4092026-10-22T19:58:51.357ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10504522126455372507 n_samples = 6 unit = oximeter
4102026-10-22T19:58:52.259ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4112026-10-22T19:58:52.268ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
4122026-10-22T19:58:52.272ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4132026-10-22T19:58:53.788ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4142026-10-22T19:58:53.797ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
4152026-10-22T19:58:53.802ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4162026-10-22T19:58:54.477ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4172026-10-22T19:58:54.485ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
4182026-10-22T19:58:54.494ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4192026-10-22T19:58:55.039ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4202026-10-22T19:58:55.045ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
4212026-10-22T19:58:55.050ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4222026-10-22T19:58:55.615ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5774364433794701276 n_samples = 6 unit = oximeter
4232026-10-22T19:58:56.071ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4242026-10-22T19:58:56.076ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
4252026-10-22T19:58:56.079ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4262026-10-22T19:58:56.899ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4272026-10-22T19:58:56.904ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
4282026-10-22T19:58:56.907ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4292026-10-22T19:58:57.820ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4302026-10-22T19:58:57.825ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
4312026-10-22T19:58:57.828ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4322026-10-22T19:58:59.049ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4332026-10-22T19:58:59.055ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
4342026-10-22T19:58:59.058ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4352026-10-22T19:58:59.843ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4362026-10-22T19:58:59.848ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
4372026-10-22T19:58:59.851ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4382026-10-22T19:59:00.093ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("6e875180-3f2c-4f0b-a878-8fed5fb9ebe3.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("73898c74-0dc4-4105-8246-fe22d2a38964.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("cdf4c94b-a076-44f6-9924-6e936644b832.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("cdf4c94b-a076-44f6-9924-6e936644b832.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 688, tv_nsec: 976103120 } }) unit = producer-server
4392026-10-22T19:59:00.094ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221 unit = producer-server
4402026-10-22T19:59:00.102ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
4412026-10-22T19:59:00.677ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4422026-10-22T19:59:00.681ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
4432026-10-22T19:59:00.684ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4442026-10-22T19:59:01.176ZDEBGtfportd (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 503, headers: {"content-type": "application/json", "x-request-id": "f9045db6-96eb-4856-a510-92b043dcccf1", "content-length": "133", "date": "Thu, 22 Oct 2026 19:59:01 GMT"} }) unit = producer-server
4452026-10-22T19:59:01.177ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 7 delay = 120.838792733s error = "Error Response: status: 503 Service Unavailable; headers: {\\"content-type\\": \\"application/json\\", \\"x-request-id\\": \\"f9045db6-96eb-4856-a510-92b043dcccf1\\", \\"content-length\\": \\"133\\", \\"date\\": \\"Thu, 22 Oct 2026 19:59:01 GMT\\"}; value: Error { error_code: Some(\\"ServiceNotAvailable\\"), message: \\"Service Unavailable\\", request_id: \\"f9045db6-96eb-4856-a510-92b043dcccf1\\" }" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
4462026-10-22T19:59:01.358ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10504522126455372507 n_samples = 6 unit = oximeter
4472026-10-22T19:59:01.804ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4482026-10-22T19:59:01.809ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
4492026-10-22T19:59:01.812ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4502026-10-22T19:59:02.411ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4512026-10-22T19:59:02.416ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
4522026-10-22T19:59:02.419ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4532026-10-22T19:59:03.758ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4542026-10-22T19:59:03.763ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
4552026-10-22T19:59:03.766ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4562026-10-22T19:59:04.528ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4572026-10-22T19:59:04.533ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
4582026-10-22T19:59:04.536ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4592026-10-22T19:59:05.251ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4602026-10-22T19:59:05.257ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
4612026-10-22T19:59:05.260ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4622026-10-22T19:59:05.617ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5774364433794701276 n_samples = 6 unit = oximeter
4632026-10-22T19:59:06.132ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4642026-10-22T19:59:06.138ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
4652026-10-22T19:59:06.142ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4662026-10-22T19:59:07.508ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4672026-10-22T19:59:07.514ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
4682026-10-22T19:59:07.516ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4692026-10-22T19:59:08.603ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4702026-10-22T19:59:08.608ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
4712026-10-22T19:59:08.611ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4722026-10-22T19:59:09.817ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4732026-10-22T19:59:09.822ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
4742026-10-22T19:59:09.824ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4752026-10-22T19:59:10.490ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4762026-10-22T19:59:10.495ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
4772026-10-22T19:59:10.498ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4782026-10-22T19:59:11.360ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10504522126455372507 n_samples = 6 unit = oximeter
4792026-10-22T19:59:11.840ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4802026-10-22T19:59:11.845ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
4812026-10-22T19:59:11.848ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4822026-10-22T19:59:13.128ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4832026-10-22T19:59:13.133ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
4842026-10-22T19:59:13.135ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4852026-10-22T19:59:13.764ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4862026-10-22T19:59:13.769ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
4872026-10-22T19:59:13.772ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4882026-10-22T19:59:14.535ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4892026-10-22T19:59:14.540ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
4902026-10-22T19:59:14.543ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4912026-10-22T19:59:15.384ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4922026-10-22T19:59:15.389ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
4932026-10-22T19:59:15.392ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4942026-10-22T19:59:15.619ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5774364433794701276 n_samples = 6 unit = oximeter
4952026-10-22T19:59:16.360ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4962026-10-22T19:59:16.366ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
4972026-10-22T19:59:16.370ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4982026-10-22T19:59:17.611ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4992026-10-22T19:59:17.616ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
5002026-10-22T19:59:17.619ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5012026-10-22T19:59:18.252ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5022026-10-22T19:59:18.260ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
5032026-10-22T19:59:18.265ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5042026-10-22T19:59:18.921ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5052026-10-22T19:59:18.925ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
5062026-10-22T19:59:18.928ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5072026-10-22T19:59:20.141ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5082026-10-22T19:59:20.147ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
5092026-10-22T19:59:20.150ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5102026-10-22T19:59:21.363ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10504522126455372507 n_samples = 6 unit = oximeter
5112026-10-22T19:59:21.499ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5122026-10-22T19:59:21.505ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
5132026-10-22T19:59:21.508ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5142026-10-22T19:59:22.671ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5152026-10-22T19:59:22.676ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
5162026-10-22T19:59:22.679ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5172026-10-22T19:59:23.708ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5182026-10-22T19:59:23.714ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
5192026-10-22T19:59:23.717ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5202026-10-22T19:59:24.248ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5212026-10-22T19:59:24.253ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
5222026-10-22T19:59:24.256ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5232026-10-22T19:59:25.440ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5242026-10-22T19:59:25.444ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
5252026-10-22T19:59:25.447ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5262026-10-22T19:59:25.623ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5774364433794701276 n_samples = 6 unit = oximeter
5272026-10-22T19:59:25.972ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5282026-10-22T19:59:25.977ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
5292026-10-22T19:59:25.980ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5302026-10-22T19:59:26.812ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5312026-10-22T19:59:26.818ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
5322026-10-22T19:59:26.821ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5332026-10-22T19:59:27.698ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5342026-10-22T19:59:27.705ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
5352026-10-22T19:59:27.708ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5362026-10-22T19:59:28.765ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5372026-10-22T19:59:28.769ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
5382026-10-22T19:59:28.772ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5392026-10-22T19:59:29.983ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5402026-10-22T19:59:29.988ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
5412026-10-22T19:59:29.991ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5422026-10-22T19:59:31.128ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5432026-10-22T19:59:31.132ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
5442026-10-22T19:59:31.135ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5452026-10-22T19:59:31.367ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10504522126455372507 n_samples = 6 unit = oximeter
5462026-10-22T19:59:32.099ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5472026-10-22T19:59:32.104ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
5482026-10-22T19:59:32.107ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5492026-10-22T19:59:33.055ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5502026-10-22T19:59:33.060ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
5512026-10-22T19:59:33.063ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5522026-10-22T19:59:33.631ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5532026-10-22T19:59:33.637ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
5542026-10-22T19:59:33.639ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5552026-10-22T19:59:35.113ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5562026-10-22T19:59:35.118ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
5572026-10-22T19:59:35.121ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5582026-10-22T19:59:35.624ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5774364433794701276 n_samples = 6 unit = oximeter
5592026-10-22T19:59:36.303ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5602026-10-22T19:59:36.311ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
5612026-10-22T19:59:36.316ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5622026-10-22T19:59:37.369ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5632026-10-22T19:59:37.374ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
5642026-10-22T19:59:37.377ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5652026-10-22T19:59:37.783ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("6e875180-3f2c-4f0b-a878-8fed5fb9ebe3.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("73898c74-0dc4-4105-8246-fe22d2a38964.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("cdf4c94b-a076-44f6-9924-6e936644b832.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("cdf4c94b-a076-44f6-9924-6e936644b832.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 726, tv_nsec: 666229400 } }) unit = producer-server
5662026-10-22T19:59:37.784ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221 unit = producer-server
5672026-10-22T19:59:37.869ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
5682026-10-22T19:59:37.973ZDEBGtfportd (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "7b79e3d4-b765-4819-aa8d-f6cfc725f1ef", "content-length": "41", "date": "Thu, 22 Oct 2026 19:59:37 GMT"} }) unit = producer-server
5692026-10-22T19:59:37.974ZDEBGtfportd (producer-registration-task): successfully registered with Nexus, pausing until time to renew lease lease_duration = 600s unit = producer-server wait_period = 150s
5702026-10-22T19:59:38.201ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5712026-10-22T19:59:38.206ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
5722026-10-22T19:59:38.208ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5732026-10-22T19:59:39.297ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5742026-10-22T19:59:39.302ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
5752026-10-22T19:59:39.304ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5762026-10-22T19:59:40.597ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5772026-10-22T19:59:40.601ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
5782026-10-22T19:59:40.604ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5792026-10-22T19:59:41.370ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10504522126455372507 n_samples = 6 unit = oximeter
5802026-10-22T19:59:41.817ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5812026-10-22T19:59:41.822ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
5822026-10-22T19:59:41.825ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5832026-10-22T19:59:42.808ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5842026-10-22T19:59:42.813ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
5852026-10-22T19:59:42.816ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5862026-10-22T19:59:44.323ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5872026-10-22T19:59:44.328ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
5882026-10-22T19:59:44.331ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5892026-10-22T19:59:45.627ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5774364433794701276 n_samples = 6 unit = oximeter
5902026-10-22T19:59:45.765ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5912026-10-22T19:59:45.770ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
5922026-10-22T19:59:45.773ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5932026-10-22T19:59:47.193ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5942026-10-22T19:59:47.198ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
5952026-10-22T19:59:47.201ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5962026-10-22T19:59:47.914ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5972026-10-22T19:59:47.919ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
5982026-10-22T19:59:47.922ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5992026-10-22T19:59:48.782ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6002026-10-22T19:59:48.788ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
6012026-10-22T19:59:48.791ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6022026-10-22T19:59:49.810ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6032026-10-22T19:59:49.814ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
6042026-10-22T19:59:49.818ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6052026-10-22T19:59:51.029ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6062026-10-22T19:59:51.034ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
6072026-10-22T19:59:51.037ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6082026-10-22T19:59:51.372ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10504522126455372507 n_samples = 6 unit = oximeter
6092026-10-22T19:59:51.680ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6102026-10-22T19:59:51.686ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
6112026-10-22T19:59:51.689ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6122026-10-22T19:59:53.078ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6132026-10-22T19:59:53.083ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
6142026-10-22T19:59:53.086ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6152026-10-22T19:59:53.714ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6162026-10-22T19:59:53.719ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
6172026-10-22T19:59:53.722ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6182026-10-22T19:59:54.503ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6192026-10-22T19:59:54.507ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
6202026-10-22T19:59:54.511ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6212026-10-22T19:59:55.478ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6222026-10-22T19:59:55.483ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
6232026-10-22T19:59:55.486ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6242026-10-22T19:59:55.629ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5774364433794701276 n_samples = 6 unit = oximeter
6252026-10-22T19:59:56.442ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6262026-10-22T19:59:56.447ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
6272026-10-22T19:59:56.450ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6282026-10-22T19:59:56.975ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6292026-10-22T19:59:56.979ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
6302026-10-22T19:59:56.982ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6312026-10-22T19:59:57.967ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6322026-10-22T19:59:57.971ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
6332026-10-22T19:59:57.974ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6342026-10-22T19:59:59.312ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6352026-10-22T19:59:59.317ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
6362026-10-22T19:59:59.320ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6372026-10-22T20:00:00.047ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6382026-10-22T20:00:00.052ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3003:f2ff:fec6:512a]
6392026-10-22T20:00:00.054ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]