Max level shown:
1 [ Oct 19 18:27:17 Enabled. ]
2 [ Oct 19 18:27:17 Rereading configuration. ]
3 [ Oct 19 18:27:18 Rereading configuration. ]
4 [ Oct 19 18:27:29 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dendrite/bin/tfportd --sync-only &"). ]
5 [ Oct 19 18:27:29 Method "start" exited with status 0. ]
6 No non-localhost IPv6 addresses found in SMF properties
72026-10-19T18:27:29.351ZINFOtfportd: connecting to dpd host = [::1] port = 12224
82026-10-19T18:27:29.352ZINFOtfportd: connected to dpd running softnpu-a133c73e
92026-10-19T18:27:29.353ZINFOtfportd: running in sync-only mode
102026-10-19T18:27:29.353ZINFOtfportd: no non-localhost IPv6 listen address available, waiting for SMF update unit = oximeter
112026-10-19T18:27:29.353ZINFOtfportd: refreshing SMF config prior to waiting on signals unit = signal_handler
12 No non-localhost IPv6 addresses found in SMF properties
132026-10-19T18:27:29.355ZINFOtfportd: refreshed config: Config { log_file: None, log_format: Json, listen_addresses: [ [::1]:12231, ], pkt_source: None, dpd_host: "[::1]", dpd_port: 12224, vlan_link: None, vlan_data: None, techport0_prefix: None, techport1_prefix: None, rack_id: Some( 10695a6f-9609-4224-840a-3d751d73f3c1, ), sled_id: Some( 153498b6-4b21-4ea1-94bc-c71c9132a8ae, ), sled_model: Some( "i86pc", ), sled_revision: Some( 0, ), sled_serial: Some( "buskin", ), }
142026-10-19T18:27:29.355ZINFOtfportd: no non-localhost IPv6 listen address available, waiting for SMF update unit = oximeter
152026-10-19T18:27:29.360ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::eca1:a6ff:fe88:5a14->ee:a1:a6:88:5a:14 interface = tfportrear0_0
162026-10-19T18:27:29.362ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
172026-10-19T18:27:29.367ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
182026-10-19T18:27:29.372ZWARNtfportd: tfportqsfp0_0 has no addrs
19 [ Oct 19 18:27:30 Rereading configuration. ]
20 [ Oct 19 18:27:30 Executing refresh method (:kill). ]
21 [ Oct 19 18:27:30 Stopping because all processes in service exited. ]
22 [ Oct 19 18:27:30 Executing stop method (:kill). ]
23 [ Oct 19 18:27:30 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dendrite/bin/tfportd --sync-only &"). ]
24 [ Oct 19 18:27:30 Method "start" exited with status 0. ]
252026-10-19T18:27:30.326ZINFOtfportd: connecting to dpd host = [::1] port = 12224
262026-10-19T18:27:30.327ZINFOtfportd: connected to dpd running softnpu-a133c73e
272026-10-19T18:27:30.327ZINFOtfportd: running in sync-only mode
282026-10-19T18:27:30.328ZINFOtfportd: found suitable IPv6 address for oximeter producer server address = fd00:1122:3344:101::2 unit = oximeter
292026-10-19T18:27:30.328ZINFOtfportd: refreshing SMF config prior to waiting on signals unit = signal_handler
302026-10-19T18:27:30.328ZDEBGtfportd: extracted oximeter configuration data config = OximeterConfig { listen_address: fd00:1122:3344:101::2, sled_identifiers: SledIdentifiers { rack_id: 10695a6f-9609-4224-840a-3d751d73f3c1, sled_id: 153498b6-4b21-4ea1-94bc-c71c9132a8ae, model: "i86pc", revision: 0, serial: "buskin" }, switch_identifiers: SwitchIdentifiers { asic_backend: "softnpu", fab: None, fuse: Some(FuseData { chip_rev: ChipRevision { device_id: 272, rev: "B1", rev_num: 2 }, disabled: DisabledFeatures { bsync: false, mau: [0, 0, 0, 0], pgen: false, pipes: 0, ports: 0, resub: false, speeds: 0, tm_mem: 0 }, frequency: FrequencySettings { bps: 3, bps_ext: 0, cpu_speed_dis: 0, disabled: false, pcie_dis: 0, pps: 3, pps_ext: 0 }, manufacturing: ManufacturingData { core_repair: false, die_rotation: false, pmro_and_skew: 0, silent_spin: 0, soft_pipe_dis: 0, tile_repair: false, voltage_scaling: 0, wf_core_repair: false }, part: PartInfo { part_num: 4660, pkg_id: 1, version: 2 } }), lot: None, lotnum: None, model: "FAKE_SIM_SIDECAR", revision: 0, serial: "SimSidecar0", sidecar_id: 6ecf96ef-118f-4581-b2a6-31297a3c5cc6, slot: 0, wafer: None, wafer_loc: None } } unit = oximeter
312026-10-19T18:27:30.328ZDEBGtfportd: created producer ID producer_id = 6b925436-cca7-4904-a210-cb40f67d07a8 unit = oximeter
322026-10-19T18:27:30.330ZINFOtfportd: refreshed config: Config { log_file: None, log_format: Json, listen_addresses: [ [fd00:1122:3344:101::2]:12231, [::1]:12231, ], pkt_source: None, dpd_host: "[::1]", dpd_port: 12224, vlan_link: None, vlan_data: None, techport0_prefix: None, techport1_prefix: None, rack_id: Some( 10695a6f-9609-4224-840a-3d751d73f3c1, ), sled_id: Some( 153498b6-4b21-4ea1-94bc-c71c9132a8ae, ), sled_model: Some( "i86pc", ), sled_revision: Some( 0, ), sled_serial: Some( "buskin", ), }
332026-10-19T18:27:30.338ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
342026-10-19T18:27:30.339ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::eca1:a6ff:fe88:5a14->ee:a1:a6:88:5a:14 interface = tfportrear0_0
352026-10-19T18:27:30.341ZDEBGtfportd: registered DTrace probes unit = producer-server
362026-10-19T18:27:30.342ZDEBGtfportd (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::2]:62175 method = GET path = /{producer_id} unit = producer-server versions = all
372026-10-19T18:27:30.342ZINFOtfportd (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:328 local_addr = [fd00:1122:3344:101::2]:62175 unit = producer-server
382026-10-19T18:27:30.342ZDEBGtfportd (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::2]:62175 unit = producer-server
392026-10-19T18:27:30.342ZDEBGtfportd: Requested any available port, Dropshot server has been bound to [fd00:1122:3344:101::2]:62175 unit = producer-server
402026-10-19T18:27:30.342ZDEBGtfportd: Nexus IP not provided, will use DNS to resolve it unit = producer-server
412026-10-19T18:27:30.342ZINFOtfportd (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/internal-dns/resolver/src/resolver.rs:144 unit = producer-server
422026-10-19T18:27:30.343ZDEBGtfportd: starting producer registration task unit = producer-server
432026-10-19T18:27:30.343ZINFOtfportd: starting oximeter metric producer server address = [fd00:1122:3344:101::2]:62175 file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:279 interval = 30s producer_id = 6b925436-cca7-4904-a210-cb40f67d07a8 unit = producer-server
442026-10-19T18:27:30.343ZINFOtfportd: created oximeter producer server unit = oximeter
452026-10-19T18:27:30.343ZDEBGtfportd (producer-registration-task): registering as oximeter producer with Nexus registration_count = 0 unit = producer-server
462026-10-19T18:27:30.344ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
472026-10-19T18:27:30.344ZDEBGtfportd (kstat-sampler): adding new target unit = oximeter
482026-10-19T18:27:30.344ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("13ca8606-1064-4ca1-be25-18d3910f3853.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("188d2584-0d27-48c1-9796-d7695fe9d394.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("f5e40381-d131-4b1e-b1df-44e5bef474ac.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("f5e40381-d131-4b1e-b1df-44e5bef474ac.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::c)) }], valid_until: Instant { tv_sec: 591, tv_nsec: 1673722 } }) unit = producer-server
492026-10-19T18:27:30.345ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
502026-10-19T18:27:30.345ZDEBGtfportd (kstat-sampler-worker): storing new creation time for tracked target creation_time = 2026-10-19T18:27:12.905248887Z path = KstatPath { module: "link", instance: 0, name: "tfportrear0_0" } unit = oximeter
512026-10-19T18:27:30.345ZDEBGtfportd (kstat-sampler-worker): inserted empty per-target sample queue id = 6095789274615176864 unit = oximeter
522026-10-19T18:27:30.345ZDEBGtfportd: added new link to kstat sampler link_kind = switch-port-control link_name = tfportrear0_0 unit = metrics-task-tracker
532026-10-19T18:27:30.347ZWARNtfportd: tfportqsfp0_0 has no addrs
542026-10-19T18:27:30.363ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
552026-10-19T18:27:31.184ZINFOtfportd: added new ARP entry entry = 10.151.1.174->26:e6:9f:0e:35:0d interface = tfportqsfp0_0
562026-10-19T18:27:31.362ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::fc45:e9ff:feeb:4e95->fe:45:e9:eb:4e:95 interface = tfportrear0_0
572026-10-19T18:27:31.766ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
582026-10-19T18:27:31.771ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
592026-10-19T18:27:31.774ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
602026-10-19T18:27:31.775ZDEBGtfportd (kstat-sampler): adding new target unit = oximeter
612026-10-19T18:27:31.776ZDEBGtfportd (kstat-sampler-worker): storing new creation time for tracked target creation_time = 2026-10-19T18:27:12.905114875Z path = KstatPath { module: "link", instance: 0, name: "tfportqsfp0_0" } unit = oximeter
622026-10-19T18:27:31.776ZDEBGtfportd (kstat-sampler-worker): inserted empty per-target sample queue id = 2190118730663490815 unit = oximeter
632026-10-19T18:27:31.776ZDEBGtfportd: added new link to kstat sampler link_kind = switch-port-control link_name = tfportqsfp0_0 unit = metrics-task-tracker
642026-10-19T18:27:33.244ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
652026-10-19T18:27:33.247ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
662026-10-19T18:27:33.250ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
672026-10-19T18:27:33.825ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
682026-10-19T18:27:33.829ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
692026-10-19T18:27:33.832ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
702026-10-19T18:27:35.252ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
712026-10-19T18:27:35.258ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
722026-10-19T18:27:35.262ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
732026-10-19T18:27:36.720ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
742026-10-19T18:27:36.725ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
752026-10-19T18:27:36.728ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
762026-10-19T18:27:38.007ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
772026-10-19T18:27:38.012ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
782026-10-19T18:27:38.014ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
792026-10-19T18:27:38.598ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
802026-10-19T18:27:38.602ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
812026-10-19T18:27:38.605ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
822026-10-19T18:27:39.204ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
832026-10-19T18:27:39.208ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
842026-10-19T18:27:39.211ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
852026-10-19T18:27:40.184ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
862026-10-19T18:27:40.189ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
872026-10-19T18:27:40.192ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
882026-10-19T18:27:40.348ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 6095789274615176864 n_samples = 6 unit = oximeter
892026-10-19T18:27:41.466ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
902026-10-19T18:27:41.469ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
912026-10-19T18:27:41.472ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
922026-10-19T18:27:41.779ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 2190118730663490815 n_samples = 6 unit = oximeter
932026-10-19T18:27:42.919ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
942026-10-19T18:27:42.924ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
952026-10-19T18:27:42.926ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
962026-10-19T18:27:44.013ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
972026-10-19T18:27:44.017ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
982026-10-19T18:27:44.020ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
992026-10-19T18:27:45.298ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1002026-10-19T18:27:45.302ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
1012026-10-19T18:27:45.305ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1022026-10-19T18:27:46.270ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
1032026-10-19T18:27:46.271ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 0 delay = 15.022359326s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
1042026-10-19T18:27:46.287ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1052026-10-19T18:27:46.292ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
1062026-10-19T18:27:46.295ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1072026-10-19T18:27:46.442ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("13ca8606-1064-4ca1-be25-18d3910f3853.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("188d2584-0d27-48c1-9796-d7695fe9d394.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("f5e40381-d131-4b1e-b1df-44e5bef474ac.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("f5e40381-d131-4b1e-b1df-44e5bef474ac.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::c)) }], valid_until: Instant { tv_sec: 606, tv_nsec: 193630499 } }) unit = producer-server
1082026-10-19T18:27:46.443ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
1092026-10-19T18:27:46.451ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
1102026-10-19T18:27:47.269ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1112026-10-19T18:27:47.273ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
1122026-10-19T18:27:47.276ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1132026-10-19T18:27:48.050ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1142026-10-19T18:27:48.055ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
1152026-10-19T18:27:48.058ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1162026-10-19T18:27:49.120ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1172026-10-19T18:27:49.124ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
1182026-10-19T18:27:49.127ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1192026-10-19T18:27:50.482ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1202026-10-19T18:27:50.487ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
1212026-10-19T18:27:50.490ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1222026-10-19T18:27:51.245ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 6095789274615176864 n_samples = 6 unit = oximeter
1232026-10-19T18:27:51.911ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1242026-10-19T18:27:51.916ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
1252026-10-19T18:27:51.918ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1262026-10-19T18:27:52.671ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 2190118730663490815 n_samples = 6 unit = oximeter
1272026-10-19T18:27:52.893ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1282026-10-19T18:27:52.898ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
1292026-10-19T18:27:52.901ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1302026-10-19T18:27:53.827ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1312026-10-19T18:27:53.832ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
1322026-10-19T18:27:53.834ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1332026-10-19T18:27:54.786ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1342026-10-19T18:27:54.790ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
1352026-10-19T18:27:54.793ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1362026-10-19T18:27:56.207ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1372026-10-19T18:27:56.212ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
1382026-10-19T18:27:56.215ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1392026-10-19T18:27:56.893ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1402026-10-19T18:27:56.898ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
1412026-10-19T18:27:56.900ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1422026-10-19T18:27:57.906ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1432026-10-19T18:27:57.910ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
1442026-10-19T18:27:57.913ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1452026-10-19T18:27:58.904ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1462026-10-19T18:27:58.908ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
1472026-10-19T18:27:58.910ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1482026-10-19T18:27:59.703ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1492026-10-19T18:27:59.708ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
1502026-10-19T18:27:59.711ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1512026-10-19T18:28:00.542ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1522026-10-19T18:28:00.547ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
1532026-10-19T18:28:00.549ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1542026-10-19T18:28:01.219ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 6095789274615176864 n_samples = 6 unit = oximeter
1552026-10-19T18:28:01.413ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
1562026-10-19T18:28:01.415ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 1 delay = 30.205463676s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
1572026-10-19T18:28:01.881ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("13ca8606-1064-4ca1-be25-18d3910f3853.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("188d2584-0d27-48c1-9796-d7695fe9d394.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("f5e40381-d131-4b1e-b1df-44e5bef474ac.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("f5e40381-d131-4b1e-b1df-44e5bef474ac.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::c)) }], valid_until: Instant { tv_sec: 621, tv_nsec: 673294741 } }) unit = producer-server
1582026-10-19T18:28:01.882ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
1592026-10-19T18:28:01.888ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
1602026-10-19T18:28:01.888ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1612026-10-19T18:28:01.893ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
1622026-10-19T18:28:01.895ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1632026-10-19T18:28:02.646ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 2190118730663490815 n_samples = 6 unit = oximeter
1642026-10-19T18:28:03.193ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1652026-10-19T18:28:03.197ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
1662026-10-19T18:28:03.200ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1672026-10-19T18:28:04.512ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1682026-10-19T18:28:04.515ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
1692026-10-19T18:28:04.517ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1702026-10-19T18:28:05.376ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1712026-10-19T18:28:05.380ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
1722026-10-19T18:28:05.383ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1732026-10-19T18:28:06.616ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1742026-10-19T18:28:06.620ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
1752026-10-19T18:28:06.623ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1762026-10-19T18:28:07.399ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1772026-10-19T18:28:07.403ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
1782026-10-19T18:28:07.406ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1792026-10-19T18:28:08.865ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1802026-10-19T18:28:08.870ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
1812026-10-19T18:28:08.872ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1822026-10-19T18:28:09.919ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1832026-10-19T18:28:09.924ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
1842026-10-19T18:28:09.927ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1852026-10-19T18:28:10.589ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1862026-10-19T18:28:10.593ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
1872026-10-19T18:28:10.596ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1882026-10-19T18:28:11.193ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 6095789274615176864 n_samples = 6 unit = oximeter
1892026-10-19T18:28:11.484ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1902026-10-19T18:28:11.489ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
1912026-10-19T18:28:11.491ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1922026-10-19T18:28:12.466ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1932026-10-19T18:28:12.471ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
1942026-10-19T18:28:12.473ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1952026-10-19T18:28:12.620ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 2190118730663490815 n_samples = 6 unit = oximeter
1962026-10-19T18:28:13.650ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1972026-10-19T18:28:13.654ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
1982026-10-19T18:28:13.656ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1992026-10-19T18:28:14.638ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2002026-10-19T18:28:14.642ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
2012026-10-19T18:28:14.645ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2022026-10-19T18:28:15.769ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2032026-10-19T18:28:15.774ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
2042026-10-19T18:28:15.776ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2052026-10-19T18:28:16.849ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
2062026-10-19T18:28:16.850ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 2 delay = 45.682492346s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
2072026-10-19T18:28:16.861ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2082026-10-19T18:28:16.865ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
2092026-10-19T18:28:16.868ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2102026-10-19T18:28:17.581ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("13ca8606-1064-4ca1-be25-18d3910f3853.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("188d2584-0d27-48c1-9796-d7695fe9d394.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("f5e40381-d131-4b1e-b1df-44e5bef474ac.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("f5e40381-d131-4b1e-b1df-44e5bef474ac.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::c)) }], valid_until: Instant { tv_sec: 637, tv_nsec: 415401486 } }) unit = producer-server
2112026-10-19T18:28:17.581ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
2122026-10-19T18:28:17.588ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
2132026-10-19T18:28:17.841ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2142026-10-19T18:28:17.845ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
2152026-10-19T18:28:17.848ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2162026-10-19T18:28:19.049ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2172026-10-19T18:28:19.057ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
2182026-10-19T18:28:19.060ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2192026-10-19T18:28:20.080ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2202026-10-19T18:28:20.084ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
2212026-10-19T18:28:20.087ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2222026-10-19T18:28:20.678ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2232026-10-19T18:28:20.683ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
2242026-10-19T18:28:20.686ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2252026-10-19T18:28:21.168ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 6095789274615176864 n_samples = 6 unit = oximeter
2262026-10-19T18:28:21.988ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2272026-10-19T18:28:21.992ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
2282026-10-19T18:28:21.995ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2292026-10-19T18:28:22.595ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 2190118730663490815 n_samples = 6 unit = oximeter
2302026-10-19T18:28:22.919ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2312026-10-19T18:28:22.923ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
2322026-10-19T18:28:22.926ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2332026-10-19T18:28:23.967ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2342026-10-19T18:28:23.971ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
2352026-10-19T18:28:23.973ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2362026-10-19T18:28:24.587ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2372026-10-19T18:28:24.592ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
2382026-10-19T18:28:24.594ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2392026-10-19T18:28:25.391ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2402026-10-19T18:28:25.395ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
2412026-10-19T18:28:25.398ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2422026-10-19T18:28:25.951ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2432026-10-19T18:28:25.955ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
2442026-10-19T18:28:25.957ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2452026-10-19T18:28:26.567ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2462026-10-19T18:28:26.571ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
2472026-10-19T18:28:26.574ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2482026-10-19T18:28:27.516ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2492026-10-19T18:28:27.520ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
2502026-10-19T18:28:27.523ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2512026-10-19T18:28:28.142ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2522026-10-19T18:28:28.146ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
2532026-10-19T18:28:28.148ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2542026-10-19T18:28:28.730ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2552026-10-19T18:28:28.734ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
2562026-10-19T18:28:28.737ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2572026-10-19T18:28:29.256ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2582026-10-19T18:28:29.261ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
2592026-10-19T18:28:29.263ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2602026-10-19T18:28:30.756ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2612026-10-19T18:28:30.760ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
2622026-10-19T18:28:30.762ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2632026-10-19T18:28:31.144ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 6095789274615176864 n_samples = 6 unit = oximeter
2642026-10-19T18:28:31.588ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2652026-10-19T18:28:31.593ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
2662026-10-19T18:28:31.595ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2672026-10-19T18:28:32.146ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2682026-10-19T18:28:32.150ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
2692026-10-19T18:28:32.152ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2702026-10-19T18:28:32.549ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
2712026-10-19T18:28:32.550ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 3 delay = 61.425225133s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
2722026-10-19T18:28:32.570ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 2190118730663490815 n_samples = 6 unit = oximeter
2732026-10-19T18:28:32.730ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2742026-10-19T18:28:32.735ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
2752026-10-19T18:28:32.737ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2762026-10-19T18:28:34.153ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2772026-10-19T18:28:34.157ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
2782026-10-19T18:28:34.160ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2792026-10-19T18:28:34.750ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2802026-10-19T18:28:34.755ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
2812026-10-19T18:28:34.757ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2822026-10-19T18:28:35.382ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2832026-10-19T18:28:35.382ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("13ca8606-1064-4ca1-be25-18d3910f3853.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("188d2584-0d27-48c1-9796-d7695fe9d394.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("f5e40381-d131-4b1e-b1df-44e5bef474ac.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("f5e40381-d131-4b1e-b1df-44e5bef474ac.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::c)) }], valid_until: Instant { tv_sec: 655, tv_nsec: 265196320 } }) unit = producer-server
2842026-10-19T18:28:35.383ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
2852026-10-19T18:28:35.391ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
2862026-10-19T18:28:35.393ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
2872026-10-19T18:28:35.396ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2882026-10-19T18:28:36.885ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2892026-10-19T18:28:36.889ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
2902026-10-19T18:28:36.891ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2912026-10-19T18:28:37.466ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2922026-10-19T18:28:37.471ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
2932026-10-19T18:28:37.473ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2942026-10-19T18:28:38.325ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2952026-10-19T18:28:38.329ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
2962026-10-19T18:28:38.332ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2972026-10-19T18:28:39.631ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2982026-10-19T18:28:39.635ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
2992026-10-19T18:28:39.638ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3002026-10-19T18:28:40.973ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3012026-10-19T18:28:40.976ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
3022026-10-19T18:28:40.979ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3032026-10-19T18:28:41.118ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 6095789274615176864 n_samples = 6 unit = oximeter
3042026-10-19T18:28:42.450ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3052026-10-19T18:28:42.455ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
3062026-10-19T18:28:42.458ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3072026-10-19T18:28:42.544ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 2190118730663490815 n_samples = 6 unit = oximeter
3082026-10-19T18:28:43.703ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3092026-10-19T18:28:43.707ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
3102026-10-19T18:28:43.710ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3112026-10-19T18:28:44.598ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3122026-10-19T18:28:44.603ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
3132026-10-19T18:28:44.605ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3142026-10-19T18:28:46.071ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3152026-10-19T18:28:46.074ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
3162026-10-19T18:28:46.077ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3172026-10-19T18:28:47.501ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3182026-10-19T18:28:47.506ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
3192026-10-19T18:28:47.508ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3202026-10-19T18:28:48.049ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3212026-10-19T18:28:48.053ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
3222026-10-19T18:28:48.056ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3232026-10-19T18:28:49.193ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3242026-10-19T18:28:49.198ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
3252026-10-19T18:28:49.200ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3262026-10-19T18:28:49.751ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3272026-10-19T18:28:49.756ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
3282026-10-19T18:28:49.758ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3292026-10-19T18:28:50.351ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
3302026-10-19T18:28:50.353ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 4 delay = 79.276050817s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
3312026-10-19T18:28:50.876ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3322026-10-19T18:28:50.880ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
3332026-10-19T18:28:50.883ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3342026-10-19T18:28:51.093ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 6095789274615176864 n_samples = 6 unit = oximeter
3352026-10-19T18:28:52.043ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3362026-10-19T18:28:52.046ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
3372026-10-19T18:28:52.048ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3382026-10-19T18:28:52.520ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 2190118730663490815 n_samples = 6 unit = oximeter
3392026-10-19T18:28:53.092ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3402026-10-19T18:28:53.097ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
3412026-10-19T18:28:53.099ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3422026-10-19T18:28:53.647ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3432026-10-19T18:28:53.651ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
3442026-10-19T18:28:53.654ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3452026-10-19T18:28:54.723ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3462026-10-19T18:28:54.727ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
3472026-10-19T18:28:54.729ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3482026-10-19T18:28:55.446ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3492026-10-19T18:28:55.451ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
3502026-10-19T18:28:55.453ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3512026-10-19T18:28:55.555ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("13ca8606-1064-4ca1-be25-18d3910f3853.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("188d2584-0d27-48c1-9796-d7695fe9d394.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("f5e40381-d131-4b1e-b1df-44e5bef474ac.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("f5e40381-d131-4b1e-b1df-44e5bef474ac.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::c)) }], valid_until: Instant { tv_sec: 675, tv_nsec: 492916839 } }) unit = producer-server
3522026-10-19T18:28:55.556ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
3532026-10-19T18:28:55.563ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
3542026-10-19T18:28:56.296ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3552026-10-19T18:28:56.301ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
3562026-10-19T18:28:56.303ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3572026-10-19T18:28:57.524ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3582026-10-19T18:28:57.528ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
3592026-10-19T18:28:57.531ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3602026-10-19T18:28:58.901ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3612026-10-19T18:28:58.906ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
3622026-10-19T18:28:58.908ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3632026-10-19T18:29:00.037ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3642026-10-19T18:29:00.041ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
3652026-10-19T18:29:00.044ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3662026-10-19T18:29:00.562ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3672026-10-19T18:29:00.566ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
3682026-10-19T18:29:00.568ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3692026-10-19T18:29:01.068ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 6095789274615176864 n_samples = 6 unit = oximeter
3702026-10-19T18:29:02.071ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3712026-10-19T18:29:02.075ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
3722026-10-19T18:29:02.077ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3732026-10-19T18:29:02.494ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 2190118730663490815 n_samples = 6 unit = oximeter
3742026-10-19T18:29:02.738ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3752026-10-19T18:29:02.741ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
3762026-10-19T18:29:02.743ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3772026-10-19T18:29:03.403ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3782026-10-19T18:29:03.408ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
3792026-10-19T18:29:03.410ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3802026-10-19T18:29:04.359ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3812026-10-19T18:29:04.364ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
3822026-10-19T18:29:04.367ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3832026-10-19T18:29:05.681ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3842026-10-19T18:29:05.685ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
3852026-10-19T18:29:05.688ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3862026-10-19T18:29:06.935ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3872026-10-19T18:29:06.939ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
3882026-10-19T18:29:06.941ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3892026-10-19T18:29:07.787ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3902026-10-19T18:29:07.792ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
3912026-10-19T18:29:07.794ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3922026-10-19T18:29:08.682ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3932026-10-19T18:29:08.686ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
3942026-10-19T18:29:08.689ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3952026-10-19T18:29:09.959ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3962026-10-19T18:29:09.963ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
3972026-10-19T18:29:09.966ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3982026-10-19T18:29:10.525ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
3992026-10-19T18:29:10.526ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 5 delay = 99.503214426s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
4002026-10-19T18:29:11.043ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 6095789274615176864 n_samples = 6 unit = oximeter
4012026-10-19T18:29:11.111ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4022026-10-19T18:29:11.116ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
4032026-10-19T18:29:11.118ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4042026-10-19T18:29:12.470ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 2190118730663490815 n_samples = 6 unit = oximeter
4052026-10-19T18:29:12.479ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4062026-10-19T18:29:12.484ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
4072026-10-19T18:29:12.487ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4082026-10-19T18:29:13.001ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4092026-10-19T18:29:13.008ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
4102026-10-19T18:29:13.012ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4112026-10-19T18:29:14.006ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4122026-10-19T18:29:14.011ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
4132026-10-19T18:29:14.014ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4142026-10-19T18:29:15.387ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4152026-10-19T18:29:15.393ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
4162026-10-19T18:29:15.397ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4172026-10-19T18:29:16.802ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("13ca8606-1064-4ca1-be25-18d3910f3853.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("188d2584-0d27-48c1-9796-d7695fe9d394.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("f5e40381-d131-4b1e-b1df-44e5bef474ac.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("f5e40381-d131-4b1e-b1df-44e5bef474ac.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::c)) }], valid_until: Instant { tv_sec: 696, tv_nsec: 797315284 } }) unit = producer-server
4182026-10-19T18:29:16.803ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
4192026-10-19T18:29:16.813ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
4202026-10-19T18:29:16.865ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4212026-10-19T18:29:16.870ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
4222026-10-19T18:29:16.873ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4232026-10-19T18:29:17.492ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4242026-10-19T18:29:17.497ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
4252026-10-19T18:29:17.500ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4262026-10-19T18:29:18.711ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4272026-10-19T18:29:18.716ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
4282026-10-19T18:29:18.719ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4292026-10-19T18:29:19.914ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4302026-10-19T18:29:19.919ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
4312026-10-19T18:29:19.921ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4322026-10-19T18:29:20.726ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4332026-10-19T18:29:20.731ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
4342026-10-19T18:29:20.734ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4352026-10-19T18:29:21.024ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 6095789274615176864 n_samples = 6 unit = oximeter
4362026-10-19T18:29:21.324ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4372026-10-19T18:29:21.328ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
4382026-10-19T18:29:21.331ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4392026-10-19T18:29:22.162ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4402026-10-19T18:29:22.166ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
4412026-10-19T18:29:22.169ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4422026-10-19T18:29:22.456ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 2190118730663490815 n_samples = 6 unit = oximeter
4432026-10-19T18:29:22.924ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4442026-10-19T18:29:22.929ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
4452026-10-19T18:29:22.932ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4462026-10-19T18:29:24.245ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4472026-10-19T18:29:24.249ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
4482026-10-19T18:29:24.253ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4492026-10-19T18:29:25.641ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4502026-10-19T18:29:25.645ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
4512026-10-19T18:29:25.648ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4522026-10-19T18:29:26.248ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4532026-10-19T18:29:26.252ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
4542026-10-19T18:29:26.255ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4552026-10-19T18:29:27.098ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4562026-10-19T18:29:27.103ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
4572026-10-19T18:29:27.106ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4582026-10-19T18:29:28.338ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4592026-10-19T18:29:28.343ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
4602026-10-19T18:29:28.346ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4612026-10-19T18:29:29.775ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4622026-10-19T18:29:29.781ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
4632026-10-19T18:29:29.784ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4642026-10-19T18:29:30.346ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4652026-10-19T18:29:30.361ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
4662026-10-19T18:29:30.367ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4672026-10-19T18:29:30.881ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4682026-10-19T18:29:30.887ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
4692026-10-19T18:29:30.892ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4702026-10-19T18:29:31.027ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 6095789274615176864 n_samples = 6 unit = oximeter
4712026-10-19T18:29:31.873ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
4722026-10-19T18:29:31.873ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 6 delay = 120.871827551s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
4732026-10-19T18:29:31.953ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4742026-10-19T18:29:31.961ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
4752026-10-19T18:29:31.964ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4762026-10-19T18:29:32.458ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 2190118730663490815 n_samples = 6 unit = oximeter
4772026-10-19T18:29:32.824ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4782026-10-19T18:29:32.829ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
4792026-10-19T18:29:32.833ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4802026-10-19T18:29:33.862ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4812026-10-19T18:29:33.868ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
4822026-10-19T18:29:33.871ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4832026-10-19T18:29:34.867ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4842026-10-19T18:29:34.871ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
4852026-10-19T18:29:34.874ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4862026-10-19T18:29:36.015ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4872026-10-19T18:29:36.019ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
4882026-10-19T18:29:36.022ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4892026-10-19T18:29:36.769ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4902026-10-19T18:29:36.773ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
4912026-10-19T18:29:36.777ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4922026-10-19T18:29:37.767ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4932026-10-19T18:29:37.771ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
4942026-10-19T18:29:37.773ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4952026-10-19T18:29:38.442ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4962026-10-19T18:29:38.446ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
4972026-10-19T18:29:38.450ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4982026-10-19T18:29:39.190ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4992026-10-19T18:29:39.194ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
5002026-10-19T18:29:39.197ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5012026-10-19T18:29:39.912ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5022026-10-19T18:29:39.917ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
5032026-10-19T18:29:39.920ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5042026-10-19T18:29:41.030ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 6095789274615176864 n_samples = 6 unit = oximeter
5052026-10-19T18:29:41.356ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5062026-10-19T18:29:41.361ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
5072026-10-19T18:29:41.364ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5082026-10-19T18:29:42.097ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5092026-10-19T18:29:42.102ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
5102026-10-19T18:29:42.104ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5112026-10-19T18:29:42.460ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 2190118730663490815 n_samples = 6 unit = oximeter
5122026-10-19T18:29:42.622ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5132026-10-19T18:29:42.626ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
5142026-10-19T18:29:42.629ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5152026-10-19T18:29:43.410ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5162026-10-19T18:29:43.415ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
5172026-10-19T18:29:43.418ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5182026-10-19T18:29:43.728ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("13ca8606-1064-4ca1-be25-18d3910f3853.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("188d2584-0d27-48c1-9796-d7695fe9d394.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("f5e40381-d131-4b1e-b1df-44e5bef474ac.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("f5e40381-d131-4b1e-b1df-44e5bef474ac.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::c)) }], valid_until: Instant { tv_sec: 723, tv_nsec: 727098866 } }) unit = producer-server
5192026-10-19T18:29:43.729ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
5202026-10-19T18:29:43.736ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
5212026-10-19T18:29:44.085ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5222026-10-19T18:29:44.089ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
5232026-10-19T18:29:44.092ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5242026-10-19T18:29:45.451ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5252026-10-19T18:29:45.457ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
5262026-10-19T18:29:45.460ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5272026-10-19T18:29:46.133ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5282026-10-19T18:29:46.138ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
5292026-10-19T18:29:46.140ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5302026-10-19T18:29:47.428ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5312026-10-19T18:29:47.433ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
5322026-10-19T18:29:47.436ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5332026-10-19T18:29:48.303ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5342026-10-19T18:29:48.307ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
5352026-10-19T18:29:48.310ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5362026-10-19T18:29:49.378ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5372026-10-19T18:29:49.383ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
5382026-10-19T18:29:49.386ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5392026-10-19T18:29:50.065ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5402026-10-19T18:29:50.070ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
5412026-10-19T18:29:50.073ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5422026-10-19T18:29:51.032ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 6095789274615176864 n_samples = 6 unit = oximeter
5432026-10-19T18:29:51.220ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5442026-10-19T18:29:51.226ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
5452026-10-19T18:29:51.233ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5462026-10-19T18:29:52.462ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 2190118730663490815 n_samples = 6 unit = oximeter
5472026-10-19T18:29:52.727ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5482026-10-19T18:29:52.731ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
5492026-10-19T18:29:52.733ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5502026-10-19T18:29:54.000ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5512026-10-19T18:29:54.004ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
5522026-10-19T18:29:54.007ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5532026-10-19T18:29:55.498ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5542026-10-19T18:29:55.502ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
5552026-10-19T18:29:55.504ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5562026-10-19T18:29:56.046ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5572026-10-19T18:29:56.050ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
5582026-10-19T18:29:56.053ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5592026-10-19T18:29:57.439ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5602026-10-19T18:29:57.443ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
5612026-10-19T18:29:57.446ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5622026-10-19T18:29:58.737ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
5632026-10-19T18:29:58.738ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 7 delay = 147.73625448s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
5642026-10-19T18:29:58.860ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5652026-10-19T18:29:58.866ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
5662026-10-19T18:29:58.869ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5672026-10-19T18:30:00.279ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5682026-10-19T18:30:00.283ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::eca1:a6ff:fe88:5a14]
5692026-10-19T18:30:00.286ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5702026-10-19T18:30:01.035ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 6095789274615176864 n_samples = 6 unit = oximeter