Max level shown:
1 [ Nov 2 21:42:12 Enabled. ]
2 [ Nov 2 21:42:12 Rereading configuration. ]
3 [ Nov 2 21:42:13 Rereading configuration. ]
4 [ Nov 2 21:42:34 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dendrite/bin/tfportd --sync-only &"). ]
5 [ Nov 2 21:42:34 Method "start" exited with status 0. ]
6 No non-localhost IPv6 addresses found in SMF properties
72026-11-02T21:42:34.654ZINFOtfportd: connecting to dpd host = [::1] port = 12224
82026-11-02T21:42:34.656ZINFOtfportd: connected to dpd running softnpu-a133c73e
92026-11-02T21:42:34.656ZINFOtfportd: running in sync-only mode
102026-11-02T21:42:34.656ZINFOtfportd: no non-localhost IPv6 listen address available, waiting for SMF update unit = oximeter
112026-11-02T21:42:34.657ZINFOtfportd: refreshing SMF config prior to waiting on signals unit = signal_handler
12 No non-localhost IPv6 addresses found in SMF properties
132026-11-02T21:42:34.658ZINFOtfportd: refreshed config: Config { log_file: None, log_format: Json, listen_addresses: [ [::1]:12231, ], pkt_source: None, dpd_host: "[::1]", dpd_port: 12224, vlan_link: None, vlan_data: None, techport0_prefix: None, techport1_prefix: None, rack_id: Some( f1375803-46dd-4365-8be9-b6336737bac4, ), sled_id: Some( 189c735a-65e0-42f5-93e4-82afc1a03475, ), sled_model: Some( "i86pc", ), sled_revision: Some( 0, ), sled_serial: Some( "buskin", ), }
142026-11-02T21:42:34.658ZINFOtfportd: no non-localhost IPv6 listen address available, waiting for SMF update unit = oximeter
152026-11-02T21:42:34.665ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::ec70:c9ff:fe21:6d34->ee:70:c9:21:6d:34 interface = tfportrear0_0
162026-11-02T21:42:34.667ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
172026-11-02T21:42:34.671ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
182026-11-02T21:42:34.677ZWARNtfportd: tfportqsfp0_0 has no addrs
192026-11-02T21:42:35.387ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::e098:65ff:fe4e:437b->e2:98:65:4e:43:7b interface = tfportrear0_0
202026-11-02T21:42:35.433ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
212026-11-02T21:42:35.438ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
222026-11-02T21:42:35.440ZWARNtfportd: tfportqsfp0_0 has no addrs
23 [ Nov 2 21:42:36 Rereading configuration. ]
24 [ Nov 2 21:42:36 Executing refresh method (:kill). ]
25 [ Nov 2 21:42:36 Stopping because all processes in service exited. ]
26 [ Nov 2 21:42:36 Executing stop method (:kill). ]
27 [ Nov 2 21:42:36 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dendrite/bin/tfportd --sync-only &"). ]
28 [ Nov 2 21:42:36 Method "start" exited with status 0. ]
292026-11-02T21:42:36.295ZINFOtfportd: connecting to dpd host = [::1] port = 12224
302026-11-02T21:42:36.297ZINFOtfportd: connected to dpd running softnpu-a133c73e
312026-11-02T21:42:36.297ZINFOtfportd: running in sync-only mode
322026-11-02T21:42:36.297ZINFOtfportd: found suitable IPv6 address for oximeter producer server address = fd00:1122:3344:101::2 unit = oximeter
332026-11-02T21:42:36.297ZINFOtfportd: refreshing SMF config prior to waiting on signals unit = signal_handler
342026-11-02T21:42:36.297ZDEBGtfportd: extracted oximeter configuration data config = OximeterConfig { listen_address: fd00:1122:3344:101::2, sled_identifiers: SledIdentifiers { rack_id: f1375803-46dd-4365-8be9-b6336737bac4, sled_id: 189c735a-65e0-42f5-93e4-82afc1a03475, model: "i86pc", revision: 0, serial: "buskin" }, switch_identifiers: SwitchIdentifiers { asic_backend: "softnpu", fab: None, fuse: Some(FuseData { chip_rev: ChipRevision { device_id: 272, rev: "B1", rev_num: 2 }, disabled: DisabledFeatures { bsync: false, mau: [0, 0, 0, 0], pgen: false, pipes: 0, ports: 0, resub: false, speeds: 0, tm_mem: 0 }, frequency: FrequencySettings { bps: 3, bps_ext: 0, cpu_speed_dis: 0, disabled: false, pcie_dis: 0, pps: 3, pps_ext: 0 }, manufacturing: ManufacturingData { core_repair: false, die_rotation: false, pmro_and_skew: 0, silent_spin: 0, soft_pipe_dis: 0, tile_repair: false, voltage_scaling: 0, wf_core_repair: false }, part: PartInfo { part_num: 4660, pkg_id: 1, version: 2 } }), lot: None, lotnum: None, model: "FAKE_SIM_SIDECAR", revision: 0, serial: "SimSidecar0", sidecar_id: b1daf2d7-8f22-4e89-8a5d-022fd3662b89, slot: 0, wafer: None, wafer_loc: None } } unit = oximeter
352026-11-02T21:42:36.297ZDEBGtfportd: created producer ID producer_id = 5871d98e-ac1f-4f19-9250-36b375f1a539 unit = oximeter
362026-11-02T21:42:36.298ZINFOtfportd: refreshed config: Config { log_file: None, log_format: Json, listen_addresses: [ [fd00:1122:3344:101::2]:12231, [::1]:12231, ], pkt_source: None, dpd_host: "[::1]", dpd_port: 12224, vlan_link: None, vlan_data: None, techport0_prefix: None, techport1_prefix: None, rack_id: Some( f1375803-46dd-4365-8be9-b6336737bac4, ), sled_id: Some( 189c735a-65e0-42f5-93e4-82afc1a03475, ), sled_model: Some( "i86pc", ), sled_revision: Some( 0, ), sled_serial: Some( "buskin", ), }
372026-11-02T21:42:36.306ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
382026-11-02T21:42:36.308ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::e098:65ff:fe4e:437b->e2:98:65:4e:43:7b interface = tfportrear0_0
392026-11-02T21:42:36.308ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::ec70:c9ff:fe21:6d34->ee:70:c9:21:6d:34 interface = tfportrear0_0
402026-11-02T21:42:36.309ZDEBGtfportd: registered DTrace probes unit = producer-server
412026-11-02T21:42:36.310ZDEBGtfportd (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::2]:53308 method = GET path = /{producer_id} unit = producer-server versions = all
422026-11-02T21:42:36.310ZINFOtfportd (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:328 local_addr = [fd00:1122:3344:101::2]:53308 unit = producer-server
432026-11-02T21:42:36.310ZDEBGtfportd (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::2]:53308 unit = producer-server
442026-11-02T21:42:36.310ZDEBGtfportd: Requested any available port, Dropshot server has been bound to [fd00:1122:3344:101::2]:53308 unit = producer-server
452026-11-02T21:42:36.310ZDEBGtfportd: Nexus IP not provided, will use DNS to resolve it unit = producer-server
462026-11-02T21:42:36.310ZINFOtfportd (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/internal-dns/resolver/src/resolver.rs:144 unit = producer-server
472026-11-02T21:42:36.310ZDEBGtfportd: starting producer registration task unit = producer-server
482026-11-02T21:42:36.310ZINFOtfportd: starting oximeter metric producer server address = [fd00:1122:3344:101::2]:53308 file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:279 interval = 30s producer_id = 5871d98e-ac1f-4f19-9250-36b375f1a539 unit = producer-server
492026-11-02T21:42:36.311ZINFOtfportd: created oximeter producer server unit = oximeter
502026-11-02T21:42:36.311ZDEBGtfportd (producer-registration-task): registering as oximeter producer with Nexus registration_count = 0 unit = producer-server
512026-11-02T21:42:36.311ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
522026-11-02T21:42:36.311ZDEBGtfportd (kstat-sampler): adding new target unit = oximeter
532026-11-02T21:42:36.312ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("3ae35a6a-b310-416f-b735-4f087b80e800.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("b17b2679-c7fc-4490-b2fe-592c6f059f70.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("dc0fb49a-3bb6-42d6-b689-767d009317bf.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dc0fb49a-3bb6-42d6-b689-767d009317bf.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::c)) }], valid_until: Instant { tv_sec: 571, tv_nsec: 964252320 } }) unit = producer-server
542026-11-02T21:42:36.312ZDEBGtfportd (kstat-sampler-worker): storing new creation time for tracked target creation_time = 2026-11-02T21:42:08.358235178Z path = KstatPath { module: "link", instance: 0, name: "tfportrear0_0" } unit = oximeter
552026-11-02T21:42:36.313ZDEBGtfportd (kstat-sampler-worker): inserted empty per-target sample queue id = 2837261487600872993 unit = oximeter
562026-11-02T21:42:36.313ZDEBGtfportd: added new link to kstat sampler link_kind = switch-port-control link_name = tfportrear0_0 unit = metrics-task-tracker
572026-11-02T21:42:36.313ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
582026-11-02T21:42:36.314ZWARNtfportd: tfportqsfp0_0 has no addrs
592026-11-02T21:42:36.328ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
602026-11-02T21:42:37.364ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
612026-11-02T21:42:37.370ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
622026-11-02T21:42:37.373ZWARNtfportd: tfportqsfp0_0 has no addrs
632026-11-02T21:42:38.750ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
642026-11-02T21:42:38.754ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
652026-11-02T21:42:38.756ZWARNtfportd: tfportqsfp0_0 has no addrs
662026-11-02T21:42:39.710ZINFOtfportd: added new ARP entry entry = 10.151.1.174->46:b0:65:a8:2c:b1 interface = tfportqsfp0_0
672026-11-02T21:42:39.915ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
682026-11-02T21:42:39.920ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
692026-11-02T21:42:39.923ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
702026-11-02T21:42:39.923ZDEBGtfportd (kstat-sampler): adding new target unit = oximeter
712026-11-02T21:42:39.924ZDEBGtfportd (kstat-sampler-worker): storing new creation time for tracked target creation_time = 2026-11-02T21:42:08.358102394Z path = KstatPath { module: "link", instance: 0, name: "tfportqsfp0_0" } unit = oximeter
722026-11-02T21:42:39.924ZDEBGtfportd (kstat-sampler-worker): inserted empty per-target sample queue id = 16292103337539779003 unit = oximeter
732026-11-02T21:42:39.924ZDEBGtfportd: added new link to kstat sampler link_kind = switch-port-control link_name = tfportqsfp0_0 unit = metrics-task-tracker
742026-11-02T21:42:40.578ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
752026-11-02T21:42:40.583ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
762026-11-02T21:42:40.586ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
772026-11-02T21:42:41.253ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
782026-11-02T21:42:41.257ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
792026-11-02T21:42:41.260ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
802026-11-02T21:42:42.412ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
812026-11-02T21:42:42.417ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
822026-11-02T21:42:42.420ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
832026-11-02T21:42:43.276ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
842026-11-02T21:42:43.281ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
852026-11-02T21:42:43.284ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
862026-11-02T21:42:44.702ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
872026-11-02T21:42:44.710ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
882026-11-02T21:42:44.712ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
892026-11-02T21:42:45.382ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
902026-11-02T21:42:45.386ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
912026-11-02T21:42:45.389ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
922026-11-02T21:42:46.316ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 2837261487600872993 n_samples = 6 unit = oximeter
932026-11-02T21:42:46.593ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
942026-11-02T21:42:46.597ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
952026-11-02T21:42:46.600ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
962026-11-02T21:42:47.341ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
972026-11-02T21:42:47.345ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
982026-11-02T21:42:47.348ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
992026-11-02T21:42:47.953ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1002026-11-02T21:42:47.958ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
1012026-11-02T21:42:47.960ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1022026-11-02T21:42:48.416ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1032026-11-02T21:42:48.421ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
1042026-11-02T21:42:48.424ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1052026-11-02T21:42:49.457ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1062026-11-02T21:42:49.461ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
1072026-11-02T21:42:49.463ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1082026-11-02T21:42:49.533ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 16292103337539779003 n_samples = 6 unit = oximeter
1092026-11-02T21:42:50.363ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1102026-11-02T21:42:50.367ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
1112026-11-02T21:42:50.370ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1122026-11-02T21:42:50.932ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
1132026-11-02T21:42:50.933ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 0 delay = 15.020259426s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
1142026-11-02T21:42:51.047ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1152026-11-02T21:42:51.051ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
1162026-11-02T21:42:51.053ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1172026-11-02T21:42:51.106ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("3ae35a6a-b310-416f-b735-4f087b80e800.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("b17b2679-c7fc-4490-b2fe-592c6f059f70.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("dc0fb49a-3bb6-42d6-b689-767d009317bf.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dc0fb49a-3bb6-42d6-b689-767d009317bf.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::c)) }], valid_until: Instant { tv_sec: 587, tv_nsec: 156146410 } }) unit = producer-server
1182026-11-02T21:42:51.106ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
1192026-11-02T21:42:51.112ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
1202026-11-02T21:42:52.200ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1212026-11-02T21:42:52.204ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
1222026-11-02T21:42:52.207ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1232026-11-02T21:42:53.301ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1242026-11-02T21:42:53.305ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
1252026-11-02T21:42:53.307ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1262026-11-02T21:42:53.916ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1272026-11-02T21:42:53.920ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
1282026-11-02T21:42:53.922ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1292026-11-02T21:42:54.766ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1302026-11-02T21:42:54.770ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
1312026-11-02T21:42:54.772ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1322026-11-02T21:42:55.830ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1332026-11-02T21:42:55.834ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
1342026-11-02T21:42:55.837ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1352026-11-02T21:42:55.907ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 2837261487600872993 n_samples = 6 unit = oximeter
1362026-11-02T21:42:56.679ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1372026-11-02T21:42:56.684ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
1382026-11-02T21:42:56.686ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1392026-11-02T21:42:57.722ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1402026-11-02T21:42:57.726ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
1412026-11-02T21:42:57.729ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1422026-11-02T21:42:59.086ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1432026-11-02T21:42:59.090ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
1442026-11-02T21:42:59.093ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1452026-11-02T21:42:59.509ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 16292103337539779003 n_samples = 6 unit = oximeter
1462026-11-02T21:43:00.405ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1472026-11-02T21:43:00.410ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
1482026-11-02T21:43:00.413ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1492026-11-02T21:43:01.565ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1502026-11-02T21:43:01.570ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
1512026-11-02T21:43:01.573ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1522026-11-02T21:43:02.239ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1532026-11-02T21:43:02.243ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
1542026-11-02T21:43:02.246ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1552026-11-02T21:43:03.500ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1562026-11-02T21:43:03.504ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
1572026-11-02T21:43:03.507ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1582026-11-02T21:43:04.505ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1592026-11-02T21:43:04.509ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
1602026-11-02T21:43:04.512ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1612026-11-02T21:43:05.591ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1622026-11-02T21:43:05.595ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
1632026-11-02T21:43:05.598ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1642026-11-02T21:43:05.882ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 2837261487600872993 n_samples = 6 unit = oximeter
1652026-11-02T21:43:06.072ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
1662026-11-02T21:43:06.073ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 1 delay = 30.201007814s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
1672026-11-02T21:43:06.380ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1682026-11-02T21:43:06.384ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
1692026-11-02T21:43:06.387ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1702026-11-02T21:43:06.444ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("3ae35a6a-b310-416f-b735-4f087b80e800.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("b17b2679-c7fc-4490-b2fe-592c6f059f70.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("dc0fb49a-3bb6-42d6-b689-767d009317bf.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dc0fb49a-3bb6-42d6-b689-767d009317bf.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::c)) }], valid_until: Instant { tv_sec: 602, tv_nsec: 535888074 } }) unit = producer-server
1712026-11-02T21:43:06.444ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
1722026-11-02T21:43:06.451ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
1732026-11-02T21:43:07.566ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1742026-11-02T21:43:07.570ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
1752026-11-02T21:43:07.573ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1762026-11-02T21:43:08.830ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1772026-11-02T21:43:08.835ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
1782026-11-02T21:43:08.837ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1792026-11-02T21:43:09.483ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 16292103337539779003 n_samples = 6 unit = oximeter
1802026-11-02T21:43:10.072ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1812026-11-02T21:43:10.076ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
1822026-11-02T21:43:10.079ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1832026-11-02T21:43:11.180ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1842026-11-02T21:43:11.185ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
1852026-11-02T21:43:11.187ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1862026-11-02T21:43:12.279ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1872026-11-02T21:43:12.284ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
1882026-11-02T21:43:12.287ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1892026-11-02T21:43:13.341ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1902026-11-02T21:43:13.346ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
1912026-11-02T21:43:13.349ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1922026-11-02T21:43:14.135ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1932026-11-02T21:43:14.139ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
1942026-11-02T21:43:14.141ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1952026-11-02T21:43:15.579ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1962026-11-02T21:43:15.583ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
1972026-11-02T21:43:15.585ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1982026-11-02T21:43:15.857ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 2837261487600872993 n_samples = 6 unit = oximeter
1992026-11-02T21:43:16.859ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2002026-11-02T21:43:16.864ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
2012026-11-02T21:43:16.866ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2022026-11-02T21:43:18.316ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2032026-11-02T21:43:18.319ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
2042026-11-02T21:43:18.322ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2052026-11-02T21:43:19.184ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2062026-11-02T21:43:19.188ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
2072026-11-02T21:43:19.190ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2082026-11-02T21:43:19.459ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 16292103337539779003 n_samples = 6 unit = oximeter
2092026-11-02T21:43:20.342ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2102026-11-02T21:43:20.346ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
2112026-11-02T21:43:20.349ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2122026-11-02T21:43:21.233ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2132026-11-02T21:43:21.238ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
2142026-11-02T21:43:21.240ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2152026-11-02T21:43:21.411ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
2162026-11-02T21:43:21.412ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 2 delay = 45.581927262s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
2172026-11-02T21:43:21.847ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2182026-11-02T21:43:21.852ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
2192026-11-02T21:43:21.854ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2202026-11-02T21:43:22.319ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("3ae35a6a-b310-416f-b735-4f087b80e800.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("b17b2679-c7fc-4490-b2fe-592c6f059f70.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("dc0fb49a-3bb6-42d6-b689-767d009317bf.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dc0fb49a-3bb6-42d6-b689-767d009317bf.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::c)) }], valid_until: Instant { tv_sec: 618, tv_nsec: 454451768 } }) unit = producer-server
2212026-11-02T21:43:22.320ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
2222026-11-02T21:43:22.326ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
2232026-11-02T21:43:22.482ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2242026-11-02T21:43:22.486ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
2252026-11-02T21:43:22.489ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2262026-11-02T21:43:23.145ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2272026-11-02T21:43:23.149ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
2282026-11-02T21:43:23.152ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2292026-11-02T21:43:23.853ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2302026-11-02T21:43:23.857ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
2312026-11-02T21:43:23.859ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2322026-11-02T21:43:25.010ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2332026-11-02T21:43:25.014ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
2342026-11-02T21:43:25.016ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2352026-11-02T21:43:25.832ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 2837261487600872993 n_samples = 6 unit = oximeter
2362026-11-02T21:43:25.981ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2372026-11-02T21:43:25.985ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
2382026-11-02T21:43:25.988ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2392026-11-02T21:43:26.551ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2402026-11-02T21:43:26.556ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
2412026-11-02T21:43:26.558ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2422026-11-02T21:43:27.619ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2432026-11-02T21:43:27.624ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
2442026-11-02T21:43:27.627ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2452026-11-02T21:43:28.517ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2462026-11-02T21:43:28.521ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
2472026-11-02T21:43:28.524ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2482026-11-02T21:43:29.434ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 16292103337539779003 n_samples = 6 unit = oximeter
2492026-11-02T21:43:29.447ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2502026-11-02T21:43:29.451ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
2512026-11-02T21:43:29.453ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2522026-11-02T21:43:30.636ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2532026-11-02T21:43:30.640ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
2542026-11-02T21:43:30.643ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2552026-11-02T21:43:31.624ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2562026-11-02T21:43:31.628ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
2572026-11-02T21:43:31.631ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2582026-11-02T21:43:33.133ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2592026-11-02T21:43:33.137ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
2602026-11-02T21:43:33.140ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2612026-11-02T21:43:34.343ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2622026-11-02T21:43:34.348ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
2632026-11-02T21:43:34.350ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2642026-11-02T21:43:34.956ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2652026-11-02T21:43:34.959ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
2662026-11-02T21:43:34.962ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2672026-11-02T21:43:35.807ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 2837261487600872993 n_samples = 6 unit = oximeter
2682026-11-02T21:43:36.254ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2692026-11-02T21:43:36.258ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
2702026-11-02T21:43:36.261ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2712026-11-02T21:43:37.245ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2722026-11-02T21:43:37.249ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
2732026-11-02T21:43:37.252ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2742026-11-02T21:43:37.288ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
2752026-11-02T21:43:37.289ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 3 delay = 61.50223391s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
2762026-11-02T21:43:38.290ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2772026-11-02T21:43:38.294ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
2782026-11-02T21:43:38.297ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2792026-11-02T21:43:39.409ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 16292103337539779003 n_samples = 6 unit = oximeter
2802026-11-02T21:43:39.749ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2812026-11-02T21:43:39.753ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
2822026-11-02T21:43:39.756ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2832026-11-02T21:43:40.120ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("3ae35a6a-b310-416f-b735-4f087b80e800.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("b17b2679-c7fc-4490-b2fe-592c6f059f70.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("dc0fb49a-3bb6-42d6-b689-767d009317bf.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dc0fb49a-3bb6-42d6-b689-767d009317bf.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::c)) }], valid_until: Instant { tv_sec: 636, tv_nsec: 303230173 } }) unit = producer-server
2842026-11-02T21:43:40.120ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
2852026-11-02T21:43:40.126ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
2862026-11-02T21:43:40.764ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2872026-11-02T21:43:40.768ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
2882026-11-02T21:43:40.770ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2892026-11-02T21:43:41.806ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2902026-11-02T21:43:41.810ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
2912026-11-02T21:43:41.813ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2922026-11-02T21:43:42.756ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2932026-11-02T21:43:42.759ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
2942026-11-02T21:43:42.762ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2952026-11-02T21:43:44.072ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2962026-11-02T21:43:44.076ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
2972026-11-02T21:43:44.078ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2982026-11-02T21:43:44.641ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2992026-11-02T21:43:44.646ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
3002026-11-02T21:43:44.649ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3012026-11-02T21:43:45.413ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3022026-11-02T21:43:45.422ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
3032026-11-02T21:43:45.425ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3042026-11-02T21:43:45.782ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 2837261487600872993 n_samples = 6 unit = oximeter
3052026-11-02T21:43:46.756ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3062026-11-02T21:43:46.759ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
3072026-11-02T21:43:46.761ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3082026-11-02T21:43:48.123ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3092026-11-02T21:43:48.128ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
3102026-11-02T21:43:48.130ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3112026-11-02T21:43:49.280ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3122026-11-02T21:43:49.285ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
3132026-11-02T21:43:49.287ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3142026-11-02T21:43:49.384ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 16292103337539779003 n_samples = 6 unit = oximeter
3152026-11-02T21:43:49.918ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3162026-11-02T21:43:49.922ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
3172026-11-02T21:43:49.925ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3182026-11-02T21:43:50.502ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3192026-11-02T21:43:50.506ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
3202026-11-02T21:43:50.509ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3212026-11-02T21:43:51.647ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3222026-11-02T21:43:51.651ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
3232026-11-02T21:43:51.653ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3242026-11-02T21:43:52.290ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3252026-11-02T21:43:52.293ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
3262026-11-02T21:43:52.295ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3272026-11-02T21:43:53.197ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3282026-11-02T21:43:53.202ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
3292026-11-02T21:43:53.205ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3302026-11-02T21:43:54.659ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3312026-11-02T21:43:54.663ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
3322026-11-02T21:43:54.665ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3332026-11-02T21:43:55.086ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
3342026-11-02T21:43:55.087ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 4 delay = 79.348670175s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
3352026-11-02T21:43:55.756ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 2837261487600872993 n_samples = 6 unit = oximeter
3362026-11-02T21:43:55.756ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3372026-11-02T21:43:55.760ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
3382026-11-02T21:43:55.762ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3392026-11-02T21:43:56.592ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3402026-11-02T21:43:56.596ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
3412026-11-02T21:43:56.599ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3422026-11-02T21:43:57.980ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3432026-11-02T21:43:57.984ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
3442026-11-02T21:43:57.987ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3452026-11-02T21:43:58.490ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("3ae35a6a-b310-416f-b735-4f087b80e800.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("b17b2679-c7fc-4490-b2fe-592c6f059f70.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("dc0fb49a-3bb6-42d6-b689-767d009317bf.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dc0fb49a-3bb6-42d6-b689-767d009317bf.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::c)) }], valid_until: Instant { tv_sec: 654, tv_nsec: 723932408 } }) unit = producer-server
3462026-11-02T21:43:58.491ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
3472026-11-02T21:43:58.496ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
3482026-11-02T21:43:58.505ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3492026-11-02T21:43:58.509ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
3502026-11-02T21:43:58.512ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3512026-11-02T21:43:59.358ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 16292103337539779003 n_samples = 6 unit = oximeter
3522026-11-02T21:43:59.527ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3532026-11-02T21:43:59.531ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
3542026-11-02T21:43:59.535ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3552026-11-02T21:44:00.765ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3562026-11-02T21:44:00.769ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
3572026-11-02T21:44:00.771ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3582026-11-02T21:44:01.501ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3592026-11-02T21:44:01.506ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
3602026-11-02T21:44:01.508ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3612026-11-02T21:44:02.380ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3622026-11-02T21:44:02.384ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
3632026-11-02T21:44:02.387ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3642026-11-02T21:44:03.349ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3652026-11-02T21:44:03.353ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
3662026-11-02T21:44:03.356ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3672026-11-02T21:44:04.727ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3682026-11-02T21:44:04.731ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
3692026-11-02T21:44:04.734ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3702026-11-02T21:44:05.730ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 2837261487600872993 n_samples = 6 unit = oximeter
3712026-11-02T21:44:06.215ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3722026-11-02T21:44:06.220ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
3732026-11-02T21:44:06.223ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3742026-11-02T21:44:07.032ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3752026-11-02T21:44:07.037ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
3762026-11-02T21:44:07.039ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3772026-11-02T21:44:07.739ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3782026-11-02T21:44:07.744ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
3792026-11-02T21:44:07.747ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3802026-11-02T21:44:08.808ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3812026-11-02T21:44:08.812ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
3822026-11-02T21:44:08.815ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3832026-11-02T21:44:09.332ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 16292103337539779003 n_samples = 6 unit = oximeter
3842026-11-02T21:44:09.637ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3852026-11-02T21:44:09.642ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
3862026-11-02T21:44:09.645ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3872026-11-02T21:44:10.960ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3882026-11-02T21:44:10.965ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
3892026-11-02T21:44:10.967ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3902026-11-02T21:44:11.922ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3912026-11-02T21:44:11.926ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
3922026-11-02T21:44:11.928ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3932026-11-02T21:44:13.309ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3942026-11-02T21:44:13.313ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
3952026-11-02T21:44:13.315ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3962026-11-02T21:44:13.457ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
3972026-11-02T21:44:13.458ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 5 delay = 97.769076461s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
3982026-11-02T21:44:14.133ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3992026-11-02T21:44:14.137ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
4002026-11-02T21:44:14.140ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4012026-11-02T21:44:15.519ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4022026-11-02T21:44:15.523ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
4032026-11-02T21:44:15.525ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4042026-11-02T21:44:15.704ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 2837261487600872993 n_samples = 6 unit = oximeter
4052026-11-02T21:44:16.144ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4062026-11-02T21:44:16.148ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
4072026-11-02T21:44:16.150ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4082026-11-02T21:44:17.457ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4092026-11-02T21:44:17.461ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
4102026-11-02T21:44:17.464ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4112026-11-02T21:44:18.156ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4122026-11-02T21:44:18.161ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
4132026-11-02T21:44:18.163ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4142026-11-02T21:44:19.308ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 16292103337539779003 n_samples = 6 unit = oximeter
4152026-11-02T21:44:19.551ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4162026-11-02T21:44:19.555ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
4172026-11-02T21:44:19.557ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4182026-11-02T21:44:20.965ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4192026-11-02T21:44:20.969ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
4202026-11-02T21:44:20.971ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4212026-11-02T21:44:21.812ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4222026-11-02T21:44:21.817ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
4232026-11-02T21:44:21.819ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4242026-11-02T21:44:22.683ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4252026-11-02T21:44:22.688ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
4262026-11-02T21:44:22.691ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4272026-11-02T21:44:23.057ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("3ae35a6a-b310-416f-b735-4f087b80e800.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("b17b2679-c7fc-4490-b2fe-592c6f059f70.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("dc0fb49a-3bb6-42d6-b689-767d009317bf.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dc0fb49a-3bb6-42d6-b689-767d009317bf.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::c)) }], valid_until: Instant { tv_sec: 679, tv_nsec: 357687135 } }) unit = producer-server
4282026-11-02T21:44:23.058ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
4292026-11-02T21:44:23.064ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
4302026-11-02T21:44:23.348ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4312026-11-02T21:44:23.352ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
4322026-11-02T21:44:23.355ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4332026-11-02T21:44:24.563ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4342026-11-02T21:44:24.567ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
4352026-11-02T21:44:24.570ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4362026-11-02T21:44:25.371ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4372026-11-02T21:44:25.375ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
4382026-11-02T21:44:25.378ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4392026-11-02T21:44:25.679ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 2837261487600872993 n_samples = 6 unit = oximeter
4402026-11-02T21:44:26.096ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4412026-11-02T21:44:26.100ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
4422026-11-02T21:44:26.104ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4432026-11-02T21:44:27.510ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4442026-11-02T21:44:27.515ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
4452026-11-02T21:44:27.517ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4462026-11-02T21:44:28.850ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4472026-11-02T21:44:28.855ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
4482026-11-02T21:44:28.857ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4492026-11-02T21:44:29.282ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 16292103337539779003 n_samples = 6 unit = oximeter
4502026-11-02T21:44:30.270ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4512026-11-02T21:44:30.277ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
4522026-11-02T21:44:30.281ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4532026-11-02T21:44:31.286ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4542026-11-02T21:44:31.291ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
4552026-11-02T21:44:31.294ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4562026-11-02T21:44:31.958ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4572026-11-02T21:44:31.963ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
4582026-11-02T21:44:31.966ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4592026-11-02T21:44:33.399ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4602026-11-02T21:44:33.403ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
4612026-11-02T21:44:33.406ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4622026-11-02T21:44:34.923ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4632026-11-02T21:44:34.929ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
4642026-11-02T21:44:34.933ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4652026-11-02T21:44:35.669ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 2837261487600872993 n_samples = 6 unit = oximeter
4662026-11-02T21:44:36.263ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4672026-11-02T21:44:36.268ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
4682026-11-02T21:44:36.271ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4692026-11-02T21:44:37.151ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4702026-11-02T21:44:37.155ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
4712026-11-02T21:44:37.158ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4722026-11-02T21:44:38.047ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
4732026-11-02T21:44:38.048ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 6 delay = 122.403489157s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
4742026-11-02T21:44:38.353ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4752026-11-02T21:44:38.361ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
4762026-11-02T21:44:38.365ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4772026-11-02T21:44:39.005ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4782026-11-02T21:44:39.010ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
4792026-11-02T21:44:39.013ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4802026-11-02T21:44:39.282ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 16292103337539779003 n_samples = 6 unit = oximeter
4812026-11-02T21:44:39.761ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4822026-11-02T21:44:39.765ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
4832026-11-02T21:44:39.767ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4842026-11-02T21:44:40.854ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4852026-11-02T21:44:40.859ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
4862026-11-02T21:44:40.862ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4872026-11-02T21:44:41.890ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4882026-11-02T21:44:41.898ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
4892026-11-02T21:44:41.901ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4902026-11-02T21:44:42.549ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4912026-11-02T21:44:42.559ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
4922026-11-02T21:44:42.562ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4932026-11-02T21:44:43.470ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4942026-11-02T21:44:43.474ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
4952026-11-02T21:44:43.477ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4962026-11-02T21:44:44.023ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4972026-11-02T21:44:44.029ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
4982026-11-02T21:44:44.032ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4992026-11-02T21:44:44.771ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5002026-11-02T21:44:44.776ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
5012026-11-02T21:44:44.779ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5022026-11-02T21:44:45.604ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5032026-11-02T21:44:45.609ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
5042026-11-02T21:44:45.612ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5052026-11-02T21:44:45.672ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 2837261487600872993 n_samples = 6 unit = oximeter
5062026-11-02T21:44:47.088ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5072026-11-02T21:44:47.095ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
5082026-11-02T21:44:47.099ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5092026-11-02T21:44:47.658ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5102026-11-02T21:44:47.664ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
5112026-11-02T21:44:47.669ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5122026-11-02T21:44:49.027ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5132026-11-02T21:44:49.032ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
5142026-11-02T21:44:49.034ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5152026-11-02T21:44:49.284ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 16292103337539779003 n_samples = 6 unit = oximeter
5162026-11-02T21:44:49.926ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5172026-11-02T21:44:49.931ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
5182026-11-02T21:44:49.935ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5192026-11-02T21:44:50.604ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5202026-11-02T21:44:50.609ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
5212026-11-02T21:44:50.611ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5222026-11-02T21:44:51.695ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5232026-11-02T21:44:51.700ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
5242026-11-02T21:44:51.703ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5252026-11-02T21:44:53.062ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5262026-11-02T21:44:53.066ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
5272026-11-02T21:44:53.069ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5282026-11-02T21:44:53.630ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("3ae35a6a-b310-416f-b735-4f087b80e800.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("b17b2679-c7fc-4490-b2fe-592c6f059f70.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("dc0fb49a-3bb6-42d6-b689-767d009317bf.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dc0fb49a-3bb6-42d6-b689-767d009317bf.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::c)) }], valid_until: Instant { tv_sec: 709, tv_nsec: 948743429 } }) unit = producer-server
5292026-11-02T21:44:53.630ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
5302026-11-02T21:44:53.636ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
5312026-11-02T21:44:54.217ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5322026-11-02T21:44:54.222ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
5332026-11-02T21:44:54.225ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5342026-11-02T21:44:55.175ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5352026-11-02T21:44:55.179ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
5362026-11-02T21:44:55.182ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5372026-11-02T21:44:55.674ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 2837261487600872993 n_samples = 6 unit = oximeter
5382026-11-02T21:44:56.421ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5392026-11-02T21:44:56.426ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
5402026-11-02T21:44:56.428ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5412026-11-02T21:44:57.535ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5422026-11-02T21:44:57.539ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
5432026-11-02T21:44:57.543ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5442026-11-02T21:44:58.242ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5452026-11-02T21:44:58.247ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
5462026-11-02T21:44:58.250ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5472026-11-02T21:44:59.027ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5482026-11-02T21:44:59.032ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ec70:c9ff:fe21:6d34]
5492026-11-02T21:44:59.035ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5502026-11-02T21:44:59.286ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 16292103337539779003 n_samples = 6 unit = oximeter