Max level shown:
1 [ May 28 17:27:31 Enabled. ]
2 [ May 28 17:27:31 Rereading configuration. ]
3 [ May 28 17:27:32 Rereading configuration. ]
4 [ May 28 17:27:43 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dendrite/bin/tfportd --sync-only &"). ]
5 [ May 28 17:27:43 Method "start" exited with status 0. ]
6 No non-localhost IPv6 addresses found in SMF properties
72026-05-28T17:27:43.580ZINFOtfportd: connecting to dpd host = [::1] port = 12224
82026-05-28T17:27:43.582ZINFOtfportd: connected to dpd running softnpu-cc0c307c-dirty
92026-05-28T17:27:43.582ZINFOtfportd: running in sync-only mode
102026-05-28T17:27:43.584ZINFOtfportd: no non-localhost IPv6 listen address available, waiting for SMF update unit = oximeter
112026-05-28T17:27:43.585ZINFOtfportd: refreshing SMF config prior to waiting on signals unit = signal_handler
12 No non-localhost IPv6 addresses found in SMF properties
132026-05-28T17:27:43.587ZINFOtfportd: refreshed config: Config { log_file: None, log_format: Json, listen_addresses: [ [::1]:12231, ], pkt_source: None, dpd_host: "[::1]", dpd_port: 12224, vlan_link: None, vlan_data: None, techport0_prefix: None, techport1_prefix: None, rack_id: Some( 96d89729-94b8-41da-85d5-253b232250a6, ), sled_id: Some( 1114d748-ee9f-4463-9d19-6f10b32afd1c, ), sled_model: Some( "i86pc", ), sled_revision: Some( 0, ), sled_serial: Some( "buskin", ), }
142026-05-28T17:27:43.587ZINFOtfportd: no non-localhost IPv6 listen address available, waiting for SMF update unit = oximeter
152026-05-28T17:27:43.591ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::c47b:a4ff:fe2f:54f->c6:7b:a4:2f:05:4f interface = tfportrear0_0
162026-05-28T17:27:43.593ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
172026-05-28T17:27:43.598ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
182026-05-28T17:27:43.604ZWARNtfportd: tfportqsfp0_0 has no addrs
19 [ May 28 17:27:44 Rereading configuration. ]
20 [ May 28 17:27:44 Executing refresh method (:kill). ]
21 [ May 28 17:27:44 Stopping because all processes in service exited. ]
22 [ May 28 17:27:44 Executing stop method (:kill). ]
23 [ May 28 17:27:44 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dendrite/bin/tfportd --sync-only &"). ]
24 [ May 28 17:27:44 Method "start" exited with status 0. ]
252026-05-28T17:27:44.249ZINFOtfportd: connecting to dpd host = [::1] port = 12224
262026-05-28T17:27:44.250ZINFOtfportd: connected to dpd running softnpu-cc0c307c-dirty
272026-05-28T17:27:44.251ZINFOtfportd: running in sync-only mode
282026-05-28T17:27:44.251ZINFOtfportd: found suitable IPv6 address for oximeter producer server address = fd00:1122:3344:101::2 unit = oximeter
292026-05-28T17:27:44.253ZINFOtfportd: refreshing SMF config prior to waiting on signals unit = signal_handler
302026-05-28T17:27:44.253ZDEBGtfportd: extracted oximeter configuration data config = OximeterConfig { listen_address: fd00:1122:3344:101::2, sled_identifiers: SledIdentifiers { rack_id: 96d89729-94b8-41da-85d5-253b232250a6, sled_id: 1114d748-ee9f-4463-9d19-6f10b32afd1c, model: "i86pc", revision: 0, serial: "buskin" }, switch_identifiers: SwitchIdentifiers { asic_backend: "softnpu", fab: None, fuse: Some(FuseData { chip_rev: ChipRevision { device_id: 272, rev: "B1", rev_num: 2 }, disabled: DisabledFeatures { bsync: false, mau: [0, 0, 0, 0], pgen: false, pipes: 0, ports: 0, resub: false, speeds: 0, tm_mem: 0 }, frequency: FrequencySettings { bps: 3, bps_ext: 0, cpu_speed_dis: 0, disabled: false, pcie_dis: 0, pps: 3, pps_ext: 0 }, manufacturing: ManufacturingData { core_repair: false, die_rotation: false, pmro_and_skew: 0, silent_spin: 0, soft_pipe_dis: 0, tile_repair: false, voltage_scaling: 0, wf_core_repair: false }, part: PartInfo { part_num: 4660, pkg_id: 1, version: 2 } }), lot: None, lotnum: None, model: "FAKE_SIM_SIDECAR", revision: 0, serial: "SimSidecar0", sidecar_id: 120fb6c2-6b82-479d-afba-d4d163896ffd, slot: 0, wafer: None, wafer_loc: None } } unit = oximeter
312026-05-28T17:27:44.253ZDEBGtfportd: created producer ID producer_id = 95c3f6a3-11a5-4224-b776-9efaf381c247 unit = oximeter
322026-05-28T17:27:44.254ZINFOtfportd: refreshed config: Config { log_file: None, log_format: Json, listen_addresses: [ [fd00:1122:3344:101::2]:12231, [::1]:12231, ], pkt_source: None, dpd_host: "[::1]", dpd_port: 12224, vlan_link: None, vlan_data: None, techport0_prefix: None, techport1_prefix: None, rack_id: Some( 96d89729-94b8-41da-85d5-253b232250a6, ), sled_id: Some( 1114d748-ee9f-4463-9d19-6f10b32afd1c, ), sled_model: Some( "i86pc", ), sled_revision: Some( 0, ), sled_serial: Some( "buskin", ), }
332026-05-28T17:27:44.261ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
342026-05-28T17:27:44.262ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::c47b:a4ff:fe2f:54f->c6:7b:a4:2f:05:4f interface = tfportrear0_0
352026-05-28T17:27:44.263ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::a8fd:80ff:fe41:b320->aa:fd:80:41:b3:20 interface = tfportrear0_0
362026-05-28T17:27:44.265ZDEBGtfportd: registered DTrace probes unit = producer-server
372026-05-28T17:27:44.266ZDEBGtfportd (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::2]:36379 method = GET path = /{producer_id} unit = producer-server versions = all
382026-05-28T17:27:44.266ZINFOtfportd (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:328 local_addr = [fd00:1122:3344:101::2]:36379 unit = producer-server
392026-05-28T17:27:44.266ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
402026-05-28T17:27:44.266ZDEBGtfportd (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::2]:36379 unit = producer-server
412026-05-28T17:27:44.266ZDEBGtfportd: Requested any available port, Dropshot server has been bound to [fd00:1122:3344:101::2]:36379 unit = producer-server
422026-05-28T17:27:44.266ZDEBGtfportd: Nexus IP not provided, will use DNS to resolve it unit = producer-server
432026-05-28T17:27:44.267ZINFOtfportd (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/internal-dns/resolver/src/resolver.rs:144 unit = producer-server
442026-05-28T17:27:44.267ZDEBGtfportd: starting producer registration task unit = producer-server
452026-05-28T17:27:44.267ZINFOtfportd: starting oximeter metric producer server address = [fd00:1122:3344:101::2]:36379 file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:279 interval = 30s producer_id = 95c3f6a3-11a5-4224-b776-9efaf381c247 unit = producer-server
462026-05-28T17:27:44.267ZINFOtfportd: created oximeter producer server unit = oximeter
472026-05-28T17:27:44.267ZDEBGtfportd (producer-registration-task): registering as oximeter producer with Nexus registration_count = 0 unit = producer-server
482026-05-28T17:27:44.267ZDEBGtfportd (kstat-sampler): adding new target unit = oximeter
492026-05-28T17:27:44.269ZDEBGtfportd (kstat-sampler-worker): storing new creation time for tracked target creation_time = 2026-05-28T17:27:27.483398895Z path = KstatPath { module: "link", instance: 0, name: "tfportrear0_0" } unit = oximeter
502026-05-28T17:27:44.269ZDEBGtfportd (kstat-sampler-worker): inserted empty per-target sample queue id = 10555469826956914254 unit = oximeter
512026-05-28T17:27:44.269ZDEBGtfportd: added new link to kstat sampler link_kind = switch-port-control link_name = tfportrear0_0 unit = metrics-task-tracker
522026-05-28T17:27:44.269ZWARNtfportd: tfportqsfp0_0 has no addrs
532026-05-28T17:27:45.016ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
542026-05-28T17:27:45.021ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
552026-05-28T17:27:45.024ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
562026-05-28T17:27:45.024ZDEBGtfportd (kstat-sampler): adding new target unit = oximeter
572026-05-28T17:27:45.025ZDEBGtfportd (kstat-sampler-worker): storing new creation time for tracked target creation_time = 2026-05-28T17:27:27.483268062Z path = KstatPath { module: "link", instance: 0, name: "tfportqsfp0_0" } unit = oximeter
582026-05-28T17:27:45.025ZDEBGtfportd (kstat-sampler-worker): inserted empty per-target sample queue id = 9241873942294349523 unit = oximeter
592026-05-28T17:27:45.025ZDEBGtfportd: added new link to kstat sampler link_kind = switch-port-control link_name = tfportqsfp0_0 unit = metrics-task-tracker
602026-05-28T17:27:45.038ZINFOtfportd: added new ARP entry entry = 10.151.1.174->d2:d1:37:28:95:f4 interface = tfportqsfp0_0
612026-05-28T17:27:45.996ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
622026-05-28T17:27:46.002ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
632026-05-28T17:27:46.005ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
642026-05-28T17:27:46.693ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
652026-05-28T17:27:46.699ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
662026-05-28T17:27:46.701ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
672026-05-28T17:27:47.941ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
682026-05-28T17:27:47.946ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
692026-05-28T17:27:47.949ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
702026-05-28T17:27:48.480ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
712026-05-28T17:27:48.485ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
722026-05-28T17:27:48.488ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
732026-05-28T17:27:49.270ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("9b5df0a0-9701-49fe-bfe5-2e9ff7698c68.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("b5b6feb3-4749-4f5a-9c12-3cf78a5b285c.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("f816260c-0602-4f51-b725-be5e4207cbba.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("f816260c-0602-4f51-b725-be5e4207cbba.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 4506, tv_nsec: 513854301 } }) unit = producer-server
742026-05-28T17:27:49.271ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221 unit = producer-server
752026-05-28T17:27:49.289ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
762026-05-28T17:27:49.655ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
772026-05-28T17:27:49.660ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
782026-05-28T17:27:49.663ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
792026-05-28T17:27:50.516ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
802026-05-28T17:27:50.520ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
812026-05-28T17:27:50.523ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
822026-05-28T17:27:51.371ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
832026-05-28T17:27:51.375ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
842026-05-28T17:27:51.377ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
852026-05-28T17:27:52.344ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
862026-05-28T17:27:52.348ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
872026-05-28T17:27:52.350ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
882026-05-28T17:27:53.228ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
892026-05-28T17:27:53.232ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
902026-05-28T17:27:53.235ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
912026-05-28T17:27:54.274ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10555469826956914254 n_samples = 6 unit = oximeter
922026-05-28T17:27:54.397ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
932026-05-28T17:27:54.402ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
942026-05-28T17:27:54.404ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
952026-05-28T17:27:55.027ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 9241873942294349523 n_samples = 6 unit = oximeter
962026-05-28T17:27:55.358ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
972026-05-28T17:27:55.362ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
982026-05-28T17:27:55.365ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
992026-05-28T17:27:56.060ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1002026-05-28T17:27:56.065ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
1012026-05-28T17:27:56.068ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1022026-05-28T17:27:56.793ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1032026-05-28T17:27:56.797ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
1042026-05-28T17:27:56.800ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1052026-05-28T17:27:58.057ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1062026-05-28T17:27:58.061ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
1072026-05-28T17:27:58.064ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1082026-05-28T17:27:59.093ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1092026-05-28T17:27:59.097ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
1102026-05-28T17:27:59.100ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1112026-05-28T17:28:00.324ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1122026-05-28T17:28:00.328ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
1132026-05-28T17:28:00.331ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1142026-05-28T17:28:00.942ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1152026-05-28T17:28:00.947ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
1162026-05-28T17:28:00.950ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1172026-05-28T17:28:01.685ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1182026-05-28T17:28:01.689ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
1192026-05-28T17:28:01.692ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1202026-05-28T17:28:02.409ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1212026-05-28T17:28:02.413ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
1222026-05-28T17:28:02.416ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1232026-05-28T17:28:03.567ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1242026-05-28T17:28:03.572ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
1252026-05-28T17:28:03.574ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1262026-05-28T17:28:04.112ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1272026-05-28T17:28:04.118ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
1282026-05-28T17:28:04.121ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1292026-05-28T17:28:04.616ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10555469826956914254 n_samples = 6 unit = oximeter
1302026-05-28T17:28:04.631ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }) unit = producer-server
1312026-05-28T17:28:04.632ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 0 delay = 20.02496989s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
1322026-05-28T17:28:04.840ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("9b5df0a0-9701-49fe-bfe5-2e9ff7698c68.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("b5b6feb3-4749-4f5a-9c12-3cf78a5b285c.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("f816260c-0602-4f51-b725-be5e4207cbba.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("f816260c-0602-4f51-b725-be5e4207cbba.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 4521, tv_nsec: 743430208 } }) unit = producer-server
1332026-05-28T17:28:04.840ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221 unit = producer-server
1342026-05-28T17:28:04.847ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
1352026-05-28T17:28:05.226ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1362026-05-28T17:28:05.230ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
1372026-05-28T17:28:05.233ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1382026-05-28T17:28:05.367ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 9241873942294349523 n_samples = 6 unit = oximeter
1392026-05-28T17:28:06.042ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1402026-05-28T17:28:06.047ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
1412026-05-28T17:28:06.050ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1422026-05-28T17:28:06.804ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1432026-05-28T17:28:06.808ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
1442026-05-28T17:28:06.811ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1452026-05-28T17:28:08.285ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1462026-05-28T17:28:08.289ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
1472026-05-28T17:28:08.292ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1482026-05-28T17:28:09.765ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1492026-05-28T17:28:09.769ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
1502026-05-28T17:28:09.772ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1512026-05-28T17:28:10.581ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1522026-05-28T17:28:10.585ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
1532026-05-28T17:28:10.588ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1542026-05-28T17:28:11.890ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1552026-05-28T17:28:11.894ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
1562026-05-28T17:28:11.897ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1572026-05-28T17:28:12.940ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1582026-05-28T17:28:12.945ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
1592026-05-28T17:28:12.947ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1602026-05-28T17:28:13.870ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1612026-05-28T17:28:13.875ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
1622026-05-28T17:28:13.877ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1632026-05-28T17:28:14.590ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10555469826956914254 n_samples = 6 unit = oximeter
1642026-05-28T17:28:15.331ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1652026-05-28T17:28:15.336ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
1662026-05-28T17:28:15.339ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1672026-05-28T17:28:15.342ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 9241873942294349523 n_samples = 6 unit = oximeter
1682026-05-28T17:28:16.314ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1692026-05-28T17:28:16.318ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
1702026-05-28T17:28:16.321ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1712026-05-28T17:28:16.932ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1722026-05-28T17:28:16.937ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
1732026-05-28T17:28:16.939ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1742026-05-28T17:28:18.062ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1752026-05-28T17:28:18.067ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
1762026-05-28T17:28:18.069ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1772026-05-28T17:28:18.806ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1782026-05-28T17:28:18.810ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
1792026-05-28T17:28:18.813ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1802026-05-28T17:28:19.808ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }) unit = producer-server
1812026-05-28T17:28:19.809ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 1 delay = 35.242170435s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
1822026-05-28T17:28:20.302ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1832026-05-28T17:28:20.307ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
1842026-05-28T17:28:20.310ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1852026-05-28T17:28:20.439ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("9b5df0a0-9701-49fe-bfe5-2e9ff7698c68.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("b5b6feb3-4749-4f5a-9c12-3cf78a5b285c.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("f816260c-0602-4f51-b725-be5e4207cbba.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("f816260c-0602-4f51-b725-be5e4207cbba.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 4537, tv_nsec: 383628764 } }) unit = producer-server
1862026-05-28T17:28:20.439ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221 unit = producer-server
1872026-05-28T17:28:20.447ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
1882026-05-28T17:28:21.560ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1892026-05-28T17:28:21.566ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
1902026-05-28T17:28:21.569ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1912026-05-28T17:28:22.560ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1922026-05-28T17:28:22.564ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
1932026-05-28T17:28:22.567ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1942026-05-28T17:28:23.697ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1952026-05-28T17:28:23.702ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
1962026-05-28T17:28:23.710ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1972026-05-28T17:28:24.566ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10555469826956914254 n_samples = 6 unit = oximeter
1982026-05-28T17:28:25.121ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1992026-05-28T17:28:25.125ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
2002026-05-28T17:28:25.127ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2012026-05-28T17:28:25.318ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 9241873942294349523 n_samples = 6 unit = oximeter
2022026-05-28T17:28:26.032ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2032026-05-28T17:28:26.037ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
2042026-05-28T17:28:26.039ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2052026-05-28T17:28:26.796ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2062026-05-28T17:28:26.801ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
2072026-05-28T17:28:26.803ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2082026-05-28T17:28:27.945ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2092026-05-28T17:28:27.950ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
2102026-05-28T17:28:27.953ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2112026-05-28T17:28:29.077ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2122026-05-28T17:28:29.082ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
2132026-05-28T17:28:29.085ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2142026-05-28T17:28:30.331ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2152026-05-28T17:28:30.336ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
2162026-05-28T17:28:30.339ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2172026-05-28T17:28:31.281ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2182026-05-28T17:28:31.285ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
2192026-05-28T17:28:31.288ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2202026-05-28T17:28:32.197ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2212026-05-28T17:28:32.202ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
2222026-05-28T17:28:32.205ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2232026-05-28T17:28:33.670ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2242026-05-28T17:28:33.675ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
2252026-05-28T17:28:33.677ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2262026-05-28T17:28:34.541ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10555469826956914254 n_samples = 6 unit = oximeter
2272026-05-28T17:28:35.091ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2282026-05-28T17:28:35.096ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
2292026-05-28T17:28:35.099ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2302026-05-28T17:28:35.293ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 9241873942294349523 n_samples = 6 unit = oximeter
2312026-05-28T17:28:35.409ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }) unit = producer-server
2322026-05-28T17:28:35.410ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 2 delay = 50.884290128s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
2332026-05-28T17:28:35.858ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2342026-05-28T17:28:35.862ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
2352026-05-28T17:28:35.865ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2362026-05-28T17:28:36.217ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("9b5df0a0-9701-49fe-bfe5-2e9ff7698c68.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("b5b6feb3-4749-4f5a-9c12-3cf78a5b285c.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("f816260c-0602-4f51-b725-be5e4207cbba.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("f816260c-0602-4f51-b725-be5e4207cbba.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 4553, tv_nsec: 204251901 } }) unit = producer-server
2372026-05-28T17:28:36.218ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221 unit = producer-server
2382026-05-28T17:28:36.224ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
2392026-05-28T17:28:37.369ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2402026-05-28T17:28:37.373ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
2412026-05-28T17:28:37.376ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2422026-05-28T17:28:38.755ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2432026-05-28T17:28:38.760ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
2442026-05-28T17:28:38.763ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2452026-05-28T17:28:39.460ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2462026-05-28T17:28:39.465ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
2472026-05-28T17:28:39.467ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2482026-05-28T17:28:40.000ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2492026-05-28T17:28:40.005ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
2502026-05-28T17:28:40.007ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2512026-05-28T17:28:40.538ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2522026-05-28T17:28:40.543ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
2532026-05-28T17:28:40.545ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2542026-05-28T17:28:41.299ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2552026-05-28T17:28:41.303ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
2562026-05-28T17:28:41.306ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2572026-05-28T17:28:42.158ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2582026-05-28T17:28:42.162ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
2592026-05-28T17:28:42.165ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2602026-05-28T17:28:42.947ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2612026-05-28T17:28:42.951ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
2622026-05-28T17:28:42.954ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2632026-05-28T17:28:43.720ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2642026-05-28T17:28:43.724ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
2652026-05-28T17:28:43.727ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2662026-05-28T17:28:44.516ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10555469826956914254 n_samples = 6 unit = oximeter
2672026-05-28T17:28:44.832ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2682026-05-28T17:28:44.837ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
2692026-05-28T17:28:44.840ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2702026-05-28T17:28:45.267ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 9241873942294349523 n_samples = 6 unit = oximeter
2712026-05-28T17:28:45.622ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2722026-05-28T17:28:45.627ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
2732026-05-28T17:28:45.630ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2742026-05-28T17:28:46.288ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2752026-05-28T17:28:46.292ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
2762026-05-28T17:28:46.296ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2772026-05-28T17:28:47.800ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2782026-05-28T17:28:47.805ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
2792026-05-28T17:28:47.808ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2802026-05-28T17:28:48.609ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2812026-05-28T17:28:48.613ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
2822026-05-28T17:28:48.616ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2832026-05-28T17:28:49.416ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2842026-05-28T17:28:49.420ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
2852026-05-28T17:28:49.424ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2862026-05-28T17:28:50.303ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2872026-05-28T17:28:50.308ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
2882026-05-28T17:28:50.311ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2892026-05-28T17:28:50.884ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2902026-05-28T17:28:50.888ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
2912026-05-28T17:28:50.892ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2922026-05-28T17:28:51.186ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }) unit = producer-server
2932026-05-28T17:28:51.187ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 3 delay = 66.703150921s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
2942026-05-28T17:28:51.987ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2952026-05-28T17:28:51.993ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
2962026-05-28T17:28:51.996ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2972026-05-28T17:28:52.186ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("9b5df0a0-9701-49fe-bfe5-2e9ff7698c68.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("b5b6feb3-4749-4f5a-9c12-3cf78a5b285c.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("f816260c-0602-4f51-b725-be5e4207cbba.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("f816260c-0602-4f51-b725-be5e4207cbba.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 4569, tv_nsec: 216573903 } }) unit = producer-server
2982026-05-28T17:28:52.187ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221 unit = producer-server
2992026-05-28T17:28:52.193ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
3002026-05-28T17:28:52.785ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3012026-05-28T17:28:52.789ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
3022026-05-28T17:28:52.792ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3032026-05-28T17:28:53.632ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3042026-05-28T17:28:53.636ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
3052026-05-28T17:28:53.639ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3062026-05-28T17:28:54.393ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3072026-05-28T17:28:54.398ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
3082026-05-28T17:28:54.401ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3092026-05-28T17:28:54.490ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10555469826956914254 n_samples = 6 unit = oximeter
3102026-05-28T17:28:55.049ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3112026-05-28T17:28:55.053ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
3122026-05-28T17:28:55.056ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3132026-05-28T17:28:55.240ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 9241873942294349523 n_samples = 6 unit = oximeter
3142026-05-28T17:28:55.646ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3152026-05-28T17:28:55.650ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
3162026-05-28T17:28:55.653ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3172026-05-28T17:28:56.786ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3182026-05-28T17:28:56.796ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
3192026-05-28T17:28:56.804ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3202026-05-28T17:28:57.890ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3212026-05-28T17:28:57.894ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
3222026-05-28T17:28:57.897ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3232026-05-28T17:28:59.369ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3242026-05-28T17:28:59.373ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
3252026-05-28T17:28:59.376ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3262026-05-28T17:29:01.138ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3272026-05-28T17:29:01.141ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
3282026-05-28T17:29:01.158ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3292026-05-28T17:29:03.808ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3302026-05-28T17:29:03.816ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
3312026-05-28T17:29:03.843ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3322026-05-28T17:29:04.468ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10555469826956914254 n_samples = 6 unit = oximeter
3332026-05-28T17:29:04.657ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3342026-05-28T17:29:04.665ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
3352026-05-28T17:29:04.669ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3362026-05-28T17:29:05.213ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 9241873942294349523 n_samples = 6 unit = oximeter
3372026-05-28T17:29:05.389ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3382026-05-28T17:29:05.393ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
3392026-05-28T17:29:05.396ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3402026-05-28T17:29:05.954ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3412026-05-28T17:29:05.960ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
3422026-05-28T17:29:05.962ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3432026-05-28T17:29:07.096ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3442026-05-28T17:29:07.101ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
3452026-05-28T17:29:07.105ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3462026-05-28T17:29:07.153ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }) unit = producer-server
3472026-05-28T17:29:07.158ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 4 delay = 82.721763172s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
3482026-05-28T17:29:08.170ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3492026-05-28T17:29:08.175ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
3502026-05-28T17:29:08.177ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3512026-05-28T17:29:09.586ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3522026-05-28T17:29:09.591ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
3532026-05-28T17:29:09.593ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3542026-05-28T17:29:10.541ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3552026-05-28T17:29:10.546ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
3562026-05-28T17:29:10.549ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3572026-05-28T17:29:10.923ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("9b5df0a0-9701-49fe-bfe5-2e9ff7698c68.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("b5b6feb3-4749-4f5a-9c12-3cf78a5b285c.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("f816260c-0602-4f51-b725-be5e4207cbba.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("f816260c-0602-4f51-b725-be5e4207cbba.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 4588, tv_nsec: 6801254 } }) unit = producer-server
3582026-05-28T17:29:10.924ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221 unit = producer-server
3592026-05-28T17:29:10.933ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
3602026-05-28T17:29:12.011ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3612026-05-28T17:29:12.016ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
3622026-05-28T17:29:12.019ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3632026-05-28T17:29:13.282ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3642026-05-28T17:29:13.287ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
3652026-05-28T17:29:13.291ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3662026-05-28T17:29:14.418ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3672026-05-28T17:29:14.423ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
3682026-05-28T17:29:14.426ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3692026-05-28T17:29:14.455ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10555469826956914254 n_samples = 6 unit = oximeter
3702026-05-28T17:29:15.199ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 9241873942294349523 n_samples = 6 unit = oximeter
3712026-05-28T17:29:15.832ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3722026-05-28T17:29:15.837ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
3732026-05-28T17:29:15.839ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3742026-05-28T17:29:16.351ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3752026-05-28T17:29:16.356ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
3762026-05-28T17:29:16.358ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3772026-05-28T17:29:17.833ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3782026-05-28T17:29:17.838ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
3792026-05-28T17:29:17.840ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3802026-05-28T17:29:18.568ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3812026-05-28T17:29:18.572ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
3822026-05-28T17:29:18.575ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3832026-05-28T17:29:19.656ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3842026-05-28T17:29:19.661ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
3852026-05-28T17:29:19.664ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3862026-05-28T17:29:20.367ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3872026-05-28T17:29:20.372ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
3882026-05-28T17:29:20.374ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3892026-05-28T17:29:21.156ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3902026-05-28T17:29:21.161ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
3912026-05-28T17:29:21.164ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3922026-05-28T17:29:22.187ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3932026-05-28T17:29:22.192ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
3942026-05-28T17:29:22.195ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3952026-05-28T17:29:23.079ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3962026-05-28T17:29:23.086ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
3972026-05-28T17:29:23.090ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3982026-05-28T17:29:23.855ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3992026-05-28T17:29:23.872ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
4002026-05-28T17:29:23.882ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4012026-05-28T17:29:24.426ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4022026-05-28T17:29:24.433ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
4032026-05-28T17:29:24.438ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4042026-05-28T17:29:24.458ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10555469826956914254 n_samples = 6 unit = oximeter
4052026-05-28T17:29:25.000ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4062026-05-28T17:29:25.007ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
4072026-05-28T17:29:25.011ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4082026-05-28T17:29:25.202ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 9241873942294349523 n_samples = 6 unit = oximeter
4092026-05-28T17:29:25.610ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4102026-05-28T17:29:25.615ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
4112026-05-28T17:29:25.618ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4122026-05-28T17:29:25.933ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }) unit = producer-server
4132026-05-28T17:29:25.935ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 5 delay = 101.509840439s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
4142026-05-28T17:29:26.251ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4152026-05-28T17:29:26.257ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
4162026-05-28T17:29:26.261ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4172026-05-28T17:29:27.021ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4182026-05-28T17:29:27.028ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
4192026-05-28T17:29:27.031ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4202026-05-28T17:29:28.005ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4212026-05-28T17:29:28.013ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
4222026-05-28T17:29:28.018ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4232026-05-28T17:29:28.636ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4242026-05-28T17:29:28.641ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
4252026-05-28T17:29:28.643ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4262026-05-28T17:29:29.984ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4272026-05-28T17:29:29.988ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
4282026-05-28T17:29:29.991ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4292026-05-28T17:29:31.300ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4302026-05-28T17:29:31.306ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
4312026-05-28T17:29:31.308ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4322026-05-28T17:29:32.473ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4332026-05-28T17:29:32.478ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
4342026-05-28T17:29:32.482ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4352026-05-28T17:29:33.304ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4362026-05-28T17:29:33.310ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
4372026-05-28T17:29:33.312ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4382026-05-28T17:29:34.097ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4392026-05-28T17:29:34.102ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
4402026-05-28T17:29:34.105ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4412026-05-28T17:29:34.459ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10555469826956914254 n_samples = 6 unit = oximeter
4422026-05-28T17:29:35.133ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("9b5df0a0-9701-49fe-bfe5-2e9ff7698c68.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("b5b6feb3-4749-4f5a-9c12-3cf78a5b285c.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("f816260c-0602-4f51-b725-be5e4207cbba.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("f816260c-0602-4f51-b725-be5e4207cbba.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 4612, tv_nsec: 218795130 } }) unit = producer-server
4432026-05-28T17:29:35.134ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221 unit = producer-server
4442026-05-28T17:29:35.147ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
4452026-05-28T17:29:35.202ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 9241873942294349523 n_samples = 6 unit = oximeter
4462026-05-28T17:29:35.298ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4472026-05-28T17:29:35.304ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
4482026-05-28T17:29:35.307ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4492026-05-28T17:29:36.729ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4502026-05-28T17:29:36.734ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
4512026-05-28T17:29:36.737ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4522026-05-28T17:29:37.809ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4532026-05-28T17:29:37.815ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
4542026-05-28T17:29:37.818ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4552026-05-28T17:29:39.255ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4562026-05-28T17:29:39.260ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
4572026-05-28T17:29:39.263ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4582026-05-28T17:29:40.744ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4592026-05-28T17:29:40.750ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
4602026-05-28T17:29:40.753ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4612026-05-28T17:29:41.787ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4622026-05-28T17:29:41.792ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
4632026-05-28T17:29:41.796ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4642026-05-28T17:29:42.684ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4652026-05-28T17:29:42.690ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
4662026-05-28T17:29:42.692ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4672026-05-28T17:29:43.505ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4682026-05-28T17:29:43.510ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
4692026-05-28T17:29:43.513ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4702026-05-28T17:29:44.084ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4712026-05-28T17:29:44.090ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
4722026-05-28T17:29:44.092ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4732026-05-28T17:29:44.461ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10555469826956914254 n_samples = 6 unit = oximeter
4742026-05-28T17:29:45.099ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4752026-05-28T17:29:45.104ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
4762026-05-28T17:29:45.108ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4772026-05-28T17:29:45.203ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 9241873942294349523 n_samples = 6 unit = oximeter
4782026-05-28T17:29:45.645ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4792026-05-28T17:29:45.651ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
4802026-05-28T17:29:45.654ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4812026-05-28T17:29:46.581ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4822026-05-28T17:29:46.587ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
4832026-05-28T17:29:46.590ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4842026-05-28T17:29:47.649ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4852026-05-28T17:29:47.654ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
4862026-05-28T17:29:47.657ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4872026-05-28T17:29:48.223ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4882026-05-28T17:29:48.228ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
4892026-05-28T17:29:48.231ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4902026-05-28T17:29:49.039ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4912026-05-28T17:29:49.045ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
4922026-05-28T17:29:49.047ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4932026-05-28T17:29:49.748ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4942026-05-28T17:29:49.752ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
4952026-05-28T17:29:49.755ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4962026-05-28T17:29:50.148ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }) unit = producer-server
4972026-05-28T17:29:50.149ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 6 delay = 125.724705607s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
4982026-05-28T17:29:51.226ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4992026-05-28T17:29:51.232ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
5002026-05-28T17:29:51.235ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5012026-05-28T17:29:51.842ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5022026-05-28T17:29:51.847ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
5032026-05-28T17:29:51.850ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5042026-05-28T17:29:52.708ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5052026-05-28T17:29:52.713ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
5062026-05-28T17:29:52.717ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5072026-05-28T17:29:53.303ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5082026-05-28T17:29:53.310ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
5092026-05-28T17:29:53.313ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5102026-05-28T17:29:54.463ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10555469826956914254 n_samples = 6 unit = oximeter
5112026-05-28T17:29:54.784ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5122026-05-28T17:29:54.789ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
5132026-05-28T17:29:54.792ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5142026-05-28T17:29:55.204ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 9241873942294349523 n_samples = 6 unit = oximeter
5152026-05-28T17:29:56.104ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5162026-05-28T17:29:56.109ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
5172026-05-28T17:29:56.112ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5182026-05-28T17:29:57.122ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5192026-05-28T17:29:57.126ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
5202026-05-28T17:29:57.129ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5212026-05-28T17:29:58.349ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5222026-05-28T17:29:58.354ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
5232026-05-28T17:29:58.357ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5242026-05-28T17:29:59.421ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5252026-05-28T17:29:59.427ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
5262026-05-28T17:29:59.431ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5272026-05-28T17:29:59.978ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("9b5df0a0-9701-49fe-bfe5-2e9ff7698c68.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("b5b6feb3-4749-4f5a-9c12-3cf78a5b285c.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("f816260c-0602-4f51-b725-be5e4207cbba.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("f816260c-0602-4f51-b725-be5e4207cbba.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 4637, tv_nsec: 63591890 } }) unit = producer-server
5282026-05-28T17:29:59.978ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221 unit = producer-server
5292026-05-28T17:29:59.987ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
5302026-05-28T17:30:00.347ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5312026-05-28T17:30:00.353ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
5322026-05-28T17:30:00.357ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5332026-05-28T17:30:01.381ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5342026-05-28T17:30:01.387ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c47b:a4ff:fe2f:54f]
5352026-05-28T17:30:01.391ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]