Max level shown:
1 [ Oct 23 22:42:16 Enabled. ]
2 [ Oct 23 22:42:16 Rereading configuration. ]
3 [ Oct 23 22:42:17 Rereading configuration. ]
4 [ Oct 23 22:42:28 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dendrite/bin/tfportd --sync-only &"). ]
5 [ Oct 23 22:42:28 Method "start" exited with status 0. ]
6 No non-localhost IPv6 addresses found in SMF properties
72026-10-23T22:42:28.572ZINFOtfportd: connecting to dpd host = [::1] port = 12224
82026-10-23T22:42:28.574ZINFOtfportd: connected to dpd running softnpu-a133c73e
92026-10-23T22:42:28.575ZINFOtfportd: running in sync-only mode
102026-10-23T22:42:28.575ZINFOtfportd: no non-localhost IPv6 listen address available, waiting for SMF update unit = oximeter
112026-10-23T22:42:28.575ZINFOtfportd: refreshing SMF config prior to waiting on signals unit = signal_handler
12 No non-localhost IPv6 addresses found in SMF properties
132026-10-23T22:42:28.577ZINFOtfportd: refreshed config: Config { log_file: None, log_format: Json, listen_addresses: [ [::1]:12231, ], pkt_source: None, dpd_host: "[::1]", dpd_port: 12224, vlan_link: None, vlan_data: None, techport0_prefix: None, techport1_prefix: None, rack_id: Some( 5a657593-3ffd-488f-aa4f-c2d043f8b6c2, ), sled_id: Some( 1eb8ac59-6bbf-4749-aa03-2f0ad1946096, ), sled_model: Some( "i86pc", ), sled_revision: Some( 0, ), sled_serial: Some( "buskin", ), }
142026-10-23T22:42:28.577ZINFOtfportd: no non-localhost IPv6 listen address available, waiting for SMF update unit = oximeter
152026-10-23T22:42:28.582ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::5cfc:dbff:fef8:4448->5e:fc:db:f8:44:48 interface = tfportrear0_0
162026-10-23T22:42:28.583ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::b45f:20ff:fe1e:50a0->b6:5f:20:1e:50:a0 interface = tfportrear0_0
172026-10-23T22:42:28.583ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
182026-10-23T22:42:28.587ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
192026-10-23T22:42:28.592ZWARNtfportd: tfportqsfp0_0 has no addrs
20 [ Oct 23 22:42:29 Rereading configuration. ]
21 [ Oct 23 22:42:29 Executing refresh method (:kill). ]
22 [ Oct 23 22:42:29 Stopping because all processes in service exited. ]
23 [ Oct 23 22:42:29 Executing stop method (:kill). ]
24 [ Oct 23 22:42:29 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dendrite/bin/tfportd --sync-only &"). ]
25 [ Oct 23 22:42:29 Method "start" exited with status 0. ]
262026-10-23T22:42:29.212ZINFOtfportd: connecting to dpd host = [::1] port = 12224
272026-10-23T22:42:29.213ZINFOtfportd: connected to dpd running softnpu-a133c73e
282026-10-23T22:42:29.214ZINFOtfportd: running in sync-only mode
292026-10-23T22:42:29.214ZINFOtfportd: found suitable IPv6 address for oximeter producer server address = fd00:1122:3344:101::2 unit = oximeter
302026-10-23T22:42:29.214ZINFOtfportd: refreshing SMF config prior to waiting on signals unit = signal_handler
312026-10-23T22:42:29.214ZDEBGtfportd: extracted oximeter configuration data config = OximeterConfig { listen_address: fd00:1122:3344:101::2, sled_identifiers: SledIdentifiers { rack_id: 5a657593-3ffd-488f-aa4f-c2d043f8b6c2, sled_id: 1eb8ac59-6bbf-4749-aa03-2f0ad1946096, model: "i86pc", revision: 0, serial: "buskin" }, switch_identifiers: SwitchIdentifiers { asic_backend: "softnpu", fab: None, fuse: Some(FuseData { chip_rev: ChipRevision { device_id: 272, rev: "B1", rev_num: 2 }, disabled: DisabledFeatures { bsync: false, mau: [0, 0, 0, 0], pgen: false, pipes: 0, ports: 0, resub: false, speeds: 0, tm_mem: 0 }, frequency: FrequencySettings { bps: 3, bps_ext: 0, cpu_speed_dis: 0, disabled: false, pcie_dis: 0, pps: 3, pps_ext: 0 }, manufacturing: ManufacturingData { core_repair: false, die_rotation: false, pmro_and_skew: 0, silent_spin: 0, soft_pipe_dis: 0, tile_repair: false, voltage_scaling: 0, wf_core_repair: false }, part: PartInfo { part_num: 4660, pkg_id: 1, version: 2 } }), lot: None, lotnum: None, model: "FAKE_SIM_SIDECAR", revision: 0, serial: "SimSidecar0", sidecar_id: e9fe07f3-649a-483c-ab6b-41d78176695b, slot: 0, wafer: None, wafer_loc: None } } unit = oximeter
322026-10-23T22:42:29.214ZDEBGtfportd: created producer ID producer_id = ad23de39-30d8-47fa-ab27-ac0d131abf0e unit = oximeter
332026-10-23T22:42:29.216ZINFOtfportd: refreshed config: Config { log_file: None, log_format: Json, listen_addresses: [ [fd00:1122:3344:101::2]:12231, [::1]:12231, ], pkt_source: None, dpd_host: "[::1]", dpd_port: 12224, vlan_link: None, vlan_data: None, techport0_prefix: None, techport1_prefix: None, rack_id: Some( 5a657593-3ffd-488f-aa4f-c2d043f8b6c2, ), sled_id: Some( 1eb8ac59-6bbf-4749-aa03-2f0ad1946096, ), sled_model: Some( "i86pc", ), sled_revision: Some( 0, ), sled_serial: Some( "buskin", ), }
342026-10-23T22:42:29.223ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
352026-10-23T22:42:29.224ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::5cfc:dbff:fef8:4448->5e:fc:db:f8:44:48 interface = tfportrear0_0
362026-10-23T22:42:29.224ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::b45f:20ff:fe1e:50a0->b6:5f:20:1e:50:a0 interface = tfportrear0_0
372026-10-23T22:42:29.226ZDEBGtfportd: registered DTrace probes unit = producer-server
382026-10-23T22:42:29.226ZDEBGtfportd (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::2]:42966 method = GET path = /{producer_id} unit = producer-server versions = all
392026-10-23T22:42:29.226ZINFOtfportd (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:328 local_addr = [fd00:1122:3344:101::2]:42966 unit = producer-server
402026-10-23T22:42:29.227ZDEBGtfportd (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::2]:42966 unit = producer-server
412026-10-23T22:42:29.227ZDEBGtfportd: Requested any available port, Dropshot server has been bound to [fd00:1122:3344:101::2]:42966 unit = producer-server
422026-10-23T22:42:29.227ZDEBGtfportd: Nexus IP not provided, will use DNS to resolve it unit = producer-server
432026-10-23T22:42:29.227ZINFOtfportd (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/internal-dns/resolver/src/resolver.rs:144 unit = producer-server
442026-10-23T22:42:29.227ZDEBGtfportd: starting producer registration task unit = producer-server
452026-10-23T22:42:29.227ZINFOtfportd: starting oximeter metric producer server address = [fd00:1122:3344:101::2]:42966 file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:279 interval = 30s producer_id = ad23de39-30d8-47fa-ab27-ac0d131abf0e unit = producer-server
462026-10-23T22:42:29.227ZINFOtfportd: created oximeter producer server unit = oximeter
472026-10-23T22:42:29.227ZDEBGtfportd (producer-registration-task): registering as oximeter producer with Nexus registration_count = 0 unit = producer-server
482026-10-23T22:42:29.228ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
492026-10-23T22:42:29.229ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 0 delay = 1.24637ms error = "proto error: no records found for Query { name: Name(\\"_nexus._tcp.control-plane.oxide.internal.\\"), query_type: SRV, query_class: IN }" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
502026-10-23T22:42:29.229ZDEBGtfportd (kstat-sampler): adding new target unit = oximeter
512026-10-23T22:42:29.230ZDEBGtfportd (kstat-sampler-worker): storing new creation time for tracked target creation_time = 2026-10-23T22:42:12.113268078Z path = KstatPath { module: "link", instance: 0, name: "tfportrear0_0" } unit = oximeter
522026-10-23T22:42:29.230ZDEBGtfportd (kstat-sampler-worker): inserted empty per-target sample queue id = 17195656586748066456 unit = oximeter
532026-10-23T22:42:29.230ZDEBGtfportd: added new link to kstat sampler link_kind = switch-port-control link_name = tfportrear0_0 unit = metrics-task-tracker
542026-10-23T22:42:29.231ZWARNtfportd: tfportqsfp0_0 has no addrs
552026-10-23T22:42:29.467ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 1 delay = 239.459415ms error = "proto error: no records found for Query { name: Name(\\"_nexus._tcp.control-plane.oxide.internal.\\"), query_type: SRV, query_class: IN }" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
562026-10-23T22:42:30.090ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 2 delay = 862.168326ms error = "proto error: no records found for Query { name: Name(\\"_nexus._tcp.control-plane.oxide.internal.\\"), query_type: SRV, query_class: IN }" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
572026-10-23T22:42:30.312ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
582026-10-23T22:42:30.317ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
592026-10-23T22:42:30.319ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
602026-10-23T22:42:30.320ZDEBGtfportd (kstat-sampler): adding new target unit = oximeter
612026-10-23T22:42:30.321ZDEBGtfportd (kstat-sampler-worker): storing new creation time for tracked target creation_time = 2026-10-23T22:42:12.113131894Z path = KstatPath { module: "link", instance: 0, name: "tfportqsfp0_0" } unit = oximeter
622026-10-23T22:42:30.321ZDEBGtfportd (kstat-sampler-worker): inserted empty per-target sample queue id = 16038591658783834674 unit = oximeter
632026-10-23T22:42:30.321ZDEBGtfportd: added new link to kstat sampler link_kind = switch-port-control link_name = tfportqsfp0_0 unit = metrics-task-tracker
642026-10-23T22:42:30.627ZINFOtfportd: added new ARP entry entry = 10.151.1.174->8e:72:12:39:48:05 interface = tfportqsfp0_0
652026-10-23T22:42:31.066ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
662026-10-23T22:42:31.078ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
672026-10-23T22:42:31.083ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
682026-10-23T22:42:31.484ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("18c3c7a4-2d25-47f8-b487-f981af3791b3.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("3dc19e6c-ffc1-4818-983a-58e7767e485b.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("e613c475-fec5-48e0-b69e-0c4bc47e48d0.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("e613c475-fec5-48e0-b69e-0c4bc47e48d0.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::c)) }], valid_until: Instant { tv_sec: 581, tv_nsec: 135960097 } }) unit = producer-server
692026-10-23T22:42:31.484ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::a]:12221 unit = producer-server
702026-10-23T22:42:31.502ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
712026-10-23T22:42:32.548ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
722026-10-23T22:42:32.552ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
732026-10-23T22:42:32.555ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
742026-10-23T22:42:34.049ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
752026-10-23T22:42:34.054ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
762026-10-23T22:42:34.056ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
772026-10-23T22:42:34.734ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
782026-10-23T22:42:34.739ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
792026-10-23T22:42:34.742ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
802026-10-23T22:42:35.709ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
812026-10-23T22:42:35.713ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
822026-10-23T22:42:35.716ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
832026-10-23T22:42:36.493ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
842026-10-23T22:42:36.497ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
852026-10-23T22:42:36.500ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
862026-10-23T22:42:37.654ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
872026-10-23T22:42:37.658ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
882026-10-23T22:42:37.666ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
892026-10-23T22:42:38.261ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
902026-10-23T22:42:38.266ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
912026-10-23T22:42:38.269ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
922026-10-23T22:42:38.964ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
932026-10-23T22:42:38.969ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
942026-10-23T22:42:38.971ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
952026-10-23T22:42:39.237ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 17195656586748066456 n_samples = 6 unit = oximeter
962026-10-23T22:42:39.639ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
972026-10-23T22:42:39.644ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
982026-10-23T22:42:39.647ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
992026-10-23T22:42:40.323ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 16038591658783834674 n_samples = 6 unit = oximeter
1002026-10-23T22:42:40.882ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1012026-10-23T22:42:40.886ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
1022026-10-23T22:42:40.889ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1032026-10-23T22:42:41.985ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1042026-10-23T22:42:41.989ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
1052026-10-23T22:42:41.991ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1062026-10-23T22:42:43.319ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1072026-10-23T22:42:43.323ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
1082026-10-23T22:42:43.327ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1092026-10-23T22:42:44.048ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1102026-10-23T22:42:44.053ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
1112026-10-23T22:42:44.055ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1122026-10-23T22:42:44.975ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1132026-10-23T22:42:44.979ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
1142026-10-23T22:42:44.982ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1152026-10-23T22:42:46.213ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1162026-10-23T22:42:46.218ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
1172026-10-23T22:42:46.220ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1182026-10-23T22:42:46.503ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", source: TimedOut }) unit = producer-server
1192026-10-23T22:42:46.504ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 3 delay = 17.276393978s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
1202026-10-23T22:42:46.620ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1212026-10-23T22:42:46.624ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
1222026-10-23T22:42:46.627ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1232026-10-23T22:42:47.809ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1242026-10-23T22:42:47.813ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
1252026-10-23T22:42:47.816ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1262026-10-23T22:42:48.280ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("18c3c7a4-2d25-47f8-b487-f981af3791b3.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("3dc19e6c-ffc1-4818-983a-58e7767e485b.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("e613c475-fec5-48e0-b69e-0c4bc47e48d0.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("e613c475-fec5-48e0-b69e-0c4bc47e48d0.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::c)) }], valid_until: Instant { tv_sec: 598, tv_nsec: 716039461 } }) unit = producer-server
1272026-10-23T22:42:48.281ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::a]:12221 unit = producer-server
1282026-10-23T22:42:48.287ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
1292026-10-23T22:42:48.457ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 17195656586748066456 n_samples = 6 unit = oximeter
1302026-10-23T22:42:49.290ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1312026-10-23T22:42:49.294ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
1322026-10-23T22:42:49.297ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1332026-10-23T22:42:49.538ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 16038591658783834674 n_samples = 6 unit = oximeter
1342026-10-23T22:42:50.344ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1352026-10-23T22:42:50.348ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
1362026-10-23T22:42:50.351ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1372026-10-23T22:42:51.601ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1382026-10-23T22:42:51.606ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
1392026-10-23T22:42:51.608ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1402026-10-23T22:42:52.870ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1412026-10-23T22:42:52.875ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
1422026-10-23T22:42:52.877ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1432026-10-23T22:42:54.108ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1442026-10-23T22:42:54.111ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
1452026-10-23T22:42:54.114ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1462026-10-23T22:42:55.122ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1472026-10-23T22:42:55.126ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
1482026-10-23T22:42:55.128ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1492026-10-23T22:42:56.568ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1502026-10-23T22:42:56.574ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
1512026-10-23T22:42:56.577ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1522026-10-23T22:42:57.202ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1532026-10-23T22:42:57.206ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
1542026-10-23T22:42:57.208ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1552026-10-23T22:42:58.406ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1562026-10-23T22:42:58.410ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
1572026-10-23T22:42:58.413ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1582026-10-23T22:42:58.431ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 17195656586748066456 n_samples = 6 unit = oximeter
1592026-10-23T22:42:59.439ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1602026-10-23T22:42:59.444ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
1612026-10-23T22:42:59.446ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1622026-10-23T22:42:59.513ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 16038591658783834674 n_samples = 6 unit = oximeter
1632026-10-23T22:43:00.011ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1642026-10-23T22:43:00.016ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
1652026-10-23T22:43:00.019ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1662026-10-23T22:43:01.252ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1672026-10-23T22:43:01.257ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
1682026-10-23T22:43:01.259ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1692026-10-23T22:43:02.395ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1702026-10-23T22:43:02.399ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
1712026-10-23T22:43:02.402ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1722026-10-23T22:43:03.247ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", source: TimedOut }) unit = producer-server
1732026-10-23T22:43:03.248ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 4 delay = 34.844731783s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
1742026-10-23T22:43:03.805ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1752026-10-23T22:43:03.809ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
1762026-10-23T22:43:03.812ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1772026-10-23T22:43:04.965ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1782026-10-23T22:43:04.970ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
1792026-10-23T22:43:04.972ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1802026-10-23T22:43:05.576ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1812026-10-23T22:43:05.583ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
1822026-10-23T22:43:05.587ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1832026-10-23T22:43:06.712ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1842026-10-23T22:43:06.717ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
1852026-10-23T22:43:06.720ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1862026-10-23T22:43:07.348ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1872026-10-23T22:43:07.352ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
1882026-10-23T22:43:07.355ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1892026-10-23T22:43:07.972ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1902026-10-23T22:43:07.978ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
1912026-10-23T22:43:07.981ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1922026-10-23T22:43:08.407ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 17195656586748066456 n_samples = 6 unit = oximeter
1932026-10-23T22:43:08.739ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("18c3c7a4-2d25-47f8-b487-f981af3791b3.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("3dc19e6c-ffc1-4818-983a-58e7767e485b.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("e613c475-fec5-48e0-b69e-0c4bc47e48d0.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("e613c475-fec5-48e0-b69e-0c4bc47e48d0.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::c)) }], valid_until: Instant { tv_sec: 619, tv_nsec: 230146556 } }) unit = producer-server
1942026-10-23T22:43:08.739ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::a]:12221 unit = producer-server
1952026-10-23T22:43:08.747ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
1962026-10-23T22:43:09.300ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1972026-10-23T22:43:09.325ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
1982026-10-23T22:43:09.333ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1992026-10-23T22:43:09.489ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 16038591658783834674 n_samples = 6 unit = oximeter
2002026-10-23T22:43:10.226ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2012026-10-23T22:43:10.237ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
2022026-10-23T22:43:10.243ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2032026-10-23T22:43:10.812ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2042026-10-23T22:43:10.818ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
2052026-10-23T22:43:10.821ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2062026-10-23T22:43:11.834ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2072026-10-23T22:43:11.838ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
2082026-10-23T22:43:11.841ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2092026-10-23T22:43:13.170ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2102026-10-23T22:43:13.176ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
2112026-10-23T22:43:13.179ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2122026-10-23T22:43:13.909ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2132026-10-23T22:43:13.913ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
2142026-10-23T22:43:13.915ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2152026-10-23T22:43:14.608ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2162026-10-23T22:43:14.612ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
2172026-10-23T22:43:14.615ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2182026-10-23T22:43:15.546ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2192026-10-23T22:43:15.550ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
2202026-10-23T22:43:15.553ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2212026-10-23T22:43:16.143ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2222026-10-23T22:43:16.148ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
2232026-10-23T22:43:16.151ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2242026-10-23T22:43:17.238ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2252026-10-23T22:43:17.243ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
2262026-10-23T22:43:17.246ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2272026-10-23T22:43:18.215ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2282026-10-23T22:43:18.221ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
2292026-10-23T22:43:18.224ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2302026-10-23T22:43:18.382ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 17195656586748066456 n_samples = 6 unit = oximeter
2312026-10-23T22:43:19.012ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2322026-10-23T22:43:19.018ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
2332026-10-23T22:43:19.022ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2342026-10-23T22:43:19.466ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 16038591658783834674 n_samples = 6 unit = oximeter
2352026-10-23T22:43:20.165ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2362026-10-23T22:43:20.170ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
2372026-10-23T22:43:20.173ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2382026-10-23T22:43:20.991ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2392026-10-23T22:43:20.995ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
2402026-10-23T22:43:20.998ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2412026-10-23T22:43:22.392ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2422026-10-23T22:43:22.397ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
2432026-10-23T22:43:22.400ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2442026-10-23T22:43:23.715ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", source: TimedOut }) unit = producer-server
2452026-10-23T22:43:23.716ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 5 delay = 55.361142251s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
2462026-10-23T22:43:23.889ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2472026-10-23T22:43:23.894ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
2482026-10-23T22:43:23.897ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2492026-10-23T22:43:25.323ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2502026-10-23T22:43:25.327ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
2512026-10-23T22:43:25.330ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2522026-10-23T22:43:26.105ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2532026-10-23T22:43:26.110ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
2542026-10-23T22:43:26.113ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2552026-10-23T22:43:26.776ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2562026-10-23T22:43:26.781ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
2572026-10-23T22:43:26.783ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2582026-10-23T22:43:28.054ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2592026-10-23T22:43:28.059ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
2602026-10-23T22:43:28.062ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2612026-10-23T22:43:28.376ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 17195656586748066456 n_samples = 6 unit = oximeter
2622026-10-23T22:43:29.024ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2632026-10-23T22:43:29.029ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
2642026-10-23T22:43:29.031ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2652026-10-23T22:43:29.292ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("18c3c7a4-2d25-47f8-b487-f981af3791b3.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("3dc19e6c-ffc1-4818-983a-58e7767e485b.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("e613c475-fec5-48e0-b69e-0c4bc47e48d0.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("e613c475-fec5-48e0-b69e-0c4bc47e48d0.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::c)) }], valid_until: Instant { tv_sec: 639, tv_nsec: 816977344 } }) unit = producer-server
2662026-10-23T22:43:29.293ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::a]:12221 unit = producer-server
2672026-10-23T22:43:29.303ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
2682026-10-23T22:43:29.590ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 16038591658783834674 n_samples = 6 unit = oximeter
2692026-10-23T22:43:30.094ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2702026-10-23T22:43:30.100ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
2712026-10-23T22:43:30.103ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2722026-10-23T22:43:31.129ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2732026-10-23T22:43:31.135ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
2742026-10-23T22:43:31.138ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2752026-10-23T22:43:31.879ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2762026-10-23T22:43:31.884ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
2772026-10-23T22:43:31.887ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2782026-10-23T22:43:32.551ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2792026-10-23T22:43:32.556ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
2802026-10-23T22:43:32.558ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2812026-10-23T22:43:33.449ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2822026-10-23T22:43:33.453ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
2832026-10-23T22:43:33.455ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2842026-10-23T22:43:34.726ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2852026-10-23T22:43:34.732ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
2862026-10-23T22:43:34.735ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2872026-10-23T22:43:35.683ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2882026-10-23T22:43:35.688ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
2892026-10-23T22:43:35.691ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2902026-10-23T22:43:36.427ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2912026-10-23T22:43:36.432ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
2922026-10-23T22:43:36.434ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2932026-10-23T22:43:37.546ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2942026-10-23T22:43:37.551ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
2952026-10-23T22:43:37.553ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2962026-10-23T22:43:38.378ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 17195656586748066456 n_samples = 6 unit = oximeter
2972026-10-23T22:43:38.997ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2982026-10-23T22:43:39.001ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
2992026-10-23T22:43:39.003ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3002026-10-23T22:43:39.592ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 16038591658783834674 n_samples = 6 unit = oximeter
3012026-10-23T22:43:39.632ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3022026-10-23T22:43:39.637ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
3032026-10-23T22:43:39.639ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3042026-10-23T22:43:40.291ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3052026-10-23T22:43:40.296ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
3062026-10-23T22:43:40.298ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3072026-10-23T22:43:41.133ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3082026-10-23T22:43:41.138ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
3092026-10-23T22:43:41.141ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3102026-10-23T22:43:42.222ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3112026-10-23T22:43:42.227ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
3122026-10-23T22:43:42.230ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3132026-10-23T22:43:43.134ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3142026-10-23T22:43:43.139ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
3152026-10-23T22:43:43.142ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3162026-10-23T22:43:44.183ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3172026-10-23T22:43:44.188ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
3182026-10-23T22:43:44.190ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3192026-10-23T22:43:44.305ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", source: TimedOut }) unit = producer-server
3202026-10-23T22:43:44.306ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 6 delay = 75.951189596s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
3212026-10-23T22:43:45.098ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3222026-10-23T22:43:45.102ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
3232026-10-23T22:43:45.105ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3242026-10-23T22:43:45.684ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3252026-10-23T22:43:45.688ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
3262026-10-23T22:43:45.691ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3272026-10-23T22:43:47.081ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3282026-10-23T22:43:47.085ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
3292026-10-23T22:43:47.088ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3302026-10-23T22:43:48.379ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 17195656586748066456 n_samples = 6 unit = oximeter
3312026-10-23T22:43:48.505ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3322026-10-23T22:43:48.509ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
3332026-10-23T22:43:48.512ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3342026-10-23T22:43:49.420ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3352026-10-23T22:43:49.424ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
3362026-10-23T22:43:49.427ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3372026-10-23T22:43:49.594ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 16038591658783834674 n_samples = 6 unit = oximeter
3382026-10-23T22:43:50.759ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3392026-10-23T22:43:50.764ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
3402026-10-23T22:43:50.767ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3412026-10-23T22:43:52.218ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3422026-10-23T22:43:52.223ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
3432026-10-23T22:43:52.226ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3442026-10-23T22:43:52.318ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("18c3c7a4-2d25-47f8-b487-f981af3791b3.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("3dc19e6c-ffc1-4818-983a-58e7767e485b.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("e613c475-fec5-48e0-b69e-0c4bc47e48d0.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("e613c475-fec5-48e0-b69e-0c4bc47e48d0.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::c)) }], valid_until: Instant { tv_sec: 662, tv_nsec: 843227151 } }) unit = producer-server
3452026-10-23T22:43:52.319ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::a]:12221 unit = producer-server
3462026-10-23T22:43:52.327ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
3472026-10-23T22:43:53.560ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3482026-10-23T22:43:53.565ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
3492026-10-23T22:43:53.568ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3502026-10-23T22:43:54.258ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3512026-10-23T22:43:54.263ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
3522026-10-23T22:43:54.266ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3532026-10-23T22:43:55.366ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3542026-10-23T22:43:55.371ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
3552026-10-23T22:43:55.374ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3562026-10-23T22:43:56.616ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3572026-10-23T22:43:56.621ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
3582026-10-23T22:43:56.624ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3592026-10-23T22:43:58.040ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3602026-10-23T22:43:58.045ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
3612026-10-23T22:43:58.048ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3622026-10-23T22:43:58.380ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 17195656586748066456 n_samples = 6 unit = oximeter
3632026-10-23T22:43:59.305ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3642026-10-23T22:43:59.309ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
3652026-10-23T22:43:59.312ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3662026-10-23T22:43:59.596ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 16038591658783834674 n_samples = 6 unit = oximeter
3672026-10-23T22:43:59.915ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3682026-10-23T22:43:59.920ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
3692026-10-23T22:43:59.922ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3702026-10-23T22:44:01.289ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3712026-10-23T22:44:01.294ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
3722026-10-23T22:44:01.297ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3732026-10-23T22:44:02.751ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3742026-10-23T22:44:02.756ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
3752026-10-23T22:44:02.759ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3762026-10-23T22:44:03.796ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3772026-10-23T22:44:03.800ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
3782026-10-23T22:44:03.803ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3792026-10-23T22:44:04.644ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3802026-10-23T22:44:04.648ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
3812026-10-23T22:44:04.652ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3822026-10-23T22:44:05.644ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3832026-10-23T22:44:05.649ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
3842026-10-23T22:44:05.652ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3852026-10-23T22:44:06.205ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3862026-10-23T22:44:06.209ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
3872026-10-23T22:44:06.212ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3882026-10-23T22:44:07.328ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", source: TimedOut }) unit = producer-server
3892026-10-23T22:44:07.329ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 7 delay = 98.973722503s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
3902026-10-23T22:44:07.529ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3912026-10-23T22:44:07.534ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
3922026-10-23T22:44:07.537ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3932026-10-23T22:44:08.381ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 17195656586748066456 n_samples = 6 unit = oximeter
3942026-10-23T22:44:08.437ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3952026-10-23T22:44:08.442ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
3962026-10-23T22:44:08.445ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3972026-10-23T22:44:09.546ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3982026-10-23T22:44:09.551ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
3992026-10-23T22:44:09.553ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4002026-10-23T22:44:09.598ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 16038591658783834674 n_samples = 6 unit = oximeter
4012026-10-23T22:44:10.452ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4022026-10-23T22:44:10.458ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
4032026-10-23T22:44:10.461ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4042026-10-23T22:44:11.576ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4052026-10-23T22:44:11.582ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
4062026-10-23T22:44:11.585ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4072026-10-23T22:44:12.121ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4082026-10-23T22:44:12.125ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
4092026-10-23T22:44:12.128ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4102026-10-23T22:44:13.576ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4112026-10-23T22:44:13.582ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
4122026-10-23T22:44:13.586ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4132026-10-23T22:44:14.466ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4142026-10-23T22:44:14.473ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
4152026-10-23T22:44:14.477ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4162026-10-23T22:44:15.172ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4172026-10-23T22:44:15.177ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
4182026-10-23T22:44:15.179ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4192026-10-23T22:44:16.389ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4202026-10-23T22:44:16.397ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
4212026-10-23T22:44:16.401ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4222026-10-23T22:44:18.130ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4232026-10-23T22:44:18.856ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 17195656586748066456 n_samples = 6 unit = oximeter
4242026-10-23T22:44:18.900ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
4252026-10-23T22:44:22.077ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4262026-10-23T22:44:22.079ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 16038591658783834674 n_samples = 6 unit = oximeter
4272026-10-23T22:44:23.205ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4282026-10-23T22:44:23.258ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
4292026-10-23T22:44:23.296ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4302026-10-23T22:44:26.162ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4312026-10-23T22:44:26.170ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
4322026-10-23T22:44:26.176ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4332026-10-23T22:44:27.232ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4342026-10-23T22:44:27.238ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
4352026-10-23T22:44:27.242ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4362026-10-23T22:44:27.863ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4372026-10-23T22:44:27.870ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
4382026-10-23T22:44:27.875ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4392026-10-23T22:44:28.543ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4402026-10-23T22:44:28.549ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
4412026-10-23T22:44:28.554ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4422026-10-23T22:44:28.859ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 17195656586748066456 n_samples = 6 unit = oximeter
4432026-10-23T22:44:29.893ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4442026-10-23T22:44:29.899ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
4452026-10-23T22:44:29.903ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4462026-10-23T22:44:30.678ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4472026-10-23T22:44:30.692ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
4482026-10-23T22:44:30.696ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4492026-10-23T22:44:31.466ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4502026-10-23T22:44:31.474ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
4512026-10-23T22:44:31.478ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4522026-10-23T22:44:32.083ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 16038591658783834674 n_samples = 6 unit = oximeter
4532026-10-23T22:44:32.757ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4542026-10-23T22:44:32.765ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
4552026-10-23T22:44:32.770ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4562026-10-23T22:44:33.759ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4572026-10-23T22:44:33.766ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
4582026-10-23T22:44:33.770ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4592026-10-23T22:44:35.034ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4602026-10-23T22:44:35.042ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
4612026-10-23T22:44:35.046ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4622026-10-23T22:44:36.294ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4632026-10-23T22:44:36.301ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
4642026-10-23T22:44:36.305ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4652026-10-23T22:44:36.468ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("18c3c7a4-2d25-47f8-b487-f981af3791b3.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("3dc19e6c-ffc1-4818-983a-58e7767e485b.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("e613c475-fec5-48e0-b69e-0c4bc47e48d0.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("e613c475-fec5-48e0-b69e-0c4bc47e48d0.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::c)) }], valid_until: Instant { tv_sec: 706, tv_nsec: 990325649 } }) unit = producer-server
4662026-10-23T22:44:36.470ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::a]:12221 unit = producer-server
4672026-10-23T22:44:36.504ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
4682026-10-23T22:44:37.037ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4692026-10-23T22:44:37.041ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
4702026-10-23T22:44:37.044ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4712026-10-23T22:44:38.080ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4722026-10-23T22:44:38.087ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
4732026-10-23T22:44:38.090ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4742026-10-23T22:44:38.863ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 17195656586748066456 n_samples = 6 unit = oximeter
4752026-10-23T22:44:39.442ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4762026-10-23T22:44:39.447ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
4772026-10-23T22:44:39.450ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4782026-10-23T22:44:40.334ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4792026-10-23T22:44:40.337ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
4802026-10-23T22:44:40.340ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4812026-10-23T22:44:41.494ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4822026-10-23T22:44:41.500ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
4832026-10-23T22:44:41.502ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4842026-10-23T22:44:42.086ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 16038591658783834674 n_samples = 6 unit = oximeter
4852026-10-23T22:44:42.997ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4862026-10-23T22:44:43.002ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
4872026-10-23T22:44:43.005ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4882026-10-23T22:44:44.305ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4892026-10-23T22:44:44.309ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
4902026-10-23T22:44:44.311ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4912026-10-23T22:44:45.081ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4922026-10-23T22:44:45.089ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
4932026-10-23T22:44:45.099ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4942026-10-23T22:44:46.186ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4952026-10-23T22:44:46.190ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
4962026-10-23T22:44:46.193ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4972026-10-23T22:44:47.335ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4982026-10-23T22:44:47.341ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
4992026-10-23T22:44:47.346ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5002026-10-23T22:44:48.649ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5012026-10-23T22:44:48.656ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
5022026-10-23T22:44:48.660ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5032026-10-23T22:44:48.867ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 17195656586748066456 n_samples = 6 unit = oximeter
5042026-10-23T22:44:49.181ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5052026-10-23T22:44:49.190ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
5062026-10-23T22:44:49.195ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5072026-10-23T22:44:50.667ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5082026-10-23T22:44:50.673ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
5092026-10-23T22:44:50.677ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5102026-10-23T22:44:51.507ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", source: TimedOut }) unit = producer-server
5112026-10-23T22:44:51.510ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 8 delay = 143.154503226s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
5122026-10-23T22:44:51.761ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5132026-10-23T22:44:51.767ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
5142026-10-23T22:44:51.770ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5152026-10-23T22:44:52.089ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 16038591658783834674 n_samples = 6 unit = oximeter
5162026-10-23T22:44:53.279ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5172026-10-23T22:44:53.285ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
5182026-10-23T22:44:53.288ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5192026-10-23T22:44:54.470ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5202026-10-23T22:44:54.478ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
5212026-10-23T22:44:54.482ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5222026-10-23T22:44:55.247ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5232026-10-23T22:44:55.253ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
5242026-10-23T22:44:55.255ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5252026-10-23T22:44:56.358ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5262026-10-23T22:44:56.366ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
5272026-10-23T22:44:56.369ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5282026-10-23T22:44:57.463ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5292026-10-23T22:44:57.468ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
5302026-10-23T22:44:57.471ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5312026-10-23T22:44:58.517ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5322026-10-23T22:44:58.522ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
5332026-10-23T22:44:58.525ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5342026-10-23T22:44:58.870ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 17195656586748066456 n_samples = 6 unit = oximeter
5352026-10-23T22:44:59.540ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5362026-10-23T22:44:59.556ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
5372026-10-23T22:44:59.559ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5382026-10-23T22:45:00.319ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5392026-10-23T22:45:00.325ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::b45f:20ff:fe1e:50a0]
5402026-10-23T22:45:00.328ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]