Max level shown:
1 [ Nov 4 06:26:06 Enabled. ]
2 [ Nov 4 06:26:06 Rereading configuration. ]
3 [ Nov 4 06:26:06 Rereading configuration. ]
4 [ Nov 4 06:26:18 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dendrite/bin/tfportd --sync-only &"). ]
5 [ Nov 4 06:26:18 Method "start" exited with status 0. ]
6 No non-localhost IPv6 addresses found in SMF properties
72026-11-04T06:26:18.287ZINFOtfportd: connecting to dpd host = [::1] port = 12224
82026-11-04T06:26:18.289ZINFOtfportd: connected to dpd running softnpu-a133c73e
92026-11-04T06:26:18.289ZINFOtfportd: running in sync-only mode
102026-11-04T06:26:18.289ZINFOtfportd: no non-localhost IPv6 listen address available, waiting for SMF update unit = oximeter
112026-11-04T06:26:18.290ZINFOtfportd: refreshing SMF config prior to waiting on signals unit = signal_handler
12 No non-localhost IPv6 addresses found in SMF properties
132026-11-04T06:26:18.291ZINFOtfportd: refreshed config: Config { log_file: None, log_format: Json, listen_addresses: [ [::1]:12231, ], pkt_source: None, dpd_host: "[::1]", dpd_port: 12224, vlan_link: None, vlan_data: None, techport0_prefix: None, techport1_prefix: None, rack_id: Some( 3496dcef-98fb-4de3-a2a6-d02e499bbc89, ), sled_id: Some( c6cbfd00-b06b-4532-9e66-158e6379a779, ), sled_model: Some( "i86pc", ), sled_revision: Some( 0, ), sled_serial: Some( "buskin", ), }
142026-11-04T06:26:18.291ZINFOtfportd: no non-localhost IPv6 listen address available, waiting for SMF update unit = oximeter
152026-11-04T06:26:18.298ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::f830:89ff:fe09:983d->fa:30:89:09:98:3d interface = tfportrear0_0
162026-11-04T06:26:18.298ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
172026-11-04T06:26:18.303ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
182026-11-04T06:26:18.308ZWARNtfportd: tfportqsfp0_0 has no addrs
19 [ Nov 4 06:26:18 Rereading configuration. ]
20 [ Nov 4 06:26:18 Executing refresh method (:kill). ]
21 [ Nov 4 06:26:18 Stopping because all processes in service exited. ]
22 [ Nov 4 06:26:18 Executing stop method (:kill). ]
23 [ Nov 4 06:26:18 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dendrite/bin/tfportd --sync-only &"). ]
24 [ Nov 4 06:26:18 Method "start" exited with status 0. ]
252026-11-04T06:26:19.015ZINFOtfportd: connecting to dpd host = [::1] port = 12224
262026-11-04T06:26:19.016ZINFOtfportd: connected to dpd running softnpu-a133c73e
272026-11-04T06:26:19.017ZINFOtfportd: running in sync-only mode
282026-11-04T06:26:19.017ZINFOtfportd: found suitable IPv6 address for oximeter producer server address = fd00:1122:3344:101::2 unit = oximeter
292026-11-04T06:26:19.017ZINFOtfportd: refreshing SMF config prior to waiting on signals unit = signal_handler
302026-11-04T06:26:19.017ZDEBGtfportd: extracted oximeter configuration data config = OximeterConfig { listen_address: fd00:1122:3344:101::2, sled_identifiers: SledIdentifiers { rack_id: 3496dcef-98fb-4de3-a2a6-d02e499bbc89, sled_id: c6cbfd00-b06b-4532-9e66-158e6379a779, model: "i86pc", revision: 0, serial: "buskin" }, switch_identifiers: SwitchIdentifiers { asic_backend: "softnpu", fab: None, fuse: Some(FuseData { chip_rev: ChipRevision { device_id: 272, rev: "B1", rev_num: 2 }, disabled: DisabledFeatures { bsync: false, mau: [0, 0, 0, 0], pgen: false, pipes: 0, ports: 0, resub: false, speeds: 0, tm_mem: 0 }, frequency: FrequencySettings { bps: 3, bps_ext: 0, cpu_speed_dis: 0, disabled: false, pcie_dis: 0, pps: 3, pps_ext: 0 }, manufacturing: ManufacturingData { core_repair: false, die_rotation: false, pmro_and_skew: 0, silent_spin: 0, soft_pipe_dis: 0, tile_repair: false, voltage_scaling: 0, wf_core_repair: false }, part: PartInfo { part_num: 4660, pkg_id: 1, version: 2 } }), lot: None, lotnum: None, model: "FAKE_SIM_SIDECAR", revision: 0, serial: "SimSidecar0", sidecar_id: 67b9a4d8-5b86-47cd-b257-4cdb2d2f674a, slot: 0, wafer: None, wafer_loc: None } } unit = oximeter
312026-11-04T06:26:19.017ZDEBGtfportd: created producer ID producer_id = 95e48537-7316-4f1c-8e97-897b07cd7cbb unit = oximeter
322026-11-04T06:26:19.018ZINFOtfportd: refreshed config: Config { log_file: None, log_format: Json, listen_addresses: [ [fd00:1122:3344:101::2]:12231, [::1]:12231, ], pkt_source: None, dpd_host: "[::1]", dpd_port: 12224, vlan_link: None, vlan_data: None, techport0_prefix: None, techport1_prefix: None, rack_id: Some( 3496dcef-98fb-4de3-a2a6-d02e499bbc89, ), sled_id: Some( c6cbfd00-b06b-4532-9e66-158e6379a779, ), sled_model: Some( "i86pc", ), sled_revision: Some( 0, ), sled_serial: Some( "buskin", ), }
332026-11-04T06:26:19.027ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
342026-11-04T06:26:19.028ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::f830:89ff:fe09:983d->fa:30:89:09:98:3d interface = tfportrear0_0
352026-11-04T06:26:19.030ZDEBGtfportd: registered DTrace probes unit = producer-server
362026-11-04T06:26:19.031ZDEBGtfportd (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::2]:56081 method = GET path = /{producer_id} unit = producer-server versions = all
372026-11-04T06:26:19.031ZINFOtfportd (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:328 local_addr = [fd00:1122:3344:101::2]:56081 unit = producer-server
382026-11-04T06:26:19.031ZDEBGtfportd (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::2]:56081 unit = producer-server
392026-11-04T06:26:19.031ZDEBGtfportd: Requested any available port, Dropshot server has been bound to [fd00:1122:3344:101::2]:56081 unit = producer-server
402026-11-04T06:26:19.031ZDEBGtfportd: Nexus IP not provided, will use DNS to resolve it unit = producer-server
412026-11-04T06:26:19.031ZINFOtfportd (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/internal-dns/resolver/src/resolver.rs:144 unit = producer-server
422026-11-04T06:26:19.032ZDEBGtfportd: starting producer registration task unit = producer-server
432026-11-04T06:26:19.032ZINFOtfportd: starting oximeter metric producer server address = [fd00:1122:3344:101::2]:56081 file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:279 interval = 30s producer_id = 95e48537-7316-4f1c-8e97-897b07cd7cbb unit = producer-server
442026-11-04T06:26:19.032ZINFOtfportd: created oximeter producer server unit = oximeter
452026-11-04T06:26:19.032ZDEBGtfportd (producer-registration-task): registering as oximeter producer with Nexus registration_count = 0 unit = producer-server
462026-11-04T06:26:19.032ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
472026-11-04T06:26:19.032ZDEBGtfportd (kstat-sampler): adding new target unit = oximeter
482026-11-04T06:26:19.033ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("815de21c-cec7-4efe-b443-9c4bd66f9891.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("84ea4e0f-e7b3-4c42-b615-b8115a84187a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("bbe38990-2db5-4228-9cbe-2e1051887a5a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("bbe38990-2db5-4228-9cbe-2e1051887a5a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 575, tv_nsec: 80299446 } }) unit = producer-server
492026-11-04T06:26:19.033ZDEBGtfportd (kstat-sampler-worker): storing new creation time for tracked target creation_time = 2026-11-04T06:26:01.679422656Z path = KstatPath { module: "link", instance: 0, name: "tfportrear0_0" } unit = oximeter
502026-11-04T06:26:19.033ZDEBGtfportd (kstat-sampler-worker): inserted empty per-target sample queue id = 9068758614355475296 unit = oximeter
512026-11-04T06:26:19.033ZDEBGtfportd: added new link to kstat sampler link_kind = switch-port-control link_name = tfportrear0_0 unit = metrics-task-tracker
522026-11-04T06:26:19.034ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::a]:12221 unit = producer-server
532026-11-04T06:26:19.035ZWARNtfportd: tfportqsfp0_0 has no addrs
542026-11-04T06:26:19.050ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
552026-11-04T06:26:19.887ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
562026-11-04T06:26:19.891ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
572026-11-04T06:26:19.894ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
582026-11-04T06:26:19.895ZDEBGtfportd (kstat-sampler): adding new target unit = oximeter
592026-11-04T06:26:19.896ZDEBGtfportd (kstat-sampler-worker): storing new creation time for tracked target creation_time = 2026-11-04T06:26:01.679290163Z path = KstatPath { module: "link", instance: 0, name: "tfportqsfp0_0" } unit = oximeter
602026-11-04T06:26:19.896ZDEBGtfportd (kstat-sampler-worker): inserted empty per-target sample queue id = 18246307331050382929 unit = oximeter
612026-11-04T06:26:19.896ZDEBGtfportd: added new link to kstat sampler link_kind = switch-port-control link_name = tfportqsfp0_0 unit = metrics-task-tracker
622026-11-04T06:26:20.109ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::580d:8aff:fe08:d0e5->5a:0d:8a:08:d0:e5 interface = tfportrear0_0
632026-11-04T06:26:20.442ZINFOtfportd: added new ARP entry entry = 10.151.1.174->1e:ea:2e:55:37:bf interface = tfportqsfp0_0
642026-11-04T06:26:21.246ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
652026-11-04T06:26:21.250ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
662026-11-04T06:26:21.253ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
672026-11-04T06:26:22.592ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
682026-11-04T06:26:22.596ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
692026-11-04T06:26:22.599ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
702026-11-04T06:26:23.723ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
712026-11-04T06:26:23.727ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
722026-11-04T06:26:23.730ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
732026-11-04T06:26:25.107ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
742026-11-04T06:26:25.111ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
752026-11-04T06:26:25.113ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
762026-11-04T06:26:25.764ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
772026-11-04T06:26:25.769ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
782026-11-04T06:26:25.772ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
792026-11-04T06:26:26.848ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
802026-11-04T06:26:26.852ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
812026-11-04T06:26:26.854ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
822026-11-04T06:26:28.195ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
832026-11-04T06:26:28.199ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
842026-11-04T06:26:28.202ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
852026-11-04T06:26:29.036ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 9068758614355475296 n_samples = 6 unit = oximeter
862026-11-04T06:26:29.601ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
872026-11-04T06:26:29.605ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
882026-11-04T06:26:29.607ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
892026-11-04T06:26:29.899ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 18246307331050382929 n_samples = 6 unit = oximeter
902026-11-04T06:26:30.574ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
912026-11-04T06:26:30.579ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
922026-11-04T06:26:30.582ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
932026-11-04T06:26:31.448ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
942026-11-04T06:26:31.453ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
952026-11-04T06:26:31.456ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
962026-11-04T06:26:32.278ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
972026-11-04T06:26:32.283ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
982026-11-04T06:26:32.285ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
992026-11-04T06:26:33.522ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1002026-11-04T06:26:33.526ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
1012026-11-04T06:26:33.529ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1022026-11-04T06:26:34.049ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", source: TimedOut }) unit = producer-server
1032026-11-04T06:26:34.050ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 0 delay = 15.021080457s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
1042026-11-04T06:26:34.262ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1052026-11-04T06:26:34.266ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
1062026-11-04T06:26:34.269ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1072026-11-04T06:26:34.405ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("815de21c-cec7-4efe-b443-9c4bd66f9891.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("84ea4e0f-e7b3-4c42-b615-b8115a84187a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("bbe38990-2db5-4228-9cbe-2e1051887a5a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("bbe38990-2db5-4228-9cbe-2e1051887a5a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 590, tv_nsec: 456371851 } }) unit = producer-server
1082026-11-04T06:26:34.406ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::a]:12221 unit = producer-server
1092026-11-04T06:26:34.412ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
1102026-11-04T06:26:35.506ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1112026-11-04T06:26:35.514ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
1122026-11-04T06:26:35.516ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1132026-11-04T06:26:36.500ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1142026-11-04T06:26:36.504ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
1152026-11-04T06:26:36.507ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1162026-11-04T06:26:37.654ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1172026-11-04T06:26:37.659ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
1182026-11-04T06:26:37.662ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1192026-11-04T06:26:38.407ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1202026-11-04T06:26:38.411ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
1212026-11-04T06:26:38.413ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1222026-11-04T06:26:39.021ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 9068758614355475296 n_samples = 6 unit = oximeter
1232026-11-04T06:26:39.750ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1242026-11-04T06:26:39.755ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
1252026-11-04T06:26:39.757ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1262026-11-04T06:26:39.879ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 18246307331050382929 n_samples = 6 unit = oximeter
1272026-11-04T06:26:40.734ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1282026-11-04T06:26:40.738ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
1292026-11-04T06:26:40.740ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1302026-11-04T06:26:42.141ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1312026-11-04T06:26:42.146ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
1322026-11-04T06:26:42.148ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1332026-11-04T06:26:42.830ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1342026-11-04T06:26:42.834ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
1352026-11-04T06:26:42.836ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1362026-11-04T06:26:44.287ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1372026-11-04T06:26:44.291ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
1382026-11-04T06:26:44.294ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1392026-11-04T06:26:45.271ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1402026-11-04T06:26:45.275ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
1412026-11-04T06:26:45.278ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1422026-11-04T06:26:46.462ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1432026-11-04T06:26:46.466ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
1442026-11-04T06:26:46.469ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1452026-11-04T06:26:47.801ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1462026-11-04T06:26:47.806ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
1472026-11-04T06:26:47.809ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1482026-11-04T06:26:48.897ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1492026-11-04T06:26:48.903ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
1502026-11-04T06:26:48.906ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1512026-11-04T06:26:48.995ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 9068758614355475296 n_samples = 6 unit = oximeter
1522026-11-04T06:26:49.385ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", source: TimedOut }) unit = producer-server
1532026-11-04T06:26:49.385ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 1 delay = 30.386737703s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
1542026-11-04T06:26:49.855ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 18246307331050382929 n_samples = 6 unit = oximeter
1552026-11-04T06:26:49.927ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("815de21c-cec7-4efe-b443-9c4bd66f9891.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("84ea4e0f-e7b3-4c42-b615-b8115a84187a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("bbe38990-2db5-4228-9cbe-2e1051887a5a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("bbe38990-2db5-4228-9cbe-2e1051887a5a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 606, tv_nsec: 21727090 } }) unit = producer-server
1562026-11-04T06:26:49.928ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::a]:12221 unit = producer-server
1572026-11-04T06:26:49.937ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
1582026-11-04T06:26:50.149ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1592026-11-04T06:26:50.154ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
1602026-11-04T06:26:50.157ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1612026-11-04T06:26:51.361ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1622026-11-04T06:26:51.366ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
1632026-11-04T06:26:51.369ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1642026-11-04T06:26:52.842ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1652026-11-04T06:26:52.847ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
1662026-11-04T06:26:52.849ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1672026-11-04T06:26:53.932ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1682026-11-04T06:26:53.937ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
1692026-11-04T06:26:53.941ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1702026-11-04T06:26:55.209ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1712026-11-04T06:26:55.218ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
1722026-11-04T06:26:55.223ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1732026-11-04T06:26:56.512ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1742026-11-04T06:26:56.516ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
1752026-11-04T06:26:56.519ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1762026-11-04T06:26:57.993ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1772026-11-04T06:26:57.998ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
1782026-11-04T06:26:58.001ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1792026-11-04T06:26:58.970ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 9068758614355475296 n_samples = 6 unit = oximeter
1802026-11-04T06:26:59.278ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1812026-11-04T06:26:59.282ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
1822026-11-04T06:26:59.284ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1832026-11-04T06:26:59.841ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 18246307331050382929 n_samples = 6 unit = oximeter
1842026-11-04T06:26:59.847ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1852026-11-04T06:26:59.852ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
1862026-11-04T06:26:59.854ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1872026-11-04T06:27:00.874ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1882026-11-04T06:27:00.880ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
1892026-11-04T06:27:00.884ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1902026-11-04T06:27:01.980ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1912026-11-04T06:27:01.986ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
1922026-11-04T06:27:01.990ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1932026-11-04T06:27:03.374ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1942026-11-04T06:27:03.378ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
1952026-11-04T06:27:03.381ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1962026-11-04T06:27:04.079ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1972026-11-04T06:27:04.083ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
1982026-11-04T06:27:04.086ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1992026-11-04T06:27:04.897ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", source: TimedOut }) unit = producer-server
2002026-11-04T06:27:04.898ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 2 delay = 45.954362168s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
2012026-11-04T06:27:05.419ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2022026-11-04T06:27:05.424ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
2032026-11-04T06:27:05.427ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2042026-11-04T06:27:05.506ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("815de21c-cec7-4efe-b443-9c4bd66f9891.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("84ea4e0f-e7b3-4c42-b615-b8115a84187a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("bbe38990-2db5-4228-9cbe-2e1051887a5a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("bbe38990-2db5-4228-9cbe-2e1051887a5a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 621, tv_nsec: 643380665 } }) unit = producer-server
2052026-11-04T06:27:05.507ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::a]:12221 unit = producer-server
2062026-11-04T06:27:05.512ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
2072026-11-04T06:27:06.813ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2082026-11-04T06:27:06.818ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
2092026-11-04T06:27:06.820ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2102026-11-04T06:27:08.213ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2112026-11-04T06:27:08.218ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
2122026-11-04T06:27:08.221ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2132026-11-04T06:27:08.954ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 9068758614355475296 n_samples = 6 unit = oximeter
2142026-11-04T06:27:09.403ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2152026-11-04T06:27:09.407ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
2162026-11-04T06:27:09.410ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2172026-11-04T06:27:09.827ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 18246307331050382929 n_samples = 6 unit = oximeter
2182026-11-04T06:27:10.419ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2192026-11-04T06:27:10.425ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
2202026-11-04T06:27:10.429ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2212026-11-04T06:27:11.305ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2222026-11-04T06:27:11.310ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
2232026-11-04T06:27:11.313ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2242026-11-04T06:27:12.087ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2252026-11-04T06:27:12.111ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
2262026-11-04T06:27:12.119ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2272026-11-04T06:27:13.309ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2282026-11-04T06:27:13.315ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
2292026-11-04T06:27:13.319ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2302026-11-04T06:27:14.038ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2312026-11-04T06:27:14.042ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
2322026-11-04T06:27:14.045ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2332026-11-04T06:27:14.585ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2342026-11-04T06:27:14.590ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
2352026-11-04T06:27:14.593ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2362026-11-04T06:27:15.977ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2372026-11-04T06:27:15.980ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
2382026-11-04T06:27:15.982ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2392026-11-04T06:27:17.179ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2402026-11-04T06:27:17.184ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
2412026-11-04T06:27:17.187ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2422026-11-04T06:27:17.697ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2432026-11-04T06:27:17.703ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
2442026-11-04T06:27:17.706ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2452026-11-04T06:27:18.463ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2462026-11-04T06:27:18.468ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
2472026-11-04T06:27:18.471ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2482026-11-04T06:27:18.955ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 9068758614355475296 n_samples = 6 unit = oximeter
2492026-11-04T06:27:19.828ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 18246307331050382929 n_samples = 6 unit = oximeter
2502026-11-04T06:27:19.971ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2512026-11-04T06:27:19.975ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
2522026-11-04T06:27:19.978ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2532026-11-04T06:27:20.513ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", source: TimedOut }) unit = producer-server
2542026-11-04T06:27:20.514ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 3 delay = 61.572268769s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
2552026-11-04T06:27:21.483ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2562026-11-04T06:27:21.488ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
2572026-11-04T06:27:21.490ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2582026-11-04T06:27:22.038ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2592026-11-04T06:27:22.043ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
2602026-11-04T06:27:22.046ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2612026-11-04T06:27:22.938ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("815de21c-cec7-4efe-b443-9c4bd66f9891.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("84ea4e0f-e7b3-4c42-b615-b8115a84187a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("bbe38990-2db5-4228-9cbe-2e1051887a5a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("bbe38990-2db5-4228-9cbe-2e1051887a5a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 639, tv_nsec: 75759065 } }) unit = producer-server
2622026-11-04T06:27:22.939ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::a]:12221 unit = producer-server
2632026-11-04T06:27:22.944ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
2642026-11-04T06:27:23.517ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2652026-11-04T06:27:23.522ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
2662026-11-04T06:27:23.524ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2672026-11-04T06:27:24.980ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2682026-11-04T06:27:24.985ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
2692026-11-04T06:27:24.988ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2702026-11-04T06:27:26.022ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2712026-11-04T06:27:26.027ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
2722026-11-04T06:27:26.030ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2732026-11-04T06:27:27.009ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2742026-11-04T06:27:27.013ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
2752026-11-04T06:27:27.016ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2762026-11-04T06:27:28.293ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2772026-11-04T06:27:28.297ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
2782026-11-04T06:27:28.300ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2792026-11-04T06:27:28.900ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2802026-11-04T06:27:28.905ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
2812026-11-04T06:27:28.908ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2822026-11-04T06:27:28.956ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 9068758614355475296 n_samples = 6 unit = oximeter
2832026-11-04T06:27:29.513ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2842026-11-04T06:27:29.518ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
2852026-11-04T06:27:29.521ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2862026-11-04T06:27:29.830ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 18246307331050382929 n_samples = 6 unit = oximeter
2872026-11-04T06:27:30.287ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2882026-11-04T06:27:30.291ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
2892026-11-04T06:27:30.294ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2902026-11-04T06:27:30.833ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2912026-11-04T06:27:30.838ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
2922026-11-04T06:27:30.841ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2932026-11-04T06:27:31.991ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2942026-11-04T06:27:31.996ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
2952026-11-04T06:27:31.999ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2962026-11-04T06:27:32.930ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2972026-11-04T06:27:32.934ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
2982026-11-04T06:27:32.937ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2992026-11-04T06:27:33.980ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3002026-11-04T06:27:33.985ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
3012026-11-04T06:27:33.987ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3022026-11-04T06:27:35.405ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3032026-11-04T06:27:35.409ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
3042026-11-04T06:27:35.412ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3052026-11-04T06:27:36.820ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3062026-11-04T06:27:36.825ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
3072026-11-04T06:27:36.827ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3082026-11-04T06:27:37.945ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", source: TimedOut }) unit = producer-server
3092026-11-04T06:27:37.945ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 4 delay = 79.004031486s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
3102026-11-04T06:27:38.305ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3112026-11-04T06:27:38.310ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
3122026-11-04T06:27:38.312ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3132026-11-04T06:27:38.958ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 9068758614355475296 n_samples = 6 unit = oximeter
3142026-11-04T06:27:39.175ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3152026-11-04T06:27:39.179ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
3162026-11-04T06:27:39.182ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3172026-11-04T06:27:39.831ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 18246307331050382929 n_samples = 6 unit = oximeter
3182026-11-04T06:27:39.908ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3192026-11-04T06:27:39.912ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
3202026-11-04T06:27:39.915ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3212026-11-04T06:27:41.165ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3222026-11-04T06:27:41.170ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
3232026-11-04T06:27:41.172ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3242026-11-04T06:27:42.349ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3252026-11-04T06:27:42.439ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
3262026-11-04T06:27:42.444ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3272026-11-04T06:27:47.480ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("815de21c-cec7-4efe-b443-9c4bd66f9891.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("84ea4e0f-e7b3-4c42-b615-b8115a84187a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("bbe38990-2db5-4228-9cbe-2e1051887a5a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("bbe38990-2db5-4228-9cbe-2e1051887a5a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 663, tv_nsec: 617400306 } }) unit = producer-server
3282026-11-04T06:27:47.493ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::a]:12221 unit = producer-server
3292026-11-04T06:27:47.606ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3302026-11-04T06:27:47.623ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
3312026-11-04T06:27:47.628ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3322026-11-04T06:27:48.145ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
3332026-11-04T06:27:53.389ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 9068758614355475296 n_samples = 6 unit = oximeter
3342026-11-04T06:27:53.400ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 18246307331050382929 n_samples = 6 unit = oximeter
3352026-11-04T06:27:53.497ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3362026-11-04T06:27:53.507ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
3372026-11-04T06:27:53.521ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3382026-11-04T06:27:54.267ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3392026-11-04T06:27:54.274ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
3402026-11-04T06:27:54.279ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3412026-11-04T06:27:55.696ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3422026-11-04T06:27:55.704ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
3432026-11-04T06:27:55.709ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3442026-11-04T06:27:59.789ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3452026-11-04T06:27:59.887ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
3462026-11-04T06:28:00.053ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3472026-11-04T06:28:01.606ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3482026-11-04T06:28:01.614ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
3492026-11-04T06:28:01.619ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3502026-11-04T06:28:02.823ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3512026-11-04T06:28:02.832ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
3522026-11-04T06:28:02.837ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3532026-11-04T06:28:03.315ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", source: TimedOut }) unit = producer-server
3542026-11-04T06:28:03.330ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 5 delay = 104.388114721s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
3552026-11-04T06:28:03.562ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 9068758614355475296 n_samples = 6 unit = oximeter
3562026-11-04T06:28:03.564ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 18246307331050382929 n_samples = 6 unit = oximeter
3572026-11-04T06:28:03.573ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3582026-11-04T06:28:03.578ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
3592026-11-04T06:28:03.582ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3602026-11-04T06:28:04.328ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3612026-11-04T06:28:04.333ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
3622026-11-04T06:28:04.337ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3632026-11-04T06:28:05.804ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3642026-11-04T06:28:05.808ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
3652026-11-04T06:28:05.811ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3662026-11-04T06:28:06.504ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3672026-11-04T06:28:06.511ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
3682026-11-04T06:28:06.515ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3692026-11-04T06:28:07.531ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3702026-11-04T06:28:07.538ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
3712026-11-04T06:28:07.542ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3722026-11-04T06:28:08.149ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3732026-11-04T06:28:08.156ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
3742026-11-04T06:28:08.160ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3752026-11-04T06:28:09.166ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3762026-11-04T06:28:09.170ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
3772026-11-04T06:28:09.173ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3782026-11-04T06:28:10.602ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3792026-11-04T06:28:10.607ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
3802026-11-04T06:28:10.609ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3812026-11-04T06:28:10.963ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("815de21c-cec7-4efe-b443-9c4bd66f9891.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("84ea4e0f-e7b3-4c42-b615-b8115a84187a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("bbe38990-2db5-4228-9cbe-2e1051887a5a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("bbe38990-2db5-4228-9cbe-2e1051887a5a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 687, tv_nsec: 100292506 } }) unit = producer-server
3822026-11-04T06:28:10.965ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::a]:12221 unit = producer-server
3832026-11-04T06:28:11.022ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
3842026-11-04T06:28:11.167ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3852026-11-04T06:28:11.173ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
3862026-11-04T06:28:11.176ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3872026-11-04T06:28:11.804ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3882026-11-04T06:28:11.810ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
3892026-11-04T06:28:11.813ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3902026-11-04T06:28:12.865ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3912026-11-04T06:28:12.885ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
3922026-11-04T06:28:12.891ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3932026-11-04T06:28:13.564ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 9068758614355475296 n_samples = 6 unit = oximeter
3942026-11-04T06:28:13.567ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 18246307331050382929 n_samples = 6 unit = oximeter
3952026-11-04T06:28:13.746ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3962026-11-04T06:28:13.750ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
3972026-11-04T06:28:13.752ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3982026-11-04T06:28:15.097ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3992026-11-04T06:28:15.106ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
4002026-11-04T06:28:15.110ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4012026-11-04T06:28:15.773ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4022026-11-04T06:28:15.778ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
4032026-11-04T06:28:15.781ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4042026-11-04T06:28:17.194ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4052026-11-04T06:28:17.201ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
4062026-11-04T06:28:17.205ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4072026-11-04T06:28:18.189ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4082026-11-04T06:28:18.196ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
4092026-11-04T06:28:18.199ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4102026-11-04T06:28:19.536ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4112026-11-04T06:28:19.540ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
4122026-11-04T06:28:19.543ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4132026-11-04T06:28:20.805ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4142026-11-04T06:28:20.814ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
4152026-11-04T06:28:20.818ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4162026-11-04T06:28:21.980ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4172026-11-04T06:28:21.987ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
4182026-11-04T06:28:21.990ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4192026-11-04T06:28:22.985ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4202026-11-04T06:28:22.997ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
4212026-11-04T06:28:23.002ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4222026-11-04T06:28:23.568ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 9068758614355475296 n_samples = 6 unit = oximeter
4232026-11-04T06:28:23.569ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 18246307331050382929 n_samples = 6 unit = oximeter
4242026-11-04T06:28:23.570ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4252026-11-04T06:28:23.582ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
4262026-11-04T06:28:23.586ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4272026-11-04T06:28:25.036ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4282026-11-04T06:28:25.042ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
4292026-11-04T06:28:25.044ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4302026-11-04T06:28:26.023ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", source: TimedOut }) unit = producer-server
4312026-11-04T06:28:26.024ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 6 delay = 127.082382773s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
4322026-11-04T06:28:26.203ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4332026-11-04T06:28:26.208ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
4342026-11-04T06:28:26.211ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4352026-11-04T06:28:27.685ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4362026-11-04T06:28:27.691ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
4372026-11-04T06:28:27.694ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4382026-11-04T06:28:28.806ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4392026-11-04T06:28:28.811ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
4402026-11-04T06:28:28.814ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4412026-11-04T06:28:30.303ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4422026-11-04T06:28:30.309ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
4432026-11-04T06:28:30.312ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4442026-11-04T06:28:31.001ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4452026-11-04T06:28:31.008ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
4462026-11-04T06:28:31.011ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4472026-11-04T06:28:32.078ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4482026-11-04T06:28:32.087ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
4492026-11-04T06:28:32.092ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4502026-11-04T06:28:33.497ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4512026-11-04T06:28:33.505ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
4522026-11-04T06:28:33.509ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4532026-11-04T06:28:33.572ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 9068758614355475296 n_samples = 6 unit = oximeter
4542026-11-04T06:28:33.573ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 18246307331050382929 n_samples = 6 unit = oximeter
4552026-11-04T06:28:34.497ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4562026-11-04T06:28:34.503ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
4572026-11-04T06:28:34.507ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4582026-11-04T06:28:35.545ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4592026-11-04T06:28:35.550ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
4602026-11-04T06:28:35.553ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4612026-11-04T06:28:36.653ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4622026-11-04T06:28:36.657ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
4632026-11-04T06:28:36.660ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4642026-11-04T06:28:37.648ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4652026-11-04T06:28:37.653ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
4662026-11-04T06:28:37.656ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4672026-11-04T06:28:38.539ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("815de21c-cec7-4efe-b443-9c4bd66f9891.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("84ea4e0f-e7b3-4c42-b615-b8115a84187a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("bbe38990-2db5-4228-9cbe-2e1051887a5a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("bbe38990-2db5-4228-9cbe-2e1051887a5a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 714, tv_nsec: 676261368 } }) unit = producer-server
4682026-11-04T06:28:38.540ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::a]:12221 unit = producer-server
4692026-11-04T06:28:38.563ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
4702026-11-04T06:28:38.568ZDEBGtfportd (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", status: 503, headers: {"content-type": "application/json", "x-request-id": "c116d503-53de-4eac-abbd-6e0b176f9ed6", "content-length": "133", "date": "Wed, 04 Nov 2026 06:28:38 GMT"} }) unit = producer-server
4712026-11-04T06:28:38.569ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 7 delay = 139.627282228s error = "Error Response: status: 503 Service Unavailable; headers: {\\"content-type\\": \\"application/json\\", \\"x-request-id\\": \\"c116d503-53de-4eac-abbd-6e0b176f9ed6\\", \\"content-length\\": \\"133\\", \\"date\\": \\"Wed, 04 Nov 2026 06:28:38 GMT\\"}; value: Error { error_code: Some(\\"ServiceNotAvailable\\"), message: \\"Service Unavailable\\", request_id: \\"c116d503-53de-4eac-abbd-6e0b176f9ed6\\" }" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
4722026-11-04T06:28:38.919ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4732026-11-04T06:28:38.924ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
4742026-11-04T06:28:38.926ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4752026-11-04T06:28:39.851ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4762026-11-04T06:28:39.856ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
4772026-11-04T06:28:39.860ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4782026-11-04T06:28:40.556ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4792026-11-04T06:28:40.561ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
4802026-11-04T06:28:40.565ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4812026-11-04T06:28:41.763ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4822026-11-04T06:28:41.768ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
4832026-11-04T06:28:41.772ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4842026-11-04T06:28:43.157ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4852026-11-04T06:28:43.163ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
4862026-11-04T06:28:43.165ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4872026-11-04T06:28:43.576ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 9068758614355475296 n_samples = 6 unit = oximeter
4882026-11-04T06:28:43.576ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 18246307331050382929 n_samples = 6 unit = oximeter
4892026-11-04T06:28:44.431ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4902026-11-04T06:28:44.436ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
4912026-11-04T06:28:44.440ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4922026-11-04T06:28:45.553ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4932026-11-04T06:28:45.557ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
4942026-11-04T06:28:45.560ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4952026-11-04T06:28:46.515ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4962026-11-04T06:28:46.521ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
4972026-11-04T06:28:46.524ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4982026-11-04T06:28:47.956ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4992026-11-04T06:28:47.961ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
5002026-11-04T06:28:47.963ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5012026-11-04T06:28:48.913ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5022026-11-04T06:28:48.918ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
5032026-11-04T06:28:48.921ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5042026-11-04T06:28:49.848ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5052026-11-04T06:28:49.853ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
5062026-11-04T06:28:49.858ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5072026-11-04T06:28:50.388ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5082026-11-04T06:28:50.393ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
5092026-11-04T06:28:50.406ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5102026-11-04T06:28:51.170ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5112026-11-04T06:28:51.175ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
5122026-11-04T06:28:51.178ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5132026-11-04T06:28:52.641ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5142026-11-04T06:28:52.646ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
5152026-11-04T06:28:52.648ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5162026-11-04T06:28:53.531ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5172026-11-04T06:28:53.536ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
5182026-11-04T06:28:53.539ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5192026-11-04T06:28:53.578ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 9068758614355475296 n_samples = 6 unit = oximeter
5202026-11-04T06:28:53.579ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 18246307331050382929 n_samples = 6 unit = oximeter
5212026-11-04T06:28:54.568ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5222026-11-04T06:28:54.573ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
5232026-11-04T06:28:54.576ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5242026-11-04T06:28:55.232ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5252026-11-04T06:28:55.237ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
5262026-11-04T06:28:55.239ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5272026-11-04T06:28:56.741ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5282026-11-04T06:28:56.746ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
5292026-11-04T06:28:56.748ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5302026-11-04T06:28:57.809ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5312026-11-04T06:28:57.814ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
5322026-11-04T06:28:57.816ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5332026-11-04T06:28:58.625ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5342026-11-04T06:28:58.630ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
5352026-11-04T06:28:58.633ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5362026-11-04T06:29:00.107ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5372026-11-04T06:29:00.112ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
5382026-11-04T06:29:00.115ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5392026-11-04T06:29:01.403ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5402026-11-04T06:29:01.407ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
5412026-11-04T06:29:01.410ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5422026-11-04T06:29:02.009ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5432026-11-04T06:29:02.015ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
5442026-11-04T06:29:02.019ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5452026-11-04T06:29:02.685ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5462026-11-04T06:29:02.689ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
5472026-11-04T06:29:02.692ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5482026-11-04T06:29:03.540ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5492026-11-04T06:29:03.545ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
5502026-11-04T06:29:03.548ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5512026-11-04T06:29:03.582ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 9068758614355475296 n_samples = 6 unit = oximeter
5522026-11-04T06:29:03.582ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 18246307331050382929 n_samples = 6 unit = oximeter
5532026-11-04T06:29:04.918ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5542026-11-04T06:29:04.925ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
5552026-11-04T06:29:04.928ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5562026-11-04T06:29:05.568ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5572026-11-04T06:29:05.572ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
5582026-11-04T06:29:05.574ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5592026-11-04T06:29:06.819ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5602026-11-04T06:29:06.824ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
5612026-11-04T06:29:06.827ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5622026-11-04T06:29:08.063ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5632026-11-04T06:29:08.068ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
5642026-11-04T06:29:08.072ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5652026-11-04T06:29:08.843ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5662026-11-04T06:29:08.848ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
5672026-11-04T06:29:08.851ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5682026-11-04T06:29:10.227ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5692026-11-04T06:29:10.233ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
5702026-11-04T06:29:10.236ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5712026-11-04T06:29:11.682ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5722026-11-04T06:29:11.689ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
5732026-11-04T06:29:11.692ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5742026-11-04T06:29:12.940ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5752026-11-04T06:29:12.946ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
5762026-11-04T06:29:12.949ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5772026-11-04T06:29:13.594ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 9068758614355475296 n_samples = 6 unit = oximeter
5782026-11-04T06:29:13.597ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 18246307331050382929 n_samples = 6 unit = oximeter
5792026-11-04T06:29:13.774ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5802026-11-04T06:29:13.779ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
5812026-11-04T06:29:13.782ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5822026-11-04T06:29:14.851ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5832026-11-04T06:29:14.856ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
5842026-11-04T06:29:14.859ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5852026-11-04T06:29:15.915ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5862026-11-04T06:29:15.920ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
5872026-11-04T06:29:15.923ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5882026-11-04T06:29:16.497ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5892026-11-04T06:29:16.502ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
5902026-11-04T06:29:16.505ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5912026-11-04T06:29:17.061ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5922026-11-04T06:29:17.066ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
5932026-11-04T06:29:17.069ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5942026-11-04T06:29:17.829ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5952026-11-04T06:29:17.833ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
5962026-11-04T06:29:17.836ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5972026-11-04T06:29:19.288ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5982026-11-04T06:29:19.293ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
5992026-11-04T06:29:19.296ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6002026-11-04T06:29:20.781ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6012026-11-04T06:29:20.786ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
6022026-11-04T06:29:20.789ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6032026-11-04T06:29:22.218ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6042026-11-04T06:29:22.223ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
6052026-11-04T06:29:22.226ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6062026-11-04T06:29:22.877ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6072026-11-04T06:29:22.881ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
6082026-11-04T06:29:22.885ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6092026-11-04T06:29:23.598ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 9068758614355475296 n_samples = 6 unit = oximeter
6102026-11-04T06:29:23.598ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 18246307331050382929 n_samples = 6 unit = oximeter
6112026-11-04T06:29:23.634ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6122026-11-04T06:29:23.638ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
6132026-11-04T06:29:23.640ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6142026-11-04T06:29:24.295ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6152026-11-04T06:29:24.300ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
6162026-11-04T06:29:24.303ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6172026-11-04T06:29:25.502ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("815de21c-cec7-4efe-b443-9c4bd66f9891.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("84ea4e0f-e7b3-4c42-b615-b8115a84187a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("bbe38990-2db5-4228-9cbe-2e1051887a5a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("bbe38990-2db5-4228-9cbe-2e1051887a5a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 761, tv_nsec: 638838125 } }) unit = producer-server
6182026-11-04T06:29:25.503ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::a]:12221 unit = producer-server
6192026-11-04T06:29:25.508ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
6202026-11-04T06:29:25.519ZDEBGtfportd (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "7ed3d405-0264-4ead-8b06-c146e092d203", "content-length": "41", "date": "Wed, 04 Nov 2026 06:29:25 GMT"} }) unit = producer-server
6212026-11-04T06:29:25.519ZDEBGtfportd (producer-registration-task): successfully registered with Nexus, pausing until time to renew lease lease_duration = 600s unit = producer-server wait_period = 150s
6222026-11-04T06:29:25.628ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6232026-11-04T06:29:25.634ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
6242026-11-04T06:29:25.637ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6252026-11-04T06:29:26.206ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6262026-11-04T06:29:26.211ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
6272026-11-04T06:29:26.214ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6282026-11-04T06:29:26.835ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6292026-11-04T06:29:26.840ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
6302026-11-04T06:29:26.844ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6312026-11-04T06:29:27.388ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6322026-11-04T06:29:27.392ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
6332026-11-04T06:29:27.394ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6342026-11-04T06:29:28.475ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6352026-11-04T06:29:28.480ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
6362026-11-04T06:29:28.483ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6372026-11-04T06:29:29.519ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6382026-11-04T06:29:29.524ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
6392026-11-04T06:29:29.527ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6402026-11-04T06:29:30.393ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6412026-11-04T06:29:30.397ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
6422026-11-04T06:29:30.399ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6432026-11-04T06:29:31.261ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6442026-11-04T06:29:31.265ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
6452026-11-04T06:29:31.268ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6462026-11-04T06:29:32.112ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6472026-11-04T06:29:32.120ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
6482026-11-04T06:29:32.132ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6492026-11-04T06:29:32.741ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6502026-11-04T06:29:32.748ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
6512026-11-04T06:29:32.751ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6522026-11-04T06:29:33.600ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 9068758614355475296 n_samples = 6 unit = oximeter
6532026-11-04T06:29:33.600ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 18246307331050382929 n_samples = 6 unit = oximeter
6542026-11-04T06:29:34.124ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6552026-11-04T06:29:34.132ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
6562026-11-04T06:29:34.135ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6572026-11-04T06:29:34.702ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6582026-11-04T06:29:34.707ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
6592026-11-04T06:29:34.710ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6602026-11-04T06:29:35.976ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6612026-11-04T06:29:35.980ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
6622026-11-04T06:29:35.984ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6632026-11-04T06:29:36.819ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6642026-11-04T06:29:36.825ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
6652026-11-04T06:29:36.832ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6662026-11-04T06:29:37.561ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6672026-11-04T06:29:37.566ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
6682026-11-04T06:29:37.569ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6692026-11-04T06:29:38.535ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6702026-11-04T06:29:38.540ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
6712026-11-04T06:29:38.543ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6722026-11-04T06:29:39.437ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6732026-11-04T06:29:39.442ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
6742026-11-04T06:29:39.444ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6752026-11-04T06:29:40.636ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6762026-11-04T06:29:40.641ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
6772026-11-04T06:29:40.643ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6782026-11-04T06:29:41.784ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6792026-11-04T06:29:41.788ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
6802026-11-04T06:29:41.791ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6812026-11-04T06:29:43.091ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6822026-11-04T06:29:43.096ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
6832026-11-04T06:29:43.099ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6842026-11-04T06:29:43.602ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 9068758614355475296 n_samples = 6 unit = oximeter
6852026-11-04T06:29:43.603ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 18246307331050382929 n_samples = 6 unit = oximeter
6862026-11-04T06:29:44.174ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6872026-11-04T06:29:44.179ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
6882026-11-04T06:29:44.182ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6892026-11-04T06:29:45.685ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6902026-11-04T06:29:45.690ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
6912026-11-04T06:29:45.693ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6922026-11-04T06:29:46.834ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6932026-11-04T06:29:46.839ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
6942026-11-04T06:29:46.841ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6952026-11-04T06:29:47.965ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6962026-11-04T06:29:47.970ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
6972026-11-04T06:29:47.972ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6982026-11-04T06:29:49.302ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6992026-11-04T06:29:49.307ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
7002026-11-04T06:29:49.309ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
7012026-11-04T06:29:50.493ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
7022026-11-04T06:29:50.498ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
7032026-11-04T06:29:50.500ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
7042026-11-04T06:29:51.117ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
7052026-11-04T06:29:51.122ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
7062026-11-04T06:29:51.125ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
7072026-11-04T06:29:52.514ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
7082026-11-04T06:29:52.518ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
7092026-11-04T06:29:52.521ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
7102026-11-04T06:29:53.604ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 9068758614355475296 n_samples = 6 unit = oximeter
7112026-11-04T06:29:53.604ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 18246307331050382929 n_samples = 6 unit = oximeter
7122026-11-04T06:29:53.818ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
7132026-11-04T06:29:53.823ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
7142026-11-04T06:29:53.826ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
7152026-11-04T06:29:54.955ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
7162026-11-04T06:29:54.960ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
7172026-11-04T06:29:54.963ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
7182026-11-04T06:29:55.637ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
7192026-11-04T06:29:55.643ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
7202026-11-04T06:29:55.646ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
7212026-11-04T06:29:56.070ZINFOtfportd (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:1025 local_addr = [fd00:1122:3344:101::2]:56081 remote_addr = [fd00:1122:3344:101::d]:45473 unit = producer-server
7222026-11-04T06:29:56.081ZINFOtfportd (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 9512 local_addr = [fd00:1122:3344:101::2]:56081 method = GET remote_addr = [fd00:1122:3344:101::d]:45473 req_id = 1a37003e-7c55-4850-a37b-5de8ddc6d018 response_code = 200 unit = producer-server uri = /95e48537-7316-4f1c-8e97-897b07cd7cbb
7232026-11-04T06:29:57.088ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
7242026-11-04T06:29:57.093ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
7252026-11-04T06:29:57.096ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
7262026-11-04T06:29:57.638ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
7272026-11-04T06:29:57.642ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
7282026-11-04T06:29:57.645ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
7292026-11-04T06:29:58.513ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
7302026-11-04T06:29:58.518ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
7312026-11-04T06:29:58.522ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
7322026-11-04T06:29:59.251ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
7332026-11-04T06:29:59.256ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
7342026-11-04T06:29:59.259ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
7352026-11-04T06:30:00.289ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
7362026-11-04T06:30:00.295ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f830:89ff:fe09:983d]
7372026-11-04T06:30:00.298ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]