Max level shown:
1 [ Aug 20 07:28:09 Enabled. ]
2 [ Aug 20 07:28:09 Rereading configuration. ]
3 [ Aug 20 07:28:09 Rereading configuration. ]
4 [ Aug 20 07:28:20 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dendrite/bin/tfportd --sync-only &"). ]
5 [ Aug 20 07:28:20 Method "start" exited with status 0. ]
6 No non-localhost IPv6 addresses found in SMF properties
72026-08-20T07:28:20.824ZINFOtfportd: connecting to dpd host = [::1] port = 12224
82026-08-20T07:28:20.826ZINFOtfportd: connected to dpd running softnpu-0d48b5a3
92026-08-20T07:28:20.826ZINFOtfportd: running in sync-only mode
102026-08-20T07:28:20.827ZINFOtfportd: no non-localhost IPv6 listen address available, waiting for SMF update unit = oximeter
112026-08-20T07:28:20.829ZINFOtfportd: refreshing SMF config prior to waiting on signals unit = signal_handler
12 No non-localhost IPv6 addresses found in SMF properties
132026-08-20T07:28:20.830ZINFOtfportd: refreshed config: Config { log_file: None, log_format: Json, listen_addresses: [ [::1]:12231, ], pkt_source: None, dpd_host: "[::1]", dpd_port: 12224, vlan_link: None, vlan_data: None, techport0_prefix: None, techport1_prefix: None, rack_id: Some( 8fe09c79-0ea0-4718-a6f6-8aeafa9520d7, ), sled_id: Some( b9b21b15-5d3d-42b7-a528-e63982617157, ), sled_model: Some( "i86pc", ), sled_revision: Some( 0, ), sled_serial: Some( "buskin", ), }
142026-08-20T07:28:20.830ZINFOtfportd: no non-localhost IPv6 listen address available, waiting for SMF update unit = oximeter
152026-08-20T07:28:20.836ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::f02d:91ff:fecd:7f65->f2:2d:91:cd:7f:65 interface = tfportrear0_0
162026-08-20T07:28:20.838ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
172026-08-20T07:28:20.843ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
182026-08-20T07:28:20.848ZWARNtfportd: tfportqsfp0_0 has no addrs
19 [ Aug 20 07:28:21 Rereading configuration. ]
20 [ Aug 20 07:28:21 Executing refresh method (:kill). ]
21 [ Aug 20 07:28:21 Stopping because all processes in service exited. ]
22 [ Aug 20 07:28:21 Executing stop method (:kill). ]
23 [ Aug 20 07:28:21 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dendrite/bin/tfportd --sync-only &"). ]
24 [ Aug 20 07:28:21 Method "start" exited with status 0. ]
252026-08-20T07:28:21.488ZINFOtfportd: connecting to dpd host = [::1] port = 12224
262026-08-20T07:28:21.489ZINFOtfportd: connected to dpd running softnpu-0d48b5a3
272026-08-20T07:28:21.490ZINFOtfportd: running in sync-only mode
282026-08-20T07:28:21.490ZINFOtfportd: found suitable IPv6 address for oximeter producer server address = fd00:1122:3344:101::2 unit = oximeter
292026-08-20T07:28:21.491ZINFOtfportd: refreshing SMF config prior to waiting on signals unit = signal_handler
302026-08-20T07:28:21.492ZDEBGtfportd: extracted oximeter configuration data config = OximeterConfig { listen_address: fd00:1122:3344:101::2, sled_identifiers: SledIdentifiers { rack_id: 8fe09c79-0ea0-4718-a6f6-8aeafa9520d7, sled_id: b9b21b15-5d3d-42b7-a528-e63982617157, model: "i86pc", revision: 0, serial: "buskin" }, switch_identifiers: SwitchIdentifiers { asic_backend: "softnpu", fab: None, fuse: Some(FuseData { chip_rev: ChipRevision { device_id: 272, rev: "B1", rev_num: 2 }, disabled: DisabledFeatures { bsync: false, mau: [0, 0, 0, 0], pgen: false, pipes: 0, ports: 0, resub: false, speeds: 0, tm_mem: 0 }, frequency: FrequencySettings { bps: 3, bps_ext: 0, cpu_speed_dis: 0, disabled: false, pcie_dis: 0, pps: 3, pps_ext: 0 }, manufacturing: ManufacturingData { core_repair: false, die_rotation: false, pmro_and_skew: 0, silent_spin: 0, soft_pipe_dis: 0, tile_repair: false, voltage_scaling: 0, wf_core_repair: false }, part: PartInfo { part_num: 4660, pkg_id: 1, version: 2 } }), lot: None, lotnum: None, model: "FAKE_SIM_SIDECAR", revision: 0, serial: "SimSidecar0", sidecar_id: 3fef83df-15a1-4f24-96ef-6ca23d3605fb, slot: 0, wafer: None, wafer_loc: None } } unit = oximeter
312026-08-20T07:28:21.492ZDEBGtfportd: created producer ID producer_id = 09bd04b3-463c-4a8b-9531-007145c2547b unit = oximeter
322026-08-20T07:28:21.493ZINFOtfportd: refreshed config: Config { log_file: None, log_format: Json, listen_addresses: [ [fd00:1122:3344:101::2]:12231, [::1]:12231, ], pkt_source: None, dpd_host: "[::1]", dpd_port: 12224, vlan_link: None, vlan_data: None, techport0_prefix: None, techport1_prefix: None, rack_id: Some( 8fe09c79-0ea0-4718-a6f6-8aeafa9520d7, ), sled_id: Some( b9b21b15-5d3d-42b7-a528-e63982617157, ), sled_model: Some( "i86pc", ), sled_revision: Some( 0, ), sled_serial: Some( "buskin", ), }
332026-08-20T07:28:21.499ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
342026-08-20T07:28:21.501ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::f02d:91ff:fecd:7f65->f2:2d:91:cd:7f:65 interface = tfportrear0_0
352026-08-20T07:28:21.501ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::833:5bff:fe24:90fe->0a:33:5b:24:90:fe interface = tfportrear0_0
362026-08-20T07:28:21.503ZDEBGtfportd: registered DTrace probes unit = producer-server
372026-08-20T07:28:21.504ZDEBGtfportd (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::2]:39305 method = GET path = /{producer_id} unit = producer-server versions = all
382026-08-20T07:28:21.504ZINFOtfportd (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:328 local_addr = [fd00:1122:3344:101::2]:39305 unit = producer-server
392026-08-20T07:28:21.504ZDEBGtfportd (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::2]:39305 unit = producer-server
402026-08-20T07:28:21.504ZDEBGtfportd: Requested any available port, Dropshot server has been bound to [fd00:1122:3344:101::2]:39305 unit = producer-server
412026-08-20T07:28:21.504ZDEBGtfportd: Nexus IP not provided, will use DNS to resolve it unit = producer-server
422026-08-20T07:28:21.505ZINFOtfportd (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/internal-dns/resolver/src/resolver.rs:144 unit = producer-server
432026-08-20T07:28:21.505ZDEBGtfportd: starting producer registration task unit = producer-server
442026-08-20T07:28:21.505ZINFOtfportd: starting oximeter metric producer server address = [fd00:1122:3344:101::2]:39305 file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:279 interval = 30s producer_id = 09bd04b3-463c-4a8b-9531-007145c2547b unit = producer-server
452026-08-20T07:28:21.505ZDEBGtfportd (producer-registration-task): registering as oximeter producer with Nexus registration_count = 0 unit = producer-server
462026-08-20T07:28:21.505ZINFOtfportd: created oximeter producer server unit = oximeter
472026-08-20T07:28:21.505ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
482026-08-20T07:28:21.506ZDEBGtfportd (kstat-sampler): adding new target unit = oximeter
492026-08-20T07:28:21.506ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 0 delay = 1.336233ms error = "proto error: no records found for Query { name: Name(\\"_nexus._tcp.control-plane.oxide.internal.\\"), query_type: SRV, query_class: IN }" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
502026-08-20T07:28:21.507ZDEBGtfportd (kstat-sampler-worker): storing new creation time for tracked target creation_time = 2026-08-20T07:28:04.692525539Z path = KstatPath { module: "link", instance: 0, name: "tfportrear0_0" } unit = oximeter
512026-08-20T07:28:21.507ZDEBGtfportd (kstat-sampler-worker): inserted empty per-target sample queue id = 18232203736512251191 unit = oximeter
522026-08-20T07:28:21.507ZDEBGtfportd: added new link to kstat sampler link_kind = switch-port-control link_name = tfportrear0_0 unit = metrics-task-tracker
532026-08-20T07:28:21.509ZWARNtfportd: tfportqsfp0_0 has no addrs
542026-08-20T07:28:21.804ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("2ca4d8a0-d930-4747-b6ed-75adfaa26fa8.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("72e536de-e939-4277-b409-4fc06ab736c4.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("e3d12376-a8a1-4aa5-8cfc-b29cde8f213e.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("e3d12376-a8a1-4aa5-8cfc-b29cde8f213e.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 1157, tv_nsec: 476266134 } }) unit = producer-server
552026-08-20T07:28:21.805ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
562026-08-20T07:28:21.823ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
572026-08-20T07:28:22.677ZINFOtfportd: added new ARP entry entry = 10.151.1.174->9e:d0:41:90:f7:b1 interface = tfportqsfp0_0
582026-08-20T07:28:22.923ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
592026-08-20T07:28:22.928ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
602026-08-20T07:28:22.931ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
612026-08-20T07:28:22.931ZDEBGtfportd (kstat-sampler): adding new target unit = oximeter
622026-08-20T07:28:22.933ZDEBGtfportd (kstat-sampler-worker): storing new creation time for tracked target creation_time = 2026-08-20T07:28:04.692395004Z path = KstatPath { module: "link", instance: 0, name: "tfportqsfp0_0" } unit = oximeter
632026-08-20T07:28:22.933ZDEBGtfportd (kstat-sampler-worker): inserted empty per-target sample queue id = 18086029853746819567 unit = oximeter
642026-08-20T07:28:22.933ZDEBGtfportd: added new link to kstat sampler link_kind = switch-port-control link_name = tfportqsfp0_0 unit = metrics-task-tracker
652026-08-20T07:28:23.973ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
662026-08-20T07:28:23.978ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
672026-08-20T07:28:23.982ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
682026-08-20T07:28:25.227ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
692026-08-20T07:28:25.232ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
702026-08-20T07:28:25.236ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
712026-08-20T07:28:26.614ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
722026-08-20T07:28:26.619ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
732026-08-20T07:28:26.622ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
742026-08-20T07:28:27.177ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
752026-08-20T07:28:27.182ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
762026-08-20T07:28:27.185ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
772026-08-20T07:28:28.663ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
782026-08-20T07:28:28.667ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
792026-08-20T07:28:28.670ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
802026-08-20T07:28:29.889ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
812026-08-20T07:28:29.894ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
822026-08-20T07:28:29.898ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
832026-08-20T07:28:30.739ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
842026-08-20T07:28:30.744ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
852026-08-20T07:28:30.748ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
862026-08-20T07:28:31.511ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 18232203736512251191 n_samples = 6 unit = oximeter
872026-08-20T07:28:32.152ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
882026-08-20T07:28:32.156ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
892026-08-20T07:28:32.160ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
902026-08-20T07:28:32.936ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 18086029853746819567 n_samples = 6 unit = oximeter
912026-08-20T07:28:32.981ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
922026-08-20T07:28:32.985ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
932026-08-20T07:28:32.988ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
942026-08-20T07:28:33.946ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
952026-08-20T07:28:33.950ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
962026-08-20T07:28:33.954ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
972026-08-20T07:28:35.482ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
982026-08-20T07:28:35.486ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
992026-08-20T07:28:35.489ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1002026-08-20T07:28:36.544ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1012026-08-20T07:28:36.549ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
1022026-08-20T07:28:36.552ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1032026-08-20T07:28:37.130ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
1042026-08-20T07:28:37.131ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 1 delay = 15.320452044s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
1052026-08-20T07:28:37.565ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1062026-08-20T07:28:37.570ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
1072026-08-20T07:28:37.572ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1082026-08-20T07:28:37.700ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("2ca4d8a0-d930-4747-b6ed-75adfaa26fa8.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("72e536de-e939-4277-b409-4fc06ab736c4.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("e3d12376-a8a1-4aa5-8cfc-b29cde8f213e.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("e3d12376-a8a1-4aa5-8cfc-b29cde8f213e.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 1173, tv_nsec: 65290293 } }) unit = producer-server
1092026-08-20T07:28:37.701ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
1102026-08-20T07:28:37.707ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
1112026-08-20T07:28:38.751ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1122026-08-20T07:28:38.755ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
1132026-08-20T07:28:38.758ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1142026-08-20T07:28:39.886ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1152026-08-20T07:28:39.892ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
1162026-08-20T07:28:39.895ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1172026-08-20T07:28:40.466ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1182026-08-20T07:28:40.472ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
1192026-08-20T07:28:40.474ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1202026-08-20T07:28:41.675ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1212026-08-20T07:28:41.680ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
1222026-08-20T07:28:41.683ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1232026-08-20T07:28:41.832ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 18232203736512251191 n_samples = 6 unit = oximeter
1242026-08-20T07:28:42.420ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1252026-08-20T07:28:42.425ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
1262026-08-20T07:28:42.428ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1272026-08-20T07:28:43.261ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 18086029853746819567 n_samples = 6 unit = oximeter
1282026-08-20T07:28:43.880ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1292026-08-20T07:28:43.886ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
1302026-08-20T07:28:43.890ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1312026-08-20T07:28:45.380ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1322026-08-20T07:28:45.387ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
1332026-08-20T07:28:45.390ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1342026-08-20T07:28:46.507ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1352026-08-20T07:28:46.513ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
1362026-08-20T07:28:46.516ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1372026-08-20T07:28:47.871ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1382026-08-20T07:28:47.884ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
1392026-08-20T07:28:47.888ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1402026-08-20T07:28:48.771ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1412026-08-20T07:28:48.782ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
1422026-08-20T07:28:48.787ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1432026-08-20T07:28:49.399ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1442026-08-20T07:28:49.405ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
1452026-08-20T07:28:49.409ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1462026-08-20T07:28:50.039ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1472026-08-20T07:28:50.046ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
1482026-08-20T07:28:50.050ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1492026-08-20T07:28:50.979ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1502026-08-20T07:28:50.985ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
1512026-08-20T07:28:50.988ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1522026-08-20T07:28:51.592ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1532026-08-20T07:28:51.598ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
1542026-08-20T07:28:51.602ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1552026-08-20T07:28:51.864ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 18232203736512251191 n_samples = 6 unit = oximeter
1562026-08-20T07:28:52.750ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
1572026-08-20T07:28:52.751ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 2 delay = 30.897239338s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
1582026-08-20T07:28:53.107ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1592026-08-20T07:28:53.113ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
1602026-08-20T07:28:53.115ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1612026-08-20T07:28:53.291ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 18086029853746819567 n_samples = 6 unit = oximeter
1622026-08-20T07:28:54.122ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1632026-08-20T07:28:54.128ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
1642026-08-20T07:28:54.131ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1652026-08-20T07:28:54.196ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("2ca4d8a0-d930-4747-b6ed-75adfaa26fa8.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("72e536de-e939-4277-b409-4fc06ab736c4.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("e3d12376-a8a1-4aa5-8cfc-b29cde8f213e.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("e3d12376-a8a1-4aa5-8cfc-b29cde8f213e.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 1189, tv_nsec: 516157890 } }) unit = producer-server
1662026-08-20T07:28:54.197ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
1672026-08-20T07:28:54.205ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
1682026-08-20T07:28:54.730ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1692026-08-20T07:28:54.736ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
1702026-08-20T07:28:54.738ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1712026-08-20T07:28:55.397ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1722026-08-20T07:28:55.403ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
1732026-08-20T07:28:55.406ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1742026-08-20T07:28:56.087ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1752026-08-20T07:28:56.093ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
1762026-08-20T07:28:56.096ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1772026-08-20T07:28:57.298ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1782026-08-20T07:28:57.303ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
1792026-08-20T07:28:57.307ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1802026-08-20T07:28:57.902ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1812026-08-20T07:28:57.907ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
1822026-08-20T07:28:57.911ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1832026-08-20T07:28:58.476ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1842026-08-20T07:28:58.483ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
1852026-08-20T07:28:58.492ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1862026-08-20T07:28:59.606ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1872026-08-20T07:28:59.614ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
1882026-08-20T07:28:59.618ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1892026-08-20T07:29:00.935ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1902026-08-20T07:29:00.941ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
1912026-08-20T07:29:00.944ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1922026-08-20T07:29:01.893ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 18232203736512251191 n_samples = 6 unit = oximeter
1932026-08-20T07:29:02.063ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1942026-08-20T07:29:02.069ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
1952026-08-20T07:29:02.072ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1962026-08-20T07:29:03.284ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1972026-08-20T07:29:03.289ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
1982026-08-20T07:29:03.292ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1992026-08-20T07:29:03.315ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 18086029853746819567 n_samples = 6 unit = oximeter
2002026-08-20T07:29:03.871ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2012026-08-20T07:29:03.876ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
2022026-08-20T07:29:03.879ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2032026-08-20T07:29:04.776ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2042026-08-20T07:29:04.781ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
2052026-08-20T07:29:04.785ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2062026-08-20T07:29:05.338ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2072026-08-20T07:29:05.344ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
2082026-08-20T07:29:05.347ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2092026-08-20T07:29:06.804ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2102026-08-20T07:29:06.809ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
2112026-08-20T07:29:06.812ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2122026-08-20T07:29:07.614ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2132026-08-20T07:29:07.619ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
2142026-08-20T07:29:07.622ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2152026-08-20T07:29:08.344ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2162026-08-20T07:29:08.350ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
2172026-08-20T07:29:08.354ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2182026-08-20T07:29:09.269ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
2192026-08-20T07:29:09.269ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 3 delay = 47.391319289s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
2202026-08-20T07:29:09.687ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2212026-08-20T07:29:10.791ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
2222026-08-20T07:29:10.795ZINFOtfportd: removed stale NDP entry :fe80::833:5bff:fe24:90fe->0a:33:5b:24:90:fe
2232026-08-20T07:29:10.795ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2242026-08-20T07:29:11.693ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::833:5bff:fe24:90fe->0a:33:5b:24:90:fe interface = tfportrear0_0
2252026-08-20T07:29:11.882ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2262026-08-20T07:29:11.890ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
2272026-08-20T07:29:11.894ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2282026-08-20T07:29:11.895ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 18232203736512251191 n_samples = 6 unit = oximeter
2292026-08-20T07:29:12.094ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("2ca4d8a0-d930-4747-b6ed-75adfaa26fa8.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("72e536de-e939-4277-b409-4fc06ab736c4.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("e3d12376-a8a1-4aa5-8cfc-b29cde8f213e.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("e3d12376-a8a1-4aa5-8cfc-b29cde8f213e.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 1207, tv_nsec: 394059731 } }) unit = producer-server
2302026-08-20T07:29:12.094ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
2312026-08-20T07:29:12.101ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
2322026-08-20T07:29:12.588ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2332026-08-20T07:29:12.593ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
2342026-08-20T07:29:12.597ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2352026-08-20T07:29:13.316ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 18086029853746819567 n_samples = 6 unit = oximeter
2362026-08-20T07:29:14.090ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2372026-08-20T07:29:14.097ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
2382026-08-20T07:29:14.101ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2392026-08-20T07:29:14.903ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2402026-08-20T07:29:14.907ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
2412026-08-20T07:29:14.910ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2422026-08-20T07:29:15.475ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2432026-08-20T07:29:15.482ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
2442026-08-20T07:29:15.485ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2452026-08-20T07:29:16.397ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2462026-08-20T07:29:16.402ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
2472026-08-20T07:29:16.405ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2482026-08-20T07:29:17.738ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2492026-08-20T07:29:17.743ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
2502026-08-20T07:29:17.747ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2512026-08-20T07:29:18.341ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2522026-08-20T07:29:18.347ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
2532026-08-20T07:29:18.351ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2542026-08-20T07:29:19.836ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2552026-08-20T07:29:19.841ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
2562026-08-20T07:29:19.844ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2572026-08-20T07:29:21.149ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2582026-08-20T07:29:21.155ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
2592026-08-20T07:29:21.158ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2602026-08-20T07:29:21.896ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 18232203736512251191 n_samples = 6 unit = oximeter
2612026-08-20T07:29:22.046ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2622026-08-20T07:29:22.052ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
2632026-08-20T07:29:22.055ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2642026-08-20T07:29:23.317ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 18086029853746819567 n_samples = 6 unit = oximeter
2652026-08-20T07:29:23.366ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2662026-08-20T07:29:23.371ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
2672026-08-20T07:29:23.374ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2682026-08-20T07:29:24.187ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2692026-08-20T07:29:24.192ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
2702026-08-20T07:29:24.195ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2712026-08-20T07:29:25.127ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2722026-08-20T07:29:25.133ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
2732026-08-20T07:29:25.136ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2742026-08-20T07:29:26.292ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2752026-08-20T07:29:26.297ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
2762026-08-20T07:29:26.301ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2772026-08-20T07:29:27.101ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
2782026-08-20T07:29:27.102ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 4 delay = 65.225481464s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
2792026-08-20T07:29:27.542ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2802026-08-20T07:29:27.548ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
2812026-08-20T07:29:27.552ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2822026-08-20T07:29:28.681ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2832026-08-20T07:29:28.686ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
2842026-08-20T07:29:28.689ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2852026-08-20T07:29:29.835ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2862026-08-20T07:29:29.841ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
2872026-08-20T07:29:29.845ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2882026-08-20T07:29:30.663ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("2ca4d8a0-d930-4747-b6ed-75adfaa26fa8.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("72e536de-e939-4277-b409-4fc06ab736c4.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("e3d12376-a8a1-4aa5-8cfc-b29cde8f213e.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("e3d12376-a8a1-4aa5-8cfc-b29cde8f213e.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 1225, tv_nsec: 964005942 } }) unit = producer-server
2892026-08-20T07:29:30.663ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
2902026-08-20T07:29:30.670ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
2912026-08-20T07:29:30.823ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2922026-08-20T07:29:30.829ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
2932026-08-20T07:29:30.832ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2942026-08-20T07:29:31.741ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2952026-08-20T07:29:31.746ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
2962026-08-20T07:29:31.750ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2972026-08-20T07:29:31.898ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 18232203736512251191 n_samples = 6 unit = oximeter
2982026-08-20T07:29:32.997ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2992026-08-20T07:29:33.002ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
3002026-08-20T07:29:33.006ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3012026-08-20T07:29:33.319ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 18086029853746819567 n_samples = 6 unit = oximeter
3022026-08-20T07:29:34.289ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3032026-08-20T07:29:34.295ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
3042026-08-20T07:29:34.298ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3052026-08-20T07:29:35.551ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3062026-08-20T07:29:35.556ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
3072026-08-20T07:29:35.559ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3082026-08-20T07:29:37.063ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3092026-08-20T07:29:37.070ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
3102026-08-20T07:29:37.073ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3112026-08-20T07:29:38.014ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3122026-08-20T07:29:38.019ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
3132026-08-20T07:29:38.023ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3142026-08-20T07:29:38.985ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3152026-08-20T07:29:38.990ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
3162026-08-20T07:29:38.993ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3172026-08-20T07:29:40.152ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3182026-08-20T07:29:40.157ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
3192026-08-20T07:29:40.161ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3202026-08-20T07:29:41.157ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3212026-08-20T07:29:41.162ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
3222026-08-20T07:29:41.166ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3232026-08-20T07:29:41.900ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 18232203736512251191 n_samples = 6 unit = oximeter
3242026-08-20T07:29:42.550ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3252026-08-20T07:29:42.555ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
3262026-08-20T07:29:42.559ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3272026-08-20T07:29:43.321ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 18086029853746819567 n_samples = 6 unit = oximeter
3282026-08-20T07:29:43.912ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3292026-08-20T07:29:43.917ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
3302026-08-20T07:29:43.921ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3312026-08-20T07:29:45.344ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3322026-08-20T07:29:45.350ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
3332026-08-20T07:29:45.353ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3342026-08-20T07:29:45.671ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
3352026-08-20T07:29:45.672ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 5 delay = 83.79606774s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
3362026-08-20T07:29:46.520ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3372026-08-20T07:29:46.525ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
3382026-08-20T07:29:46.528ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3392026-08-20T07:29:47.887ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3402026-08-20T07:29:47.893ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
3412026-08-20T07:29:47.896ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3422026-08-20T07:29:49.405ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3432026-08-20T07:29:49.409ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
3442026-08-20T07:29:49.413ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3452026-08-20T07:29:50.839ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3462026-08-20T07:29:50.844ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
3472026-08-20T07:29:50.848ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3482026-08-20T07:29:51.834ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3492026-08-20T07:29:51.840ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
3502026-08-20T07:29:51.843ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3512026-08-20T07:29:51.902ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 18232203736512251191 n_samples = 6 unit = oximeter
3522026-08-20T07:29:53.019ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3532026-08-20T07:29:53.024ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
3542026-08-20T07:29:53.027ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3552026-08-20T07:29:53.323ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 18086029853746819567 n_samples = 6 unit = oximeter
3562026-08-20T07:29:53.886ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3572026-08-20T07:29:53.891ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
3582026-08-20T07:29:53.895ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3592026-08-20T07:29:54.685ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3602026-08-20T07:29:54.691ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
3612026-08-20T07:29:54.694ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3622026-08-20T07:29:55.461ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3632026-08-20T07:29:55.466ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
3642026-08-20T07:29:55.469ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3652026-08-20T07:29:56.050ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3662026-08-20T07:29:56.056ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
3672026-08-20T07:29:56.059ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3682026-08-20T07:29:56.907ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3692026-08-20T07:29:56.913ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
3702026-08-20T07:29:56.915ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3712026-08-20T07:29:56.984ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("2ca4d8a0-d930-4747-b6ed-75adfaa26fa8.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("72e536de-e939-4277-b409-4fc06ab736c4.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("e3d12376-a8a1-4aa5-8cfc-b29cde8f213e.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("e3d12376-a8a1-4aa5-8cfc-b29cde8f213e.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 1252, tv_nsec: 284750965 } }) unit = producer-server
3722026-08-20T07:29:56.984ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
3732026-08-20T07:29:56.991ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
3742026-08-20T07:29:57.704ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3752026-08-20T07:29:57.710ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
3762026-08-20T07:29:57.713ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3772026-08-20T07:29:58.895ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3782026-08-20T07:29:58.901ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
3792026-08-20T07:29:58.905ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3802026-08-20T07:29:59.897ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3812026-08-20T07:29:59.904ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f02d:91ff:fecd:7f65]
3822026-08-20T07:29:59.907ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]