Max level shown:
1 [ May 8 02:58:28 Enabled. ]
2 [ May 8 02:58:28 Rereading configuration. ]
3 [ May 8 02:58:29 Rereading configuration. ]
4 [ May 8 02:58:40 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dendrite/bin/tfportd --sync-only &"). ]
5 [ May 8 02:58:40 Method "start" exited with status 0. ]
6 No non-localhost IPv6 addresses found in SMF properties
72026-05-08T02:58:40.702ZINFOtfportd: connecting to dpd host = [::1] port = 12224
82026-05-08T02:58:40.704ZINFOtfportd: connected to dpd running softnpu-d147f092
92026-05-08T02:58:40.704ZINFOtfportd: running in sync-only mode
102026-05-08T02:58:40.707ZINFOtfportd: no non-localhost IPv6 listen address available, waiting for SMF update unit = oximeter
112026-05-08T02:58:40.707ZINFOtfportd: refreshing SMF config prior to waiting on signals unit = signal_handler
12 No non-localhost IPv6 addresses found in SMF properties
132026-05-08T02:58:40.709ZINFOtfportd: refreshed config: Config { log_file: None, log_format: Json, listen_addresses: [ [::1]:12231, ], pkt_source: None, dpd_host: "[::1]", dpd_port: 12224, vlan_link: None, vlan_data: None, techport0_prefix: None, techport1_prefix: None, rack_id: Some( 972b37f1-844a-44ea-9a12-11a16d5b4142, ), sled_id: Some( b5764393-aba7-42db-a12c-ba3459552b16, ), sled_model: Some( "i86pc", ), sled_revision: Some( 0, ), sled_serial: Some( "sock", ), }
142026-05-08T02:58:40.709ZINFOtfportd: no non-localhost IPv6 listen address available, waiting for SMF update unit = oximeter
152026-05-08T02:58:40.715ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::d86c:42ff:fec9:795b->da:6c:42:c9:79:5b interface = tfportrear0_0
162026-05-08T02:58:40.716ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
172026-05-08T02:58:40.723ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::d86c:42ff:fec9:795b]
182026-05-08T02:58:40.730ZWARNtfportd: tfportqsfp0_0 has no addrs
19 [ May 8 02:58:41 Rereading configuration. ]
20 [ May 8 02:58:41 Executing refresh method (:kill). ]
21 [ May 8 02:58:41 Stopping because all processes in service exited. ]
22 [ May 8 02:58:41 Executing stop method (:kill). ]
23 [ May 8 02:58:41 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dendrite/bin/tfportd --sync-only &"). ]
24 [ May 8 02:58:41 Method "start" exited with status 0. ]
252026-05-08T02:58:41.415ZINFOtfportd: connecting to dpd host = [::1] port = 12224
262026-05-08T02:58:41.416ZINFOtfportd: connected to dpd running softnpu-d147f092
272026-05-08T02:58:41.416ZINFOtfportd: running in sync-only mode
282026-05-08T02:58:41.416ZINFOtfportd: found suitable IPv6 address for oximeter producer server address = fd00:1122:3344:101::2 unit = oximeter
292026-05-08T02:58:41.418ZINFOtfportd: refreshing SMF config prior to waiting on signals unit = signal_handler
302026-05-08T02:58:41.418ZDEBGtfportd: extracted oximeter configuration data config = OximeterConfig { listen_address: fd00:1122:3344:101::2, sled_identifiers: SledIdentifiers { rack_id: 972b37f1-844a-44ea-9a12-11a16d5b4142, sled_id: b5764393-aba7-42db-a12c-ba3459552b16, model: "i86pc", revision: 0, serial: "sock" }, switch_identifiers: SwitchIdentifiers { asic_backend: "softnpu", fab: None, fuse: Some(FuseData { chip_rev: ChipRevision { device_id: 272, rev: "B1", rev_num: 2 }, disabled: DisabledFeatures { bsync: false, mau: [0, 0, 0, 0], pgen: false, pipes: 0, ports: 0, resub: false, speeds: 0, tm_mem: 0 }, frequency: FrequencySettings { bps: 3, bps_ext: 0, cpu_speed_dis: 0, disabled: false, pcie_dis: 0, pps: 3, pps_ext: 0 }, manufacturing: ManufacturingData { core_repair: false, die_rotation: false, pmro_and_skew: 0, silent_spin: 0, soft_pipe_dis: 0, tile_repair: false, voltage_scaling: 0, wf_core_repair: false }, part: PartInfo { part_num: 4660, pkg_id: 1, version: 2 } }), lot: None, lotnum: None, model: "FAKE_SIM_SIDECAR", revision: 0, serial: "SimSidecar0", sidecar_id: 0f2310b9-94cd-43e1-b25d-d37cf7537ee5, slot: 0, wafer: None, wafer_loc: None } } unit = oximeter
312026-05-08T02:58:41.418ZDEBGtfportd: created producer ID producer_id = 2d7e64db-bb20-45d0-8963-78e9c35d14b1 unit = oximeter
322026-05-08T02:58:41.419ZINFOtfportd: refreshed config: Config { log_file: None, log_format: Json, listen_addresses: [ [fd00:1122:3344:101::2]:12231, [::1]:12231, ], pkt_source: None, dpd_host: "[::1]", dpd_port: 12224, vlan_link: None, vlan_data: None, techport0_prefix: None, techport1_prefix: None, rack_id: Some( 972b37f1-844a-44ea-9a12-11a16d5b4142, ), sled_id: Some( b5764393-aba7-42db-a12c-ba3459552b16, ), sled_model: Some( "i86pc", ), sled_revision: Some( 0, ), sled_serial: Some( "sock", ), }
332026-05-08T02:58:41.427ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
342026-05-08T02:58:41.428ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::6cd4:c6ff:fe9b:c7f1->6e:d4:c6:9b:c7:f1 interface = tfportrear0_0
352026-05-08T02:58:41.428ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::d86c:42ff:fec9:795b->da:6c:42:c9:79:5b interface = tfportrear0_0
362026-05-08T02:58:41.430ZDEBGtfportd: registered DTrace probes unit = producer-server
372026-05-08T02:58:41.431ZDEBGtfportd (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::2]:45496 method = GET path = /{producer_id} unit = producer-server versions = all
382026-05-08T02:58:41.431ZINFOtfportd (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:328 local_addr = [fd00:1122:3344:101::2]:45496 unit = producer-server
392026-05-08T02:58:41.431ZDEBGtfportd (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::2]:45496 unit = producer-server
402026-05-08T02:58:41.431ZDEBGtfportd: Requested any available port, Dropshot server has been bound to [fd00:1122:3344:101::2]:45496 unit = producer-server
412026-05-08T02:58:41.431ZDEBGtfportd: Nexus IP not provided, will use DNS to resolve it unit = producer-server
422026-05-08T02:58:41.431ZINFOtfportd (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/internal-dns/resolver/src/resolver.rs:144 unit = producer-server
432026-05-08T02:58:41.432ZDEBGtfportd: starting producer registration task unit = producer-server
442026-05-08T02:58:41.432ZINFOtfportd: starting oximeter metric producer server address = [fd00:1122:3344:101::2]:45496 file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:279 interval = 30s producer_id = 2d7e64db-bb20-45d0-8963-78e9c35d14b1 unit = producer-server
452026-05-08T02:58:41.432ZINFOtfportd: created oximeter producer server unit = oximeter
462026-05-08T02:58:41.432ZDEBGtfportd (producer-registration-task): registering as oximeter producer with Nexus registration_count = 0 unit = producer-server
472026-05-08T02:58:41.433ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::d86c:42ff:fec9:795b]
482026-05-08T02:58:41.433ZDEBGtfportd (kstat-sampler): adding new target unit = oximeter
492026-05-08T02:58:41.434ZDEBGtfportd (kstat-sampler-worker): storing new creation time for tracked target creation_time = 2026-05-08T02:58:24.498796342Z path = KstatPath { module: "link", instance: 0, name: "tfportrear0_0" } unit = oximeter
502026-05-08T02:58:41.434ZDEBGtfportd (kstat-sampler-worker): inserted empty per-target sample queue id = 15344381362915020892 unit = oximeter
512026-05-08T02:58:41.434ZDEBGtfportd: added new link to kstat sampler link_kind = switch-port-control link_name = tfportrear0_0 unit = metrics-task-tracker
522026-05-08T02:58:41.436ZWARNtfportd: tfportqsfp0_0 has no addrs
532026-05-08T02:58:41.982ZINFOtfportd: added new ARP entry entry = 10.151.2.174->86:27:59:58:b0:16 interface = tfportqsfp0_0
542026-05-08T02:58:42.727ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
552026-05-08T02:58:42.733ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::d86c:42ff:fec9:795b]
562026-05-08T02:58:42.736ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
572026-05-08T02:58:42.736ZDEBGtfportd (kstat-sampler): adding new target unit = oximeter
582026-05-08T02:58:42.737ZDEBGtfportd (kstat-sampler-worker): storing new creation time for tracked target creation_time = 2026-05-08T02:58:24.498664939Z path = KstatPath { module: "link", instance: 0, name: "tfportqsfp0_0" } unit = oximeter
592026-05-08T02:58:42.737ZDEBGtfportd (kstat-sampler-worker): inserted empty per-target sample queue id = 697620907606702896 unit = oximeter
602026-05-08T02:58:42.737ZDEBGtfportd: added new link to kstat sampler link_kind = switch-port-control link_name = tfportqsfp0_0 unit = metrics-task-tracker
612026-05-08T02:58:43.414ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
622026-05-08T02:58:43.420ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::d86c:42ff:fec9:795b]
632026-05-08T02:58:43.423ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
642026-05-08T02:58:44.182ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
652026-05-08T02:58:44.188ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::d86c:42ff:fec9:795b]
662026-05-08T02:58:44.191ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
672026-05-08T02:58:44.990ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
682026-05-08T02:58:44.995ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::d86c:42ff:fec9:795b]
692026-05-08T02:58:44.998ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
702026-05-08T02:58:46.034ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
712026-05-08T02:58:46.038ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::d86c:42ff:fec9:795b]
722026-05-08T02:58:46.041ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
732026-05-08T02:58:46.435ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("9dd37190-08b2-4a79-a007-d84bf3387e7e.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("bf4c6a7c-288c-478e-9c3d-e8a203817422.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("c16df408-f701-4085-ba98-22bd907ffeba.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("c16df408-f701-4085-ba98-22bd907ffeba.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 665, tv_nsec: 917641774 } }) unit = producer-server
742026-05-08T02:58:46.436ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
752026-05-08T02:58:46.452ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
762026-05-08T02:58:47.282ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
772026-05-08T02:58:47.288ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::d86c:42ff:fec9:795b]
782026-05-08T02:58:47.291ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
792026-05-08T02:58:48.545ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
802026-05-08T02:58:48.550ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::d86c:42ff:fec9:795b]
812026-05-08T02:58:48.553ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
822026-05-08T02:58:49.276ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
832026-05-08T02:58:49.281ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::d86c:42ff:fec9:795b]
842026-05-08T02:58:49.284ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
852026-05-08T02:58:49.830ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
862026-05-08T02:58:49.835ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::d86c:42ff:fec9:795b]
872026-05-08T02:58:49.838ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
882026-05-08T02:58:51.058ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
892026-05-08T02:58:51.063ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::d86c:42ff:fec9:795b]
902026-05-08T02:58:51.066ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
912026-05-08T02:58:51.438ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 15344381362915020892 n_samples = 6 unit = oximeter
922026-05-08T02:58:52.191ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
932026-05-08T02:58:52.195ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::d86c:42ff:fec9:795b]
942026-05-08T02:58:52.198ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
952026-05-08T02:58:52.739ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 697620907606702896 n_samples = 6 unit = oximeter
962026-05-08T02:58:52.852ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
972026-05-08T02:58:52.856ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::d86c:42ff:fec9:795b]
982026-05-08T02:58:52.860ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
992026-05-08T02:58:53.404ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1002026-05-08T02:58:53.410ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::d86c:42ff:fec9:795b]
1012026-05-08T02:58:53.412ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1022026-05-08T02:58:54.856ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1032026-05-08T02:58:54.860ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::d86c:42ff:fec9:795b]
1042026-05-08T02:58:54.864ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1052026-05-08T02:58:55.571ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1062026-05-08T02:58:55.576ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::d86c:42ff:fec9:795b]
1072026-05-08T02:58:55.579ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1082026-05-08T02:58:57.068ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1092026-05-08T02:58:57.073ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::d86c:42ff:fec9:795b]
1102026-05-08T02:58:57.076ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1112026-05-08T02:58:57.959ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1122026-05-08T02:58:57.964ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::d86c:42ff:fec9:795b]
1132026-05-08T02:58:57.968ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1142026-05-08T02:58:58.568ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1152026-05-08T02:58:58.573ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::d86c:42ff:fec9:795b]
1162026-05-08T02:58:58.576ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1172026-05-08T02:58:59.512ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1182026-05-08T02:58:59.517ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::d86c:42ff:fec9:795b]
1192026-05-08T02:58:59.519ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1202026-05-08T02:59:00.192ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1212026-05-08T02:59:00.197ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::d86c:42ff:fec9:795b]
1222026-05-08T02:59:00.200ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1232026-05-08T02:59:01.451ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1242026-05-08T02:59:01.455ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 15344381362915020892 n_samples = 6 unit = oximeter
1252026-05-08T02:59:01.456ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::d86c:42ff:fec9:795b]
1262026-05-08T02:59:01.459ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1272026-05-08T02:59:01.469ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
1282026-05-08T02:59:01.470ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 0 delay = 20.022133592s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
1292026-05-08T02:59:01.818ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("9dd37190-08b2-4a79-a007-d84bf3387e7e.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("bf4c6a7c-288c-478e-9c3d-e8a203817422.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("c16df408-f701-4085-ba98-22bd907ffeba.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("c16df408-f701-4085-ba98-22bd907ffeba.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 681, tv_nsec: 283145538 } }) unit = producer-server
1302026-05-08T02:59:01.818ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
1312026-05-08T02:59:01.826ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
1322026-05-08T02:59:02.340ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1332026-05-08T02:59:02.344ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::d86c:42ff:fec9:795b]
1342026-05-08T02:59:02.347ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1352026-05-08T02:59:02.761ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 697620907606702896 n_samples = 6 unit = oximeter
1362026-05-08T02:59:03.237ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1372026-05-08T02:59:03.241ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::d86c:42ff:fec9:795b]
1382026-05-08T02:59:03.245ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1392026-05-08T02:59:04.061ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1402026-05-08T02:59:04.065ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::d86c:42ff:fec9:795b]
1412026-05-08T02:59:04.068ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1422026-05-08T02:59:05.457ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1432026-05-08T02:59:05.462ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::d86c:42ff:fec9:795b]
1442026-05-08T02:59:05.466ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1452026-05-08T02:59:06.809ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1462026-05-08T02:59:06.814ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::d86c:42ff:fec9:795b]
1472026-05-08T02:59:06.816ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1482026-05-08T02:59:08.156ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1492026-05-08T02:59:08.161ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::d86c:42ff:fec9:795b]
1502026-05-08T02:59:08.164ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1512026-05-08T02:59:08.992ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1522026-05-08T02:59:08.997ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::d86c:42ff:fec9:795b]
1532026-05-08T02:59:09.000ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1542026-05-08T02:59:09.816ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1552026-05-08T02:59:09.822ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::d86c:42ff:fec9:795b]
1562026-05-08T02:59:09.825ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1572026-05-08T02:59:10.341ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1582026-05-08T02:59:10.345ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::d86c:42ff:fec9:795b]
1592026-05-08T02:59:10.348ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1602026-05-08T02:59:11.486ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 15344381362915020892 n_samples = 6 unit = oximeter
1612026-05-08T02:59:11.841ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1622026-05-08T02:59:11.845ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::d86c:42ff:fec9:795b]
1632026-05-08T02:59:11.848ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1642026-05-08T02:59:12.791ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 697620907606702896 n_samples = 6 unit = oximeter
1652026-05-08T02:59:12.903ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1662026-05-08T02:59:12.908ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::d86c:42ff:fec9:795b]
1672026-05-08T02:59:12.911ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1682026-05-08T02:59:14.271ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1692026-05-08T02:59:14.287ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::d86c:42ff:fec9:795b]
1702026-05-08T02:59:14.294ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1712026-05-08T02:59:15.381ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1722026-05-08T02:59:15.387ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::d86c:42ff:fec9:795b]
1732026-05-08T02:59:15.390ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1742026-05-08T02:59:16.175ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1752026-05-08T02:59:16.180ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::d86c:42ff:fec9:795b]
1762026-05-08T02:59:16.183ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1772026-05-08T02:59:16.868ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
1782026-05-08T02:59:16.869ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 1 delay = 35.379005434s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
1792026-05-08T02:59:17.192ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1802026-05-08T02:59:17.198ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::d86c:42ff:fec9:795b]
1812026-05-08T02:59:17.205ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1822026-05-08T02:59:17.760ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("9dd37190-08b2-4a79-a007-d84bf3387e7e.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("bf4c6a7c-288c-478e-9c3d-e8a203817422.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("c16df408-f701-4085-ba98-22bd907ffeba.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("c16df408-f701-4085-ba98-22bd907ffeba.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 697, tv_nsec: 181952364 } }) unit = producer-server
1832026-05-08T02:59:17.762ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
1842026-05-08T02:59:17.956ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
1852026-05-08T02:59:18.994ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1862026-05-08T02:59:19.001ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::d86c:42ff:fec9:795b]
1872026-05-08T02:59:19.006ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1882026-05-08T02:59:20.229ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1892026-05-08T02:59:20.236ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::d86c:42ff:fec9:795b]
1902026-05-08T02:59:20.240ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1912026-05-08T02:59:21.442ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1922026-05-08T02:59:21.446ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::d86c:42ff:fec9:795b]
1932026-05-08T02:59:21.450ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1942026-05-08T02:59:21.515ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 15344381362915020892 n_samples = 6 unit = oximeter
1952026-05-08T02:59:22.187ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1962026-05-08T02:59:22.194ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::d86c:42ff:fec9:795b]
1972026-05-08T02:59:22.199ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1982026-05-08T02:59:22.819ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 697620907606702896 n_samples = 6 unit = oximeter
1992026-05-08T02:59:23.361ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2002026-05-08T02:59:23.365ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::d86c:42ff:fec9:795b]
2012026-05-08T02:59:23.368ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2022026-05-08T02:59:23.995ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2032026-05-08T02:59:24.001ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::d86c:42ff:fec9:795b]
2042026-05-08T02:59:24.004ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2052026-05-08T02:59:24.672ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2062026-05-08T02:59:24.679ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::d86c:42ff:fec9:795b]
2072026-05-08T02:59:24.682ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2082026-05-08T02:59:25.912ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2092026-05-08T02:59:25.918ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::d86c:42ff:fec9:795b]
2102026-05-08T02:59:25.922ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2112026-05-08T02:59:26.503ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2122026-05-08T02:59:26.508ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::d86c:42ff:fec9:795b]
2132026-05-08T02:59:26.511ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2142026-05-08T02:59:27.278ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2152026-05-08T02:59:27.283ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::d86c:42ff:fec9:795b]
2162026-05-08T02:59:27.287ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2172026-05-08T02:59:28.712ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2182026-05-08T02:59:28.712ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::d86c:42ff:fec9:795b]
2192026-05-08T02:59:28.715ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2202026-05-08T02:59:29.611ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2212026-05-08T02:59:29.618ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::d86c:42ff:fec9:795b]
2222026-05-08T02:59:29.622ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2232026-05-08T02:59:30.700ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2242026-05-08T02:59:30.707ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::d86c:42ff:fec9:795b]
2252026-05-08T02:59:30.711ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2262026-05-08T02:59:31.349ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2272026-05-08T02:59:31.356ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::d86c:42ff:fec9:795b]
2282026-05-08T02:59:31.360ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2292026-05-08T02:59:31.540ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 15344381362915020892 n_samples = 6 unit = oximeter
2302026-05-08T02:59:32.171ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2312026-05-08T02:59:32.179ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::d86c:42ff:fec9:795b]
2322026-05-08T02:59:32.183ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2332026-05-08T02:59:32.840ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 697620907606702896 n_samples = 6 unit = oximeter
2342026-05-08T02:59:32.990ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
2352026-05-08T02:59:32.990ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 2 delay = 51.465599505s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
2362026-05-08T02:59:33.508ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2372026-05-08T02:59:33.513ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::d86c:42ff:fec9:795b]
2382026-05-08T02:59:33.516ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2392026-05-08T02:59:34.046ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2402026-05-08T02:59:34.051ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::d86c:42ff:fec9:795b]
2412026-05-08T02:59:34.054ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2422026-05-08T02:59:34.483ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("9dd37190-08b2-4a79-a007-d84bf3387e7e.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("bf4c6a7c-288c-478e-9c3d-e8a203817422.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("c16df408-f701-4085-ba98-22bd907ffeba.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("c16df408-f701-4085-ba98-22bd907ffeba.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 713, tv_nsec: 872476711 } }) unit = producer-server
2432026-05-08T02:59:34.483ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
2442026-05-08T02:59:34.491ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
2452026-05-08T02:59:34.724ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2462026-05-08T02:59:34.729ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::d86c:42ff:fec9:795b]
2472026-05-08T02:59:34.732ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2482026-05-08T02:59:35.272ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2492026-05-08T02:59:35.277ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::d86c:42ff:fec9:795b]
2502026-05-08T02:59:35.280ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2512026-05-08T02:59:36.464ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2522026-05-08T02:59:36.470ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::d86c:42ff:fec9:795b]
2532026-05-08T02:59:36.473ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2542026-05-08T02:59:37.779ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2552026-05-08T02:59:37.785ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::d86c:42ff:fec9:795b]
2562026-05-08T02:59:37.788ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2572026-05-08T02:59:38.455ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2582026-05-08T02:59:38.463ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::d86c:42ff:fec9:795b]
2592026-05-08T02:59:38.466ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2602026-05-08T02:59:39.887ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2612026-05-08T02:59:39.892ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::d86c:42ff:fec9:795b]
2622026-05-08T02:59:39.896ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2632026-05-08T02:59:41.217ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2642026-05-08T02:59:41.223ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::d86c:42ff:fec9:795b]
2652026-05-08T02:59:41.225ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2662026-05-08T02:59:41.540ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 15344381362915020892 n_samples = 6 unit = oximeter
2672026-05-08T02:59:42.281ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2682026-05-08T02:59:42.289ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::d86c:42ff:fec9:795b]
2692026-05-08T02:59:42.293ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2702026-05-08T02:59:42.840ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 697620907606702896 n_samples = 6 unit = oximeter
2712026-05-08T02:59:43.176ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2722026-05-08T02:59:43.183ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::d86c:42ff:fec9:795b]
2732026-05-08T02:59:43.187ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2742026-05-08T02:59:44.134ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2752026-05-08T02:59:44.139ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::d86c:42ff:fec9:795b]
2762026-05-08T02:59:44.142ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2772026-05-08T02:59:44.658ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2782026-05-08T02:59:44.667ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::d86c:42ff:fec9:795b]
2792026-05-08T02:59:44.672ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2802026-05-08T02:59:45.790ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2812026-05-08T02:59:45.801ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::d86c:42ff:fec9:795b]
2822026-05-08T02:59:45.807ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2832026-05-08T02:59:46.669ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2842026-05-08T02:59:46.684ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::d86c:42ff:fec9:795b]
2852026-05-08T02:59:46.691ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2862026-05-08T02:59:47.871ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2872026-05-08T02:59:47.880ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::d86c:42ff:fec9:795b]
2882026-05-08T02:59:47.885ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2892026-05-08T02:59:55.126ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
2902026-05-08T02:59:55.366ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 15344381362915020892 n_samples = 6 unit = oximeter
2912026-05-08T02:59:55.374ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 697620907606702896 n_samples = 6 unit = oximeter
2922026-05-08T02:59:55.546ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 3 delay = 74.01946561s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
2932026-05-08T02:59:55.864ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2942026-05-08T02:59:55.903ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::d86c:42ff:fec9:795b]
2952026-05-08T02:59:55.945ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2962026-05-08T02:59:57.149ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2972026-05-08T02:59:57.166ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::d86c:42ff:fec9:795b]
2982026-05-08T02:59:57.197ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2992026-05-08T02:59:58.122ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("9dd37190-08b2-4a79-a007-d84bf3387e7e.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("bf4c6a7c-288c-478e-9c3d-e8a203817422.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("c16df408-f701-4085-ba98-22bd907ffeba.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("c16df408-f701-4085-ba98-22bd907ffeba.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 737, tv_nsec: 510264387 } }) unit = producer-server
3002026-05-08T02:59:58.188ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3012026-05-08T02:59:58.194ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
3022026-05-08T02:59:58.204ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::d86c:42ff:fec9:795b]
3032026-05-08T02:59:58.212ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3042026-05-08T02:59:58.244ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
3052026-05-08T02:59:59.335ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3062026-05-08T02:59:59.345ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::d86c:42ff:fec9:795b]
3072026-05-08T02:59:59.351ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3082026-05-08T03:00:00.164ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3092026-05-08T03:00:00.175ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::d86c:42ff:fec9:795b]
3102026-05-08T03:00:00.213ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3112026-05-08T03:00:00.816ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3122026-05-08T03:00:00.828ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::d86c:42ff:fec9:795b]
3132026-05-08T03:00:00.835ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]