Max level shown:
1 [ Dec 23 23:12:34 Enabled. ]
2 [ Dec 23 23:12:34 Rereading configuration. ]
3 [ Dec 23 23:12:35 Rereading configuration. ]
4 [ Dec 23 23:12:46 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dendrite/bin/tfportd --sync-only &"). ]
5 [ Dec 23 23:12:46 Method "start" exited with status 0. ]
6 No non-localhost IPv6 addresses found in SMF properties
72025-12-23T23:12:46.797ZINFOtfportd: connecting to dpd host = [::1] port = 12224
82025-12-23T23:12:46.844ZINFOtfportd: connected to dpd running softnpu-606c0be8
92025-12-23T23:12:46.844ZINFOtfportd: running in sync-only mode
102025-12-23T23:12:46.845ZINFOtfportd: no non-localhost IPv6 listen address available, waiting for SMF update unit = oximeter
112025-12-23T23:12:46.846ZINFOtfportd: refreshing SMF config prior to waiting on signals unit = signal_handler
12 No non-localhost IPv6 addresses found in SMF properties
132025-12-23T23:12:46.848ZINFOtfportd: refreshed config: Config { log_file: None, log_format: Json, listen_addresses: [ [::1]:12231, ], pkt_source: None, dpd_host: "[::1]", dpd_port: 12224, vlan_link: None, vlan_data: None, techport0_prefix: None, techport1_prefix: None, rack_id: Some( 4889a7d1-c9ed-41ac-8a9a-51a50313b7fb, ), sled_id: Some( 48102599-a41b-4fff-9175-96fdb3ee674f, ), sled_model: Some( "i86pc", ), sled_revision: Some( 0, ), sled_serial: Some( "buskin", ), }
142025-12-23T23:12:46.848ZINFOtfportd: no non-localhost IPv6 listen address available, waiting for SMF update unit = oximeter
152025-12-23T23:12:46.853ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::e42b:f7ff:fe70:ed99->e6:2b:f7:70:ed:99 interface = tfportrear0_0
162025-12-23T23:12:46.854ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
172025-12-23T23:12:46.860ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
182025-12-23T23:12:46.865ZWARNtfportd: tfportqsfp0_0 has no addrs
192025-12-23T23:12:47.378ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
202025-12-23T23:12:47.384ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
212025-12-23T23:12:47.387ZWARNtfportd: tfportqsfp0_0 has no addrs
222025-12-23T23:12:47.421ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::c8d6:78ff:fee3:e964->ca:d6:78:e3:e9:64 interface = tfportrear0_0
23 [ Dec 23 23:12:47 Rereading configuration. ]
24 [ Dec 23 23:12:47 Executing refresh method (:kill). ]
25 [ Dec 23 23:12:47 Stopping because all processes in service exited. ]
26 [ Dec 23 23:12:47 Executing stop method (:kill). ]
27 [ Dec 23 23:12:47 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dendrite/bin/tfportd --sync-only &"). ]
28 [ Dec 23 23:12:47 Method "start" exited with status 0. ]
292025-12-23T23:12:47.503ZINFOtfportd: connecting to dpd host = [::1] port = 12224
302025-12-23T23:12:47.543ZINFOtfportd: connected to dpd running softnpu-606c0be8
312025-12-23T23:12:47.544ZINFOtfportd: running in sync-only mode
322025-12-23T23:12:47.544ZINFOtfportd: found suitable IPv6 address for oximeter producer server address = fd00:1122:3344:101::2 unit = oximeter
332025-12-23T23:12:47.545ZINFOtfportd: refreshing SMF config prior to waiting on signals unit = signal_handler
342025-12-23T23:12:47.546ZDEBGtfportd: extracted oximeter configuration data config = OximeterConfig { listen_address: fd00:1122:3344:101::2, sled_identifiers: SledIdentifiers { rack_id: 4889a7d1-c9ed-41ac-8a9a-51a50313b7fb, sled_id: 48102599-a41b-4fff-9175-96fdb3ee674f, model: "i86pc", revision: 0, serial: "buskin" }, switch_identifiers: SwitchIdentifiers { asic_backend: "softnpu", fab: None, lot: None, model: "FAKE_SIM_SIDECAR", revision: 0, serial: "SimSidecar0", sidecar_id: d3318316-88cd-4d9d-89a7-33494aff9b70, slot: 0, wafer: None, wafer_loc: None } } unit = oximeter
352025-12-23T23:12:47.546ZDEBGtfportd: created producer ID producer_id = d3a8015e-e53b-43ce-9248-f411fa024bc4 unit = oximeter
362025-12-23T23:12:47.547ZINFOtfportd: refreshed config: Config { log_file: None, log_format: Json, listen_addresses: [ [fd00:1122:3344:101::2]:12231, [::1]:12231, ], pkt_source: None, dpd_host: "[::1]", dpd_port: 12224, vlan_link: None, vlan_data: None, techport0_prefix: None, techport1_prefix: None, rack_id: Some( 4889a7d1-c9ed-41ac-8a9a-51a50313b7fb, ), sled_id: Some( 48102599-a41b-4fff-9175-96fdb3ee674f, ), sled_model: Some( "i86pc", ), sled_revision: Some( 0, ), sled_serial: Some( "buskin", ), }
372025-12-23T23:12:47.554ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
382025-12-23T23:12:47.555ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::e42b:f7ff:fe70:ed99->e6:2b:f7:70:ed:99 interface = tfportrear0_0
392025-12-23T23:12:47.556ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::c8d6:78ff:fee3:e964->ca:d6:78:e3:e9:64 interface = tfportrear0_0
402025-12-23T23:12:47.557ZDEBGtfportd: registered DTrace probes unit = producer-server
412025-12-23T23:12:47.557ZDEBGtfportd (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::2]:36358 method = GET path = /{producer_id} unit = producer-server versions = all
422025-12-23T23:12:47.558ZINFOtfportd (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.4/src/server.rs:328 local_addr = [fd00:1122:3344:101::2]:36358 unit = producer-server
432025-12-23T23:12:47.558ZDEBGtfportd (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::2]:36358 unit = producer-server
442025-12-23T23:12:47.558ZDEBGtfportd: Requested any available port, Dropshot server has been bound to [fd00:1122:3344:101::2]:36358 unit = producer-server
452025-12-23T23:12:47.558ZDEBGtfportd: Nexus IP not provided, will use DNS to resolve it unit = producer-server
462025-12-23T23:12:47.558ZINFOtfportd (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/e76962a/internal-dns/resolver/src/resolver.rs:144 unit = producer-server
472025-12-23T23:12:47.559ZDEBGtfportd: starting producer registration task unit = producer-server
482025-12-23T23:12:47.559ZINFOtfportd: starting oximeter metric producer server address = [fd00:1122:3344:101::2]:36358 file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/e76962a/oximeter/producer/src/lib.rs:279 interval = 30s producer_id = d3a8015e-e53b-43ce-9248-f411fa024bc4 unit = producer-server
492025-12-23T23:12:47.559ZINFOtfportd: created oximeter producer server unit = oximeter
502025-12-23T23:12:47.559ZDEBGtfportd (producer-registration-task): registering as oximeter producer with Nexus registration_count = 0 unit = producer-server
512025-12-23T23:12:47.560ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
522025-12-23T23:12:47.561ZDEBGtfportd (kstat-sampler): adding new target unit = oximeter
532025-12-23T23:12:47.561ZDEBGtfportd (kstat-sampler-worker): storing new creation time for tracked target creation_time = 2025-12-23T23:12:30.792790620Z path = KstatPath { module: "link", instance: 0, name: "tfportrear0_0" } unit = oximeter
542025-12-23T23:12:47.561ZDEBGtfportd (kstat-sampler-worker): inserted empty per-target sample queue id = 14694353075232564630 unit = oximeter
552025-12-23T23:12:47.561ZDEBGtfportd: added new link to kstat sampler link_kind = switch-port-control link_name = tfportrear0_0 unit = metrics-task-tracker
562025-12-23T23:12:47.563ZWARNtfportd: tfportqsfp0_0 has no addrs
572025-12-23T23:12:49.014ZINFOtfportd: added new ARP entry entry = 10.151.1.174->7a:f6:6d:19:87:3e interface = tfportqsfp0_0
582025-12-23T23:12:49.070ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
592025-12-23T23:12:49.075ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
602025-12-23T23:12:49.078ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
612025-12-23T23:12:49.078ZDEBGtfportd (kstat-sampler): adding new target unit = oximeter
622025-12-23T23:12:49.080ZDEBGtfportd (kstat-sampler-worker): storing new creation time for tracked target creation_time = 2025-12-23T23:12:30.792645309Z path = KstatPath { module: "link", instance: 0, name: "tfportqsfp0_0" } unit = oximeter
632025-12-23T23:12:49.080ZDEBGtfportd (kstat-sampler-worker): inserted empty per-target sample queue id = 14482000139896466522 unit = oximeter
642025-12-23T23:12:49.080ZDEBGtfportd: added new link to kstat sampler link_kind = switch-port-control link_name = tfportqsfp0_0 unit = metrics-task-tracker
652025-12-23T23:12:49.823ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
662025-12-23T23:12:49.828ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
672025-12-23T23:12:49.831ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
682025-12-23T23:12:50.689ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
692025-12-23T23:12:50.695ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
702025-12-23T23:12:50.698ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
712025-12-23T23:12:51.540ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
722025-12-23T23:12:51.545ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
732025-12-23T23:12:51.548ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
742025-12-23T23:12:52.563ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("213c9834-4b09-4f55-b603-eedd1591beb5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("33e2dd55-dc49-46eb-acd0-2f3d1ff43cec.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("f6985ec1-5d90-44e3-a615-48bb538b8da5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("f6985ec1-5d90-44e3-a615-48bb538b8da5.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 649, tv_nsec: 83039934 } }) unit = producer-server
752025-12-23T23:12:52.563ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221 unit = producer-server
762025-12-23T23:12:52.594ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
772025-12-23T23:12:52.595ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
782025-12-23T23:12:52.601ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
792025-12-23T23:12:52.603ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
802025-12-23T23:12:53.254ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
812025-12-23T23:12:53.259ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
822025-12-23T23:12:53.262ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
832025-12-23T23:12:53.930ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
842025-12-23T23:12:53.935ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
852025-12-23T23:12:53.938ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
862025-12-23T23:12:55.010ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
872025-12-23T23:12:55.018ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
882025-12-23T23:12:55.021ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
892025-12-23T23:12:56.079ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
902025-12-23T23:12:56.083ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
912025-12-23T23:12:56.086ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
922025-12-23T23:12:57.158ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
932025-12-23T23:12:57.164ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
942025-12-23T23:12:57.166ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
952025-12-23T23:12:57.566ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 14694353075232564630 n_samples = 6 unit = oximeter
962025-12-23T23:12:58.055ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
972025-12-23T23:12:58.060ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
982025-12-23T23:12:58.063ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
992025-12-23T23:12:58.672ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1002025-12-23T23:12:58.676ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
1012025-12-23T23:12:58.680ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1022025-12-23T23:12:59.083ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 14482000139896466522 n_samples = 6 unit = oximeter
1032025-12-23T23:13:00.093ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1042025-12-23T23:13:00.099ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
1052025-12-23T23:13:00.102ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1062025-12-23T23:13:01.101ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1072025-12-23T23:13:01.106ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
1082025-12-23T23:13:01.109ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1092025-12-23T23:13:02.060ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1102025-12-23T23:13:02.065ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
1112025-12-23T23:13:02.068ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1122025-12-23T23:13:02.741ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1132025-12-23T23:13:02.746ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
1142025-12-23T23:13:02.749ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1152025-12-23T23:13:03.759ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1162025-12-23T23:13:03.764ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
1172025-12-23T23:13:03.767ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1182025-12-23T23:13:04.920ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1192025-12-23T23:13:04.930ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
1202025-12-23T23:13:04.935ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1212025-12-23T23:13:06.254ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1222025-12-23T23:13:06.259ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
1232025-12-23T23:13:06.262ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1242025-12-23T23:13:06.991ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1252025-12-23T23:13:06.996ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
1262025-12-23T23:13:07.000ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1272025-12-23T23:13:07.701ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1282025-12-23T23:13:07.707ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
1292025-12-23T23:13:07.710ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1302025-12-23T23:13:07.783ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 14694353075232564630 n_samples = 6 unit = oximeter
1312025-12-23T23:13:07.809ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }) unit = producer-server
1322025-12-23T23:13:07.810ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 0 delay = 20.036771005s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/e76962a/oximeter/producer/src/lib.rs:371 unit = producer-server
1332025-12-23T23:13:07.951ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("213c9834-4b09-4f55-b603-eedd1591beb5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("33e2dd55-dc49-46eb-acd0-2f3d1ff43cec.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("f6985ec1-5d90-44e3-a615-48bb538b8da5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("f6985ec1-5d90-44e3-a615-48bb538b8da5.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 664, tv_nsec: 256850417 } }) unit = producer-server
1342025-12-23T23:13:07.952ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221 unit = producer-server
1352025-12-23T23:13:08.022ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
1362025-12-23T23:13:08.908ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1372025-12-23T23:13:08.916ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
1382025-12-23T23:13:08.925ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1392025-12-23T23:13:09.311ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 14482000139896466522 n_samples = 6 unit = oximeter
1402025-12-23T23:13:09.657ZINFOtfportd: removed stale NDP entry :fe80::c8d6:78ff:fee3:e964->ca:d6:78:e3:e9:64
1412025-12-23T23:13:10.216ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1422025-12-23T23:13:10.224ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
1432025-12-23T23:13:10.228ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1442025-12-23T23:13:10.761ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::c8d6:78ff:fee3:e964->ca:d6:78:e3:e9:64 interface = tfportrear0_0
1452025-12-23T23:13:11.005ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1462025-12-23T23:13:11.013ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
1472025-12-23T23:13:11.018ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1482025-12-23T23:13:12.010ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1492025-12-23T23:13:12.015ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
1502025-12-23T23:13:12.018ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1512025-12-23T23:13:12.659ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1522025-12-23T23:13:12.669ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
1532025-12-23T23:13:12.671ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1542025-12-23T23:13:14.144ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1552025-12-23T23:13:14.149ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
1562025-12-23T23:13:14.152ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1572025-12-23T23:13:15.456ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1582025-12-23T23:13:15.460ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
1592025-12-23T23:13:15.463ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1602025-12-23T23:13:16.125ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1612025-12-23T23:13:16.130ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
1622025-12-23T23:13:16.133ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1632025-12-23T23:13:17.439ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1642025-12-23T23:13:17.445ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
1652025-12-23T23:13:17.448ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1662025-12-23T23:13:17.813ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 14694353075232564630 n_samples = 6 unit = oximeter
1672025-12-23T23:13:17.976ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1682025-12-23T23:13:17.981ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
1692025-12-23T23:13:17.984ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1702025-12-23T23:13:19.341ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 14482000139896466522 n_samples = 6 unit = oximeter
1712025-12-23T23:13:19.437ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1722025-12-23T23:13:19.442ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
1732025-12-23T23:13:19.445ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1742025-12-23T23:13:20.260ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1752025-12-23T23:13:20.267ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
1762025-12-23T23:13:20.269ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1772025-12-23T23:13:21.180ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1782025-12-23T23:13:21.185ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
1792025-12-23T23:13:21.188ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1802025-12-23T23:13:22.689ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1812025-12-23T23:13:22.694ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
1822025-12-23T23:13:22.697ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1832025-12-23T23:13:23.066ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }) unit = producer-server
1842025-12-23T23:13:23.067ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 1 delay = 35.251953507s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/e76962a/oximeter/producer/src/lib.rs:371 unit = producer-server
1852025-12-23T23:13:23.451ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("213c9834-4b09-4f55-b603-eedd1591beb5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("33e2dd55-dc49-46eb-acd0-2f3d1ff43cec.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("f6985ec1-5d90-44e3-a615-48bb538b8da5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("f6985ec1-5d90-44e3-a615-48bb538b8da5.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 679, tv_nsec: 713852129 } }) unit = producer-server
1862025-12-23T23:13:23.451ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221 unit = producer-server
1872025-12-23T23:13:23.483ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
1882025-12-23T23:13:23.863ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1892025-12-23T23:13:23.870ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
1902025-12-23T23:13:23.873ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1912025-12-23T23:13:24.962ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1922025-12-23T23:13:30.530ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 14694353075232564630 n_samples = 6 unit = oximeter
1932025-12-23T23:13:30.530ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 14482000139896466522 n_samples = 6 unit = oximeter
1942025-12-23T23:13:30.548ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
1952025-12-23T23:13:30.627ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1962025-12-23T23:13:31.963ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1972025-12-23T23:13:31.971ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
1982025-12-23T23:13:31.975ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1992025-12-23T23:13:32.542ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2002025-12-23T23:13:32.550ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
2012025-12-23T23:13:32.554ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2022025-12-23T23:13:33.125ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2032025-12-23T23:13:33.132ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
2042025-12-23T23:13:33.136ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2052025-12-23T23:13:33.924ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2062025-12-23T23:13:33.933ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
2072025-12-23T23:13:33.938ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2082025-12-23T23:13:34.353ZINFOtfportd: removed stale NDP entry :fe80::c8d6:78ff:fee3:e964->ca:d6:78:e3:e9:64
2092025-12-23T23:13:34.925ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2102025-12-23T23:13:34.930ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::c8d6:78ff:fee3:e964->ca:d6:78:e3:e9:64 interface = tfportrear0_0
2112025-12-23T23:13:34.931ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
2122025-12-23T23:13:34.934ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2132025-12-23T23:13:35.859ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2142025-12-23T23:13:35.868ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
2152025-12-23T23:13:35.871ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2162025-12-23T23:13:37.001ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2172025-12-23T23:13:37.007ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
2182025-12-23T23:13:37.010ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2192025-12-23T23:13:37.975ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2202025-12-23T23:13:37.980ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
2212025-12-23T23:13:38.120ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2222025-12-23T23:13:38.527ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }) unit = producer-server
2232025-12-23T23:13:38.530ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 2 delay = 50.672231313s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/e76962a/oximeter/producer/src/lib.rs:371 unit = producer-server
2242025-12-23T23:13:39.370ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("213c9834-4b09-4f55-b603-eedd1591beb5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("33e2dd55-dc49-46eb-acd0-2f3d1ff43cec.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("f6985ec1-5d90-44e3-a615-48bb538b8da5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("f6985ec1-5d90-44e3-a615-48bb538b8da5.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 695, tv_nsec: 588975982 } }) unit = producer-server
2252025-12-23T23:13:39.370ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221 unit = producer-server
2262025-12-23T23:13:39.402ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
2272025-12-23T23:13:39.520ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2282025-12-23T23:13:39.526ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
2292025-12-23T23:13:39.529ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2302025-12-23T23:13:40.525ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2312025-12-23T23:13:40.529ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
2322025-12-23T23:13:40.532ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2332025-12-23T23:13:40.560ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 14694353075232564630 n_samples = 6 unit = oximeter
2342025-12-23T23:13:40.561ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 14482000139896466522 n_samples = 6 unit = oximeter
2352025-12-23T23:13:41.724ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2362025-12-23T23:13:41.729ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
2372025-12-23T23:13:41.732ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2382025-12-23T23:13:42.611ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2392025-12-23T23:13:42.616ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
2402025-12-23T23:13:42.618ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2412025-12-23T23:13:43.386ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2422025-12-23T23:13:43.391ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
2432025-12-23T23:13:43.394ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2442025-12-23T23:13:44.228ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2452025-12-23T23:13:44.234ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
2462025-12-23T23:13:44.237ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2472025-12-23T23:13:45.570ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2482025-12-23T23:13:45.575ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
2492025-12-23T23:13:45.579ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2502025-12-23T23:13:46.345ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2512025-12-23T23:13:46.350ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
2522025-12-23T23:13:46.353ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2532025-12-23T23:13:47.010ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2542025-12-23T23:13:47.015ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
2552025-12-23T23:13:47.018ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2562025-12-23T23:13:47.632ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2572025-12-23T23:13:47.637ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
2582025-12-23T23:13:47.640ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2592025-12-23T23:13:48.681ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2602025-12-23T23:13:48.686ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
2612025-12-23T23:13:48.689ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2622025-12-23T23:13:49.700ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2632025-12-23T23:13:49.705ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
2642025-12-23T23:13:49.708ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2652025-12-23T23:13:50.554ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2662025-12-23T23:13:50.559ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
2672025-12-23T23:13:50.563ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2682025-12-23T23:13:50.589ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 14694353075232564630 n_samples = 6 unit = oximeter
2692025-12-23T23:13:50.590ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 14482000139896466522 n_samples = 6 unit = oximeter
2702025-12-23T23:13:51.361ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2712025-12-23T23:13:51.367ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
2722025-12-23T23:13:51.370ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2732025-12-23T23:13:52.436ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2742025-12-23T23:13:52.443ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
2752025-12-23T23:13:52.446ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2762025-12-23T23:13:53.386ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2772025-12-23T23:13:53.391ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
2782025-12-23T23:13:53.394ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2792025-12-23T23:13:54.444ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }) unit = producer-server
2802025-12-23T23:13:54.445ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 3 delay = 66.544887034s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/e76962a/oximeter/producer/src/lib.rs:371 unit = producer-server
2812025-12-23T23:13:54.478ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2822025-12-23T23:13:54.487ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
2832025-12-23T23:13:54.492ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2842025-12-23T23:13:55.679ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2852025-12-23T23:13:55.687ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
2862025-12-23T23:13:55.703ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2872025-12-23T23:13:56.134ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("213c9834-4b09-4f55-b603-eedd1591beb5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("33e2dd55-dc49-46eb-acd0-2f3d1ff43cec.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("f6985ec1-5d90-44e3-a615-48bb538b8da5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("f6985ec1-5d90-44e3-a615-48bb538b8da5.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 712, tv_nsec: 301504635 } }) unit = producer-server
2882025-12-23T23:13:56.140ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221 unit = producer-server
2892025-12-23T23:13:56.231ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
2902025-12-23T23:13:56.392ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2912025-12-23T23:13:56.400ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
2922025-12-23T23:13:56.405ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2932025-12-23T23:13:57.579ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2942025-12-23T23:13:57.590ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
2952025-12-23T23:13:57.597ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2962025-12-23T23:13:58.591ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2972025-12-23T23:13:58.599ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
2982025-12-23T23:13:58.605ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2992025-12-23T23:13:59.355ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3002025-12-23T23:13:59.361ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
3012025-12-23T23:13:59.368ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3022025-12-23T23:14:00.651ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 14694353075232564630 n_samples = 6 unit = oximeter
3032025-12-23T23:14:00.653ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 14482000139896466522 n_samples = 6 unit = oximeter
3042025-12-23T23:14:00.670ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3052025-12-23T23:14:00.720ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
3062025-12-23T23:14:00.725ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3072025-12-23T23:14:02.089ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3082025-12-23T23:14:02.097ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
3092025-12-23T23:14:02.101ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3102025-12-23T23:14:02.872ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3112025-12-23T23:14:02.878ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
3122025-12-23T23:14:02.882ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3132025-12-23T23:14:03.455ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3142025-12-23T23:14:03.462ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
3152025-12-23T23:14:03.464ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3162025-12-23T23:14:04.209ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3172025-12-23T23:14:04.217ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
3182025-12-23T23:14:04.221ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3192025-12-23T23:14:05.072ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3202025-12-23T23:14:05.082ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
3212025-12-23T23:14:05.089ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3222025-12-23T23:14:05.755ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3232025-12-23T23:14:05.761ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
3242025-12-23T23:14:05.764ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3252025-12-23T23:14:06.619ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3262025-12-23T23:14:06.625ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
3272025-12-23T23:14:06.628ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3282025-12-23T23:14:07.282ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3292025-12-23T23:14:07.287ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
3302025-12-23T23:14:07.290ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3312025-12-23T23:14:08.466ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3322025-12-23T23:14:08.476ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
3332025-12-23T23:14:08.480ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3342025-12-23T23:14:09.688ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3352025-12-23T23:14:09.695ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
3362025-12-23T23:14:09.698ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3372025-12-23T23:14:10.633ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3382025-12-23T23:14:10.639ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
3392025-12-23T23:14:10.642ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3402025-12-23T23:14:10.654ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 14694353075232564630 n_samples = 6 unit = oximeter
3412025-12-23T23:14:10.655ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 14482000139896466522 n_samples = 6 unit = oximeter
3422025-12-23T23:14:11.235ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }) unit = producer-server
3432025-12-23T23:14:11.237ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 4 delay = 83.33526848s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/e76962a/oximeter/producer/src/lib.rs:371 unit = producer-server
3442025-12-23T23:14:11.737ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3452025-12-23T23:14:11.743ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
3462025-12-23T23:14:11.746ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3472025-12-23T23:14:13.110ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3482025-12-23T23:14:13.117ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
3492025-12-23T23:14:13.119ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3502025-12-23T23:14:14.455ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3512025-12-23T23:14:14.461ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
3522025-12-23T23:14:14.468ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3532025-12-23T23:14:15.357ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3542025-12-23T23:14:15.363ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
3552025-12-23T23:14:15.366ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3562025-12-23T23:14:15.801ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("213c9834-4b09-4f55-b603-eedd1591beb5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("33e2dd55-dc49-46eb-acd0-2f3d1ff43cec.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("f6985ec1-5d90-44e3-a615-48bb538b8da5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("f6985ec1-5d90-44e3-a615-48bb538b8da5.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 731, tv_nsec: 977394368 } }) unit = producer-server
3572025-12-23T23:14:15.809ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221 unit = producer-server
3582025-12-23T23:14:15.848ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
3592025-12-23T23:14:16.006ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3602025-12-23T23:14:16.011ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
3612025-12-23T23:14:16.013ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3622025-12-23T23:14:17.366ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3632025-12-23T23:14:17.371ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
3642025-12-23T23:14:17.374ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3652025-12-23T23:14:18.387ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3662025-12-23T23:14:18.392ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
3672025-12-23T23:14:18.395ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3682025-12-23T23:14:19.738ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3692025-12-23T23:14:19.743ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
3702025-12-23T23:14:19.746ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3712025-12-23T23:14:20.658ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 14694353075232564630 n_samples = 6 unit = oximeter
3722025-12-23T23:14:20.659ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 14482000139896466522 n_samples = 6 unit = oximeter
3732025-12-23T23:14:20.735ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3742025-12-23T23:14:20.740ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
3752025-12-23T23:14:20.743ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3762025-12-23T23:14:21.895ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3772025-12-23T23:14:21.901ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
3782025-12-23T23:14:21.904ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3792025-12-23T23:14:22.810ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3802025-12-23T23:14:22.815ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
3812025-12-23T23:14:22.819ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3822025-12-23T23:14:23.403ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3832025-12-23T23:14:23.412ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
3842025-12-23T23:14:23.415ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3852025-12-23T23:14:24.526ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3862025-12-23T23:14:24.532ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
3872025-12-23T23:14:24.535ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3882025-12-23T23:14:25.726ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3892025-12-23T23:14:25.731ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
3902025-12-23T23:14:25.742ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3912025-12-23T23:14:26.715ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3922025-12-23T23:14:26.722ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
3932025-12-23T23:14:26.724ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3942025-12-23T23:14:28.129ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3952025-12-23T23:14:28.135ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
3962025-12-23T23:14:28.146ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3972025-12-23T23:14:28.888ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3982025-12-23T23:14:28.893ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
3992025-12-23T23:14:28.896ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4002025-12-23T23:14:30.162ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4012025-12-23T23:14:30.168ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
4022025-12-23T23:14:30.171ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4032025-12-23T23:14:30.663ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 14694353075232564630 n_samples = 6 unit = oximeter
4042025-12-23T23:14:30.663ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 14482000139896466522 n_samples = 6 unit = oximeter
4052025-12-23T23:14:30.849ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }) unit = producer-server
4062025-12-23T23:14:30.850ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 5 delay = 102.947712212s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/e76962a/oximeter/producer/src/lib.rs:371 unit = producer-server
4072025-12-23T23:14:30.972ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4082025-12-23T23:14:30.979ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
4092025-12-23T23:14:30.984ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4102025-12-23T23:14:31.900ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4112025-12-23T23:14:31.907ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
4122025-12-23T23:14:31.911ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4132025-12-23T23:14:33.250ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4142025-12-23T23:14:33.256ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
4152025-12-23T23:14:33.260ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4162025-12-23T23:14:34.160ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4172025-12-23T23:14:34.166ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
4182025-12-23T23:14:34.169ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4192025-12-23T23:14:34.850ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4202025-12-23T23:14:34.860ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
4212025-12-23T23:14:34.865ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4222025-12-23T23:14:36.013ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4232025-12-23T23:14:36.022ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
4242025-12-23T23:14:36.026ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4252025-12-23T23:14:37.209ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4262025-12-23T23:14:37.216ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
4272025-12-23T23:14:37.219ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4282025-12-23T23:14:37.986ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4292025-12-23T23:14:37.991ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
4302025-12-23T23:14:37.995ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4312025-12-23T23:14:39.288ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4322025-12-23T23:14:39.294ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
4332025-12-23T23:14:39.297ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4342025-12-23T23:14:39.833ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("213c9834-4b09-4f55-b603-eedd1591beb5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("33e2dd55-dc49-46eb-acd0-2f3d1ff43cec.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("f6985ec1-5d90-44e3-a615-48bb538b8da5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("f6985ec1-5d90-44e3-a615-48bb538b8da5.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 756, tv_nsec: 9655387 } }) unit = producer-server
4352025-12-23T23:14:39.833ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221 unit = producer-server
4362025-12-23T23:14:39.864ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
4372025-12-23T23:14:39.872ZDEBGtfportd (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "246ffe14-92cd-43b4-a08d-6a7acc34e2ac", "content-length": "41", "date": "Tue, 23 Dec 2025 23:14:39 GMT"} }) unit = producer-server
4382025-12-23T23:14:39.873ZDEBGtfportd (producer-registration-task): successfully registered with Nexus, pausing until time to renew lease lease_duration = 600s unit = producer-server wait_period = 150s
4392025-12-23T23:14:40.666ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 14694353075232564630 n_samples = 6 unit = oximeter
4402025-12-23T23:14:40.667ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 14482000139896466522 n_samples = 6 unit = oximeter
4412025-12-23T23:14:40.786ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4422025-12-23T23:14:40.792ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
4432025-12-23T23:14:40.795ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4442025-12-23T23:14:42.139ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4452025-12-23T23:14:42.145ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
4462025-12-23T23:14:42.148ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4472025-12-23T23:14:43.389ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4482025-12-23T23:14:43.395ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
4492025-12-23T23:14:43.399ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4502025-12-23T23:14:44.025ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4512025-12-23T23:14:44.031ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
4522025-12-23T23:14:44.034ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4532025-12-23T23:14:44.743ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4542025-12-23T23:14:44.749ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
4552025-12-23T23:14:44.752ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4562025-12-23T23:14:45.768ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4572025-12-23T23:14:45.774ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
4582025-12-23T23:14:45.777ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4592025-12-23T23:14:47.227ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4602025-12-23T23:14:47.233ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
4612025-12-23T23:14:47.236ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4622025-12-23T23:14:47.808ZINFOtfportd (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.4/src/server.rs:1025 local_addr = [fd00:1122:3344:101::2]:36358 remote_addr = [fd00:1122:3344:101::d]:50197 unit = producer-server
4632025-12-23T23:14:47.829ZINFOtfportd (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.4/src/server.rs:867 latency_us = 18695 local_addr = [fd00:1122:3344:101::2]:36358 method = GET remote_addr = [fd00:1122:3344:101::d]:50197 req_id = 1875d4f6-5a07-4478-8480-315cdff564c5 response_code = 200 unit = producer-server uri = /d3a8015e-e53b-43ce-9248-f411fa024bc4
4642025-12-23T23:14:47.986ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4652025-12-23T23:14:47.992ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
4662025-12-23T23:14:47.996ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4672025-12-23T23:14:48.948ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4682025-12-23T23:14:48.954ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
4692025-12-23T23:14:48.957ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4702025-12-23T23:14:50.167ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4712025-12-23T23:14:50.173ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
4722025-12-23T23:14:50.176ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4732025-12-23T23:14:50.671ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 14694353075232564630 n_samples = 6 unit = oximeter
4742025-12-23T23:14:50.671ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 14482000139896466522 n_samples = 6 unit = oximeter
4752025-12-23T23:14:50.703ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4762025-12-23T23:14:50.709ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
4772025-12-23T23:14:50.713ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4782025-12-23T23:14:51.236ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4792025-12-23T23:14:51.241ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
4802025-12-23T23:14:51.244ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4812025-12-23T23:14:52.629ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4822025-12-23T23:14:52.634ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
4832025-12-23T23:14:52.638ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4842025-12-23T23:14:53.608ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4852025-12-23T23:14:53.614ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
4862025-12-23T23:14:53.616ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4872025-12-23T23:14:54.600ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4882025-12-23T23:14:54.606ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
4892025-12-23T23:14:54.609ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4902025-12-23T23:14:55.169ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4912025-12-23T23:14:55.175ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
4922025-12-23T23:14:55.178ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4932025-12-23T23:14:56.219ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4942025-12-23T23:14:56.225ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
4952025-12-23T23:14:56.228ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4962025-12-23T23:14:57.325ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4972025-12-23T23:14:57.331ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
4982025-12-23T23:14:57.334ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4992025-12-23T23:14:58.474ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5002025-12-23T23:14:58.480ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
5012025-12-23T23:14:58.483ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5022025-12-23T23:14:59.054ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5032025-12-23T23:14:59.060ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
5042025-12-23T23:14:59.064ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5052025-12-23T23:14:59.820ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5062025-12-23T23:14:59.826ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
5072025-12-23T23:14:59.830ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5082025-12-23T23:15:00.454ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5092025-12-23T23:15:00.460ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
5102025-12-23T23:15:00.464ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5112025-12-23T23:15:00.674ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 14694353075232564630 n_samples = 6 unit = oximeter
5122025-12-23T23:15:00.676ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 14482000139896466522 n_samples = 6 unit = oximeter
5132025-12-23T23:15:01.679ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5142025-12-23T23:15:01.688ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e42b:f7ff:fe70:ed99]
5152025-12-23T23:15:01.693ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]