Max level shown:
1 [ Sep 6 02:12:22 Enabled. ]
2 [ Sep 6 02:12:22 Rereading configuration. ]
3 [ Sep 6 02:12:23 Rereading configuration. ]
4 [ Sep 6 02:12:34 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dendrite/bin/tfportd --sync-only &"). ]
5 [ Sep 6 02:12:34 Method "start" exited with status 0. ]
6 No non-localhost IPv6 addresses found in SMF properties
72025-09-06T02:12:34.695ZINFOtfportd: connecting to dpd host = [::1] port = 12224
82025-09-06T02:12:34.739ZINFOtfportd: connected to dpd running softnpu-d2f5e154
92025-09-06T02:12:34.740ZINFOtfportd: running in sync-only mode
102025-09-06T02:12:34.740ZINFOtfportd: no non-localhost IPv6 listen address available, waiting for SMF update unit = oximeter
112025-09-06T02:12:34.750ZINFOtfportd: refreshing SMF config prior to waiting on signals unit = signal_handler
12 No non-localhost IPv6 addresses found in SMF properties
132025-09-06T02:12:34.752ZINFOtfportd: refreshed config: Config { log_file: None, log_format: Json, listen_addresses: [ [::1]:12231, ], pkt_source: None, dpd_host: "[::1]", dpd_port: 12224, vlan_link: None, vlan_data: None, techport0_prefix: None, techport1_prefix: None, rack_id: Some( 5ccb3a59-f08f-48f9-9576-d9a656a66012, ), sled_id: Some( 8952ad73-ed6b-4696-b2cb-d36e841abad5, ), sled_model: Some( "i86pc", ), sled_revision: Some( 0, ), sled_serial: Some( "buskin", ), }
142025-09-06T02:12:34.752ZINFOtfportd: no non-localhost IPv6 listen address available, waiting for SMF update unit = oximeter
152025-09-06T02:12:34.753ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::42c:bdff:fe8b:1bff->06:2c:bd:8b:1b:ff interface = tfportrear0_0
162025-09-06T02:12:34.757ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
172025-09-06T02:12:34.769ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
182025-09-06T02:12:34.778ZWARNtfportd: tfportqsfp0_0 has no addrs
19 [ Sep 6 02:12:35 Rereading configuration. ]
20 [ Sep 6 02:12:35 Executing refresh method (:kill). ]
21 [ Sep 6 02:12:35 Stopping because all processes in service exited. ]
22 [ Sep 6 02:12:35 Executing stop method (:kill). ]
23 [ Sep 6 02:12:35 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dendrite/bin/tfportd --sync-only &"). ]
24 [ Sep 6 02:12:35 Method "start" exited with status 0. ]
252025-09-06T02:12:35.325ZINFOtfportd: connecting to dpd host = [::1] port = 12224
262025-09-06T02:12:35.366ZINFOtfportd: connected to dpd running softnpu-d2f5e154
272025-09-06T02:12:35.367ZINFOtfportd: running in sync-only mode
282025-09-06T02:12:35.367ZINFOtfportd: found suitable IPv6 address for oximeter producer server address = fd00:1122:3344:101::2 unit = oximeter
292025-09-06T02:12:35.377ZINFOtfportd: refreshing SMF config prior to waiting on signals unit = signal_handler
302025-09-06T02:12:35.377ZDEBGtfportd: extracted oximeter configuration data config = OximeterConfig { listen_address: fd00:1122:3344:101::2, sled_identifiers: SledIdentifiers { rack_id: 5ccb3a59-f08f-48f9-9576-d9a656a66012, sled_id: 8952ad73-ed6b-4696-b2cb-d36e841abad5, model: "i86pc", revision: 0, serial: "buskin" }, switch_identifiers: SwitchIdentifiers { asic_backend: "softnpu", fab: None, lot: None, model: "FAKE_SIM_SIDECAR", revision: 0, serial: "SimSidecar0", sidecar_id: 3af152bb-bbe5-4111-96d7-aff0ff8480a4, slot: 0, wafer: None, wafer_loc: None } } unit = oximeter
312025-09-06T02:12:35.377ZDEBGtfportd: created producer ID producer_id = ef68c591-a601-4f7e-b16a-a5382d385a63 unit = oximeter
322025-09-06T02:12:35.378ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::42c:bdff:fe8b:1bff->06:2c:bd:8b:1b:ff interface = tfportrear0_0
332025-09-06T02:12:35.378ZINFOtfportd: refreshed config: Config { log_file: None, log_format: Json, listen_addresses: [ [fd00:1122:3344:101::2]:12231, [::1]:12231, ], pkt_source: None, dpd_host: "[::1]", dpd_port: 12224, vlan_link: None, vlan_data: None, techport0_prefix: None, techport1_prefix: None, rack_id: Some( 5ccb3a59-f08f-48f9-9576-d9a656a66012, ), sled_id: Some( 8952ad73-ed6b-4696-b2cb-d36e841abad5, ), sled_model: Some( "i86pc", ), sled_revision: Some( 0, ), sled_serial: Some( "buskin", ), }
342025-09-06T02:12:35.378ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::9040:41ff:fec5:7e48->92:40:41:c5:7e:48 interface = tfportrear0_0
352025-09-06T02:12:35.387ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
362025-09-06T02:12:35.390ZDEBGtfportd: registered DTrace probes unit = producer-server
372025-09-06T02:12:35.391ZDEBGtfportd (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::2]:53152 method = GET path = /{producer_id} unit = producer-server versions = all
382025-09-06T02:12:35.391ZINFOtfportd (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.3/src/server.rs:328 local_addr = [fd00:1122:3344:101::2]:53152 unit = producer-server
392025-09-06T02:12:35.391ZDEBGtfportd (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::2]:53152 unit = producer-server
402025-09-06T02:12:35.391ZDEBGtfportd: Requested any available port, Dropshot server has been bound to [fd00:1122:3344:101::2]:53152 unit = producer-server
412025-09-06T02:12:35.392ZDEBGtfportd: Nexus IP not provided, will use DNS to resolve it unit = producer-server
422025-09-06T02:12:35.392ZINFOtfportd (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/dab6693/internal-dns/resolver/src/resolver.rs:144 unit = producer-server
432025-09-06T02:12:35.392ZDEBGtfportd: starting producer registration task unit = producer-server
442025-09-06T02:12:35.392ZINFOtfportd: starting oximeter metric producer server address = [fd00:1122:3344:101::2]:53152 file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/dab6693/oximeter/producer/src/lib.rs:279 interval = 30s producer_id = ef68c591-a601-4f7e-b16a-a5382d385a63 unit = producer-server
452025-09-06T02:12:35.392ZINFOtfportd: created oximeter producer server unit = oximeter
462025-09-06T02:12:35.392ZDEBGtfportd (producer-registration-task): registering as oximeter producer with Nexus registration_count = 0 unit = producer-server
472025-09-06T02:12:35.401ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
482025-09-06T02:12:35.401ZDEBGtfportd (kstat-sampler): adding new target unit = oximeter
492025-09-06T02:12:35.406ZDEBGtfportd (kstat-sampler-worker): storing new creation time for tracked target creation_time = 2025-09-06T02:12:18.547762401Z path = KstatPath { module: "link", instance: 0, name: "tfportrear0_0" } unit = oximeter
502025-09-06T02:12:35.406ZDEBGtfportd (kstat-sampler-worker): inserted empty per-target sample queue id = 18184527020775975995 unit = oximeter
512025-09-06T02:12:35.406ZDEBGtfportd: added new link to kstat sampler link_kind = switch-port-control link_name = tfportrear0_0 unit = metrics-task-tracker
522025-09-06T02:12:35.409ZWARNtfportd: tfportqsfp0_0 has no addrs
532025-09-06T02:12:36.654ZINFOtfportd: added new ARP entry entry = 10.151.1.174->f6:7c:a1:1d:60:a2 interface = tfportqsfp0_0
542025-09-06T02:12:36.892ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
552025-09-06T02:12:36.903ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
562025-09-06T02:12:36.910ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
572025-09-06T02:12:36.910ZDEBGtfportd (kstat-sampler): adding new target unit = oximeter
582025-09-06T02:12:36.911ZDEBGtfportd (kstat-sampler-worker): storing new creation time for tracked target creation_time = 2025-09-06T02:12:18.547622409Z path = KstatPath { module: "link", instance: 0, name: "tfportqsfp0_0" } unit = oximeter
592025-09-06T02:12:36.911ZDEBGtfportd (kstat-sampler-worker): inserted empty per-target sample queue id = 1305892679055758413 unit = oximeter
602025-09-06T02:12:36.911ZDEBGtfportd: added new link to kstat sampler link_kind = switch-port-control link_name = tfportqsfp0_0 unit = metrics-task-tracker
612025-09-06T02:12:37.430ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
622025-09-06T02:12:37.440ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
632025-09-06T02:12:37.446ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
642025-09-06T02:12:38.199ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
652025-09-06T02:12:38.213ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
662025-09-06T02:12:38.220ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
672025-09-06T02:12:38.774ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
682025-09-06T02:12:38.785ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
692025-09-06T02:12:38.791ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
702025-09-06T02:12:40.103ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
712025-09-06T02:12:40.115ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
722025-09-06T02:12:40.121ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
732025-09-06T02:12:40.395ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("4e71e6d5-3c39-4dcf-bffc-4a47ef47e557.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("6882149d-846e-43cb-b587-5e654caec97f.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("75be9f9a-e4c5-4e4d-acee-25e76d554b0c.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("75be9f9a-e4c5-4e4d-acee-25e76d554b0c.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 996, tv_nsec: 964213278 } }) unit = producer-server
742025-09-06T02:12:40.395ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::a]:12221 unit = producer-server
752025-09-06T02:12:40.427ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
762025-09-06T02:12:40.915ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
772025-09-06T02:12:40.926ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
782025-09-06T02:12:40.933ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
792025-09-06T02:12:41.581ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
802025-09-06T02:12:41.593ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
812025-09-06T02:12:41.599ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
822025-09-06T02:12:42.699ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
832025-09-06T02:12:42.711ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
842025-09-06T02:12:42.718ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
852025-09-06T02:12:43.706ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
862025-09-06T02:12:43.717ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
872025-09-06T02:12:43.724ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
882025-09-06T02:12:44.379ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
892025-09-06T02:12:44.391ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
902025-09-06T02:12:44.398ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
912025-09-06T02:12:45.411ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 18184527020775975995 n_samples = 6 unit = oximeter
922025-09-06T02:12:45.748ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
932025-09-06T02:12:45.759ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
942025-09-06T02:12:45.765ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
952025-09-06T02:12:46.355ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
962025-09-06T02:12:46.366ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
972025-09-06T02:12:46.373ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
982025-09-06T02:12:46.914ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 1305892679055758413 n_samples = 6 unit = oximeter
992025-09-06T02:12:47.224ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1002025-09-06T02:12:47.236ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
1012025-09-06T02:12:47.243ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1022025-09-06T02:12:47.870ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1032025-09-06T02:12:47.882ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
1042025-09-06T02:12:47.888ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1052025-09-06T02:12:49.314ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1062025-09-06T02:12:49.326ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
1072025-09-06T02:12:49.333ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1082025-09-06T02:12:50.352ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1092025-09-06T02:12:50.364ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
1102025-09-06T02:12:50.370ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1112025-09-06T02:12:51.581ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1122025-09-06T02:12:51.593ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
1132025-09-06T02:12:51.599ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1142025-09-06T02:12:52.271ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1152025-09-06T02:12:52.282ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
1162025-09-06T02:12:52.288ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1172025-09-06T02:12:53.112ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1182025-09-06T02:12:53.123ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
1192025-09-06T02:12:53.129ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1202025-09-06T02:12:54.930ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1212025-09-06T02:12:54.942ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
1222025-09-06T02:12:54.948ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1232025-09-06T02:12:55.727ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 18184527020775975995 n_samples = 6 unit = oximeter
1242025-09-06T02:12:55.741ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", source: TimedOut }) unit = producer-server
1252025-09-06T02:12:55.743ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 0 delay = 20.037779439s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/dab6693/oximeter/producer/src/lib.rs:371 unit = producer-server
1262025-09-06T02:12:56.041ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1272025-09-06T02:12:56.051ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
1282025-09-06T02:12:56.058ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1292025-09-06T02:12:56.103ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("4e71e6d5-3c39-4dcf-bffc-4a47ef47e557.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("6882149d-846e-43cb-b587-5e654caec97f.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("75be9f9a-e4c5-4e4d-acee-25e76d554b0c.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("75be9f9a-e4c5-4e4d-acee-25e76d554b0c.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 1012, tv_nsec: 360424794 } }) unit = producer-server
1302025-09-06T02:12:56.104ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::a]:12221 unit = producer-server
1312025-09-06T02:12:56.135ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
1322025-09-06T02:12:57.123ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1332025-09-06T02:12:57.135ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
1342025-09-06T02:12:57.142ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1352025-09-06T02:12:57.226ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 1305892679055758413 n_samples = 6 unit = oximeter
1362025-09-06T02:12:57.907ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1372025-09-06T02:12:57.918ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
1382025-09-06T02:12:57.925ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1392025-09-06T02:12:59.176ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1402025-09-06T02:12:59.186ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
1412025-09-06T02:12:59.193ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1422025-09-06T02:13:00.523ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1432025-09-06T02:13:00.536ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
1442025-09-06T02:13:00.542ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1452025-09-06T02:13:01.711ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1462025-09-06T02:13:01.722ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
1472025-09-06T02:13:01.728ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1482025-09-06T02:13:03.196ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1492025-09-06T02:13:03.208ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
1502025-09-06T02:13:03.214ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1512025-09-06T02:13:04.468ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1522025-09-06T02:13:04.479ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
1532025-09-06T02:13:04.485ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1542025-09-06T02:13:05.701ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 18184527020775975995 n_samples = 6 unit = oximeter
1552025-09-06T02:13:05.809ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1562025-09-06T02:13:05.820ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
1572025-09-06T02:13:05.827ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1582025-09-06T02:13:06.877ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1592025-09-06T02:13:06.889ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
1602025-09-06T02:13:06.895ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1612025-09-06T02:13:07.199ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 1305892679055758413 n_samples = 6 unit = oximeter
1622025-09-06T02:13:08.367ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1632025-09-06T02:13:08.379ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
1642025-09-06T02:13:08.385ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1652025-09-06T02:13:09.577ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1662025-09-06T02:13:09.588ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
1672025-09-06T02:13:09.594ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1682025-09-06T02:13:10.493ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1692025-09-06T02:13:10.506ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
1702025-09-06T02:13:10.512ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1712025-09-06T02:13:11.094ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", source: TimedOut }) unit = producer-server
1722025-09-06T02:13:11.095ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 1 delay = 35.433594022s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/dab6693/oximeter/producer/src/lib.rs:371 unit = producer-server
1732025-09-06T02:13:11.349ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1742025-09-06T02:13:11.360ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
1752025-09-06T02:13:11.365ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1762025-09-06T02:13:11.719ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("4e71e6d5-3c39-4dcf-bffc-4a47ef47e557.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("6882149d-846e-43cb-b587-5e654caec97f.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("75be9f9a-e4c5-4e4d-acee-25e76d554b0c.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("75be9f9a-e4c5-4e4d-acee-25e76d554b0c.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 1028, tv_nsec: 20184387 } }) unit = producer-server
1772025-09-06T02:13:11.720ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::a]:12221 unit = producer-server
1782025-09-06T02:13:11.750ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
1792025-09-06T02:13:12.801ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1802025-09-06T02:13:12.812ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
1812025-09-06T02:13:12.819ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1822025-09-06T02:13:14.171ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1832025-09-06T02:13:14.182ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
1842025-09-06T02:13:14.189ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1852025-09-06T02:13:15.484ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1862025-09-06T02:13:15.495ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
1872025-09-06T02:13:15.502ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1882025-09-06T02:13:15.677ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 18184527020775975995 n_samples = 6 unit = oximeter
1892025-09-06T02:13:16.456ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1902025-09-06T02:13:16.469ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
1912025-09-06T02:13:16.475ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1922025-09-06T02:13:17.001ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1932025-09-06T02:13:17.013ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
1942025-09-06T02:13:17.020ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1952025-09-06T02:13:17.175ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 1305892679055758413 n_samples = 6 unit = oximeter
1962025-09-06T02:13:17.983ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1972025-09-06T02:13:17.995ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
1982025-09-06T02:13:18.001ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1992025-09-06T02:13:19.500ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2002025-09-06T02:13:19.512ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
2012025-09-06T02:13:19.518ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2022025-09-06T02:13:20.435ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2032025-09-06T02:13:20.447ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
2042025-09-06T02:13:20.456ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2052025-09-06T02:13:21.074ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2062025-09-06T02:13:21.086ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
2072025-09-06T02:13:21.092ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2082025-09-06T02:13:21.809ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2092025-09-06T02:13:21.821ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
2102025-09-06T02:13:21.827ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2112025-09-06T02:13:22.577ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2122025-09-06T02:13:22.588ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
2132025-09-06T02:13:22.594ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2142025-09-06T02:13:23.666ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2152025-09-06T02:13:23.678ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
2162025-09-06T02:13:23.684ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2172025-09-06T02:13:25.029ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2182025-09-06T02:13:25.041ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
2192025-09-06T02:13:25.048ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2202025-09-06T02:13:25.654ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 18184527020775975995 n_samples = 6 unit = oximeter
2212025-09-06T02:13:25.699ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2222025-09-06T02:13:25.711ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
2232025-09-06T02:13:25.717ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2242025-09-06T02:13:26.436ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2252025-09-06T02:13:26.448ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
2262025-09-06T02:13:26.455ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2272025-09-06T02:13:26.712ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", source: TimedOut }) unit = producer-server
2282025-09-06T02:13:26.714ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 2 delay = 51.092489559s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/dab6693/oximeter/producer/src/lib.rs:371 unit = producer-server
2292025-09-06T02:13:27.151ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 1305892679055758413 n_samples = 6 unit = oximeter
2302025-09-06T02:13:27.401ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2312025-09-06T02:13:27.413ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
2322025-09-06T02:13:27.420ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2332025-09-06T02:13:27.657ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("4e71e6d5-3c39-4dcf-bffc-4a47ef47e557.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("6882149d-846e-43cb-b587-5e654caec97f.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("75be9f9a-e4c5-4e4d-acee-25e76d554b0c.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("75be9f9a-e4c5-4e4d-acee-25e76d554b0c.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 1043, tv_nsec: 999099914 } }) unit = producer-server
2342025-09-06T02:13:27.657ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::a]:12221 unit = producer-server
2352025-09-06T02:13:27.688ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
2362025-09-06T02:13:28.270ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2372025-09-06T02:13:28.282ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
2382025-09-06T02:13:28.289ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2392025-09-06T02:13:29.794ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2402025-09-06T02:13:29.806ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
2412025-09-06T02:13:29.813ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2422025-09-06T02:13:30.878ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2432025-09-06T02:13:30.888ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
2442025-09-06T02:13:30.895ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2452025-09-06T02:13:32.155ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2462025-09-06T02:13:32.168ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
2472025-09-06T02:13:32.174ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2482025-09-06T02:13:33.006ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2492025-09-06T02:13:33.018ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
2502025-09-06T02:13:33.024ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2512025-09-06T02:13:33.742ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2522025-09-06T02:13:33.754ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
2532025-09-06T02:13:33.760ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2542025-09-06T02:13:34.596ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2552025-09-06T02:13:34.607ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
2562025-09-06T02:13:34.614ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2572025-09-06T02:13:35.534ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2582025-09-06T02:13:35.546ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
2592025-09-06T02:13:35.551ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2602025-09-06T02:13:35.630ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 18184527020775975995 n_samples = 6 unit = oximeter
2612025-09-06T02:13:36.414ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2622025-09-06T02:13:36.426ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
2632025-09-06T02:13:36.432ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2642025-09-06T02:13:37.127ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 1305892679055758413 n_samples = 6 unit = oximeter
2652025-09-06T02:13:37.472ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2662025-09-06T02:13:37.492ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
2672025-09-06T02:13:37.499ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2682025-09-06T02:13:38.191ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2692025-09-06T02:13:38.203ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
2702025-09-06T02:13:38.210ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2712025-09-06T02:13:39.407ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2722025-09-06T02:13:39.419ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
2732025-09-06T02:13:39.426ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2742025-09-06T02:13:40.216ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2752025-09-06T02:13:40.228ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
2762025-09-06T02:13:40.235ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2772025-09-06T02:13:41.163ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2782025-09-06T02:13:41.175ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
2792025-09-06T02:13:41.182ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2802025-09-06T02:13:41.946ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2812025-09-06T02:13:41.957ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
2822025-09-06T02:13:41.963ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2832025-09-06T02:13:42.648ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", source: TimedOut }) unit = producer-server
2842025-09-06T02:13:42.650ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 3 delay = 67.071934886s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/dab6693/oximeter/producer/src/lib.rs:371 unit = producer-server
2852025-09-06T02:13:43.053ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2862025-09-06T02:13:43.064ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
2872025-09-06T02:13:43.070ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2882025-09-06T02:13:43.712ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2892025-09-06T02:13:43.724ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
2902025-09-06T02:13:43.730ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2912025-09-06T02:13:44.490ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("4e71e6d5-3c39-4dcf-bffc-4a47ef47e557.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("6882149d-846e-43cb-b587-5e654caec97f.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("75be9f9a-e4c5-4e4d-acee-25e76d554b0c.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("75be9f9a-e4c5-4e4d-acee-25e76d554b0c.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 1060, tv_nsec: 877920594 } }) unit = producer-server
2922025-09-06T02:13:44.490ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::a]:12221 unit = producer-server
2932025-09-06T02:13:44.521ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
2942025-09-06T02:13:44.916ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2952025-09-06T02:13:44.929ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
2962025-09-06T02:13:44.936ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2972025-09-06T02:13:45.583ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2982025-09-06T02:13:45.596ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
2992025-09-06T02:13:45.604ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 18184527020775975995 n_samples = 6 unit = oximeter
3002025-09-06T02:13:45.604ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3012025-09-06T02:13:46.124ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3022025-09-06T02:13:46.137ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
3032025-09-06T02:13:46.144ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3042025-09-06T02:13:47.004ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3052025-09-06T02:13:47.026ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
3062025-09-06T02:13:47.037ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3072025-09-06T02:13:47.104ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 1305892679055758413 n_samples = 6 unit = oximeter
3082025-09-06T02:13:48.451ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3092025-09-06T02:13:48.498ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
3102025-09-06T02:13:48.523ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3112025-09-06T02:13:50.035ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3122025-09-06T02:13:50.049ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
3132025-09-06T02:13:50.058ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3142025-09-06T02:13:51.308ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3152025-09-06T02:13:51.591ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
3162025-09-06T02:13:51.618ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3172025-09-06T02:13:52.231ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3182025-09-06T02:13:52.248ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
3192025-09-06T02:13:52.256ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3202025-09-06T02:13:53.205ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3212025-09-06T02:13:53.217ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
3222025-09-06T02:13:53.224ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3232025-09-06T02:13:54.140ZINFOtfportd: removed stale NDP entry :fe80::9040:41ff:fec5:7e48->92:40:41:c5:7e:48
3242025-09-06T02:13:54.311ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3252025-09-06T02:13:54.323ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
3262025-09-06T02:13:54.330ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3272025-09-06T02:13:55.166ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3282025-09-06T02:13:55.177ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
3292025-09-06T02:13:55.184ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3302025-09-06T02:13:55.316ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::9040:41ff:fec5:7e48->92:40:41:c5:7e:48 interface = tfportrear0_0
3312025-09-06T02:13:55.580ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 18184527020775975995 n_samples = 6 unit = oximeter
3322025-09-06T02:13:56.277ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3332025-09-06T02:13:56.289ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
3342025-09-06T02:13:56.295ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3352025-09-06T02:13:56.922ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3362025-09-06T02:13:56.934ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
3372025-09-06T02:13:56.941ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3382025-09-06T02:13:57.080ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 1305892679055758413 n_samples = 6 unit = oximeter
3392025-09-06T02:13:58.342ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3402025-09-06T02:13:58.353ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
3412025-09-06T02:13:58.360ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3422025-09-06T02:13:59.483ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", source: TimedOut }) unit = producer-server
3432025-09-06T02:13:59.485ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 4 delay = 83.950895747s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/dab6693/oximeter/producer/src/lib.rs:371 unit = producer-server
3442025-09-06T02:13:59.556ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3452025-09-06T02:13:59.567ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
3462025-09-06T02:13:59.575ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3472025-09-06T02:14:00.560ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3482025-09-06T02:14:00.572ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
3492025-09-06T02:14:00.579ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3502025-09-06T02:14:01.315ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3512025-09-06T02:14:01.327ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
3522025-09-06T02:14:01.334ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3532025-09-06T02:14:02.037ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3542025-09-06T02:14:02.050ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
3552025-09-06T02:14:02.058ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3562025-09-06T02:14:02.576ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("4e71e6d5-3c39-4dcf-bffc-4a47ef47e557.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("6882149d-846e-43cb-b587-5e654caec97f.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("75be9f9a-e4c5-4e4d-acee-25e76d554b0c.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("75be9f9a-e4c5-4e4d-acee-25e76d554b0c.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 1079, tv_nsec: 4314400 } }) unit = producer-server
3572025-09-06T02:14:02.577ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::a]:12221 unit = producer-server
3582025-09-06T02:14:02.608ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
3592025-09-06T02:14:03.062ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3602025-09-06T02:14:03.075ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
3612025-09-06T02:14:03.090ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3622025-09-06T02:14:04.017ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3632025-09-06T02:14:04.029ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
3642025-09-06T02:14:04.035ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3652025-09-06T02:14:05.456ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3662025-09-06T02:14:05.468ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
3672025-09-06T02:14:05.475ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3682025-09-06T02:14:05.574ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 18184527020775975995 n_samples = 6 unit = oximeter
3692025-09-06T02:14:06.172ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3702025-09-06T02:14:06.185ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
3712025-09-06T02:14:06.193ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3722025-09-06T02:14:07.078ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 1305892679055758413 n_samples = 6 unit = oximeter
3732025-09-06T02:14:07.393ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3742025-09-06T02:14:07.408ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
3752025-09-06T02:14:07.417ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3762025-09-06T02:14:08.178ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3772025-09-06T02:14:08.192ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
3782025-09-06T02:14:08.199ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3792025-09-06T02:14:13.632ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3802025-09-06T02:14:13.653ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
3812025-09-06T02:14:13.672ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3822025-09-06T02:14:15.181ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3832025-09-06T02:14:15.204ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
3842025-09-06T02:14:15.217ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3852025-09-06T02:14:15.599ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 18184527020775975995 n_samples = 6 unit = oximeter
3862025-09-06T02:14:16.323ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3872025-09-06T02:14:16.342ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
3882025-09-06T02:14:16.352ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3892025-09-06T02:14:17.091ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 1305892679055758413 n_samples = 6 unit = oximeter
3902025-09-06T02:14:17.616ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", source: TimedOut }) unit = producer-server
3912025-09-06T02:14:17.625ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 5 delay = 102.087952611s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/dab6693/oximeter/producer/src/lib.rs:371 unit = producer-server
3922025-09-06T02:14:17.773ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3932025-09-06T02:14:17.790ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
3942025-09-06T02:14:17.801ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3952025-09-06T02:14:18.457ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3962025-09-06T02:14:18.469ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
3972025-09-06T02:14:18.477ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3982025-09-06T02:14:19.188ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3992025-09-06T02:14:19.200ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
4002025-09-06T02:14:19.207ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4012025-09-06T02:14:20.251ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4022025-09-06T02:14:20.276ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
4032025-09-06T02:14:20.289ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4042025-09-06T02:14:21.696ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4052025-09-06T02:14:21.724ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
4062025-09-06T02:14:21.741ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4072025-09-06T02:14:23.142ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4082025-09-06T02:14:23.155ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
4092025-09-06T02:14:23.161ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4102025-09-06T02:14:23.731ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4112025-09-06T02:14:23.746ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
4122025-09-06T02:14:23.755ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4132025-09-06T02:14:24.823ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4142025-09-06T02:14:24.838ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
4152025-09-06T02:14:24.846ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4162025-09-06T02:14:25.608ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 18184527020775975995 n_samples = 6 unit = oximeter
4172025-09-06T02:14:26.223ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4182025-09-06T02:14:26.235ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
4192025-09-06T02:14:26.243ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4202025-09-06T02:14:27.073ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4212025-09-06T02:14:27.087ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
4222025-09-06T02:14:27.097ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4232025-09-06T02:14:27.101ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 1305892679055758413 n_samples = 6 unit = oximeter
4242025-09-06T02:14:28.008ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4252025-09-06T02:14:28.020ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
4262025-09-06T02:14:28.027ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4272025-09-06T02:14:28.117ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("4e71e6d5-3c39-4dcf-bffc-4a47ef47e557.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("6882149d-846e-43cb-b587-5e654caec97f.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("75be9f9a-e4c5-4e4d-acee-25e76d554b0c.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("75be9f9a-e4c5-4e4d-acee-25e76d554b0c.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 1104, tv_nsec: 534834087 } }) unit = producer-server
4282025-09-06T02:14:28.122ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::a]:12221 unit = producer-server
4292025-09-06T02:14:28.178ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
4302025-09-06T02:14:29.191ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4312025-09-06T02:14:29.224ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
4322025-09-06T02:14:29.244ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4332025-09-06T02:14:29.957ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4342025-09-06T02:14:29.978ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
4352025-09-06T02:14:29.988ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4362025-09-06T02:14:31.510ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4372025-09-06T02:14:31.616ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
4382025-09-06T02:14:31.686ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4392025-09-06T02:14:33.292ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4402025-09-06T02:14:33.317ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
4412025-09-06T02:14:33.327ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4422025-09-06T02:14:34.770ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4432025-09-06T02:14:34.789ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
4442025-09-06T02:14:34.801ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4452025-09-06T02:14:35.516ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4462025-09-06T02:14:35.532ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
4472025-09-06T02:14:36.016ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4482025-09-06T02:14:36.272ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 18184527020775975995 n_samples = 6 unit = oximeter
4492025-09-06T02:14:36.609ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4502025-09-06T02:14:36.628ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
4512025-09-06T02:14:36.639ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4522025-09-06T02:14:37.104ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 1305892679055758413 n_samples = 6 unit = oximeter
4532025-09-06T02:14:37.300ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4542025-09-06T02:14:37.319ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
4552025-09-06T02:14:37.329ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4562025-09-06T02:14:38.689ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4572025-09-06T02:14:38.703ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
4582025-09-06T02:14:38.712ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4592025-09-06T02:14:40.076ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4602025-09-06T02:14:40.093ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
4612025-09-06T02:14:40.103ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4622025-09-06T02:14:41.445ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4632025-09-06T02:14:41.558ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
4642025-09-06T02:14:41.574ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4652025-09-06T02:14:42.799ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4662025-09-06T02:14:42.813ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
4672025-09-06T02:14:42.821ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4682025-09-06T02:14:43.179ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", source: TimedOut }) unit = producer-server
4692025-09-06T02:14:43.262ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 6 delay = 127.722352802s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/dab6693/oximeter/producer/src/lib.rs:371 unit = producer-server
4702025-09-06T02:14:43.380ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4712025-09-06T02:14:43.394ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
4722025-09-06T02:14:43.401ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4732025-09-06T02:14:44.486ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4742025-09-06T02:14:44.499ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
4752025-09-06T02:14:44.506ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4762025-09-06T02:14:45.866ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4772025-09-06T02:14:45.881ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
4782025-09-06T02:14:45.889ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4792025-09-06T02:14:46.314ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 18184527020775975995 n_samples = 6 unit = oximeter
4802025-09-06T02:14:46.843ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4812025-09-06T02:14:46.857ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
4822025-09-06T02:14:46.864ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4832025-09-06T02:14:47.121ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 1305892679055758413 n_samples = 6 unit = oximeter
4842025-09-06T02:14:47.464ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4852025-09-06T02:14:47.480ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
4862025-09-06T02:14:47.489ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4872025-09-06T02:14:48.565ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4882025-09-06T02:14:48.582ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
4892025-09-06T02:14:48.590ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4902025-09-06T02:14:49.513ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4912025-09-06T02:14:49.528ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
4922025-09-06T02:14:49.537ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4932025-09-06T02:14:50.295ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4942025-09-06T02:14:50.307ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
4952025-09-06T02:14:50.314ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4962025-09-06T02:14:51.258ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4972025-09-06T02:14:51.272ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
4982025-09-06T02:14:51.279ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4992025-09-06T02:14:51.970ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5002025-09-06T02:14:51.983ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
5012025-09-06T02:14:51.990ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5022025-09-06T02:14:53.311ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5032025-09-06T02:14:53.325ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
5042025-09-06T02:14:53.332ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5052025-09-06T02:14:54.214ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5062025-09-06T02:14:54.227ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
5072025-09-06T02:14:54.235ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5082025-09-06T02:14:55.240ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5092025-09-06T02:14:55.255ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
5102025-09-06T02:14:55.263ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5112025-09-06T02:14:56.128ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5122025-09-06T02:14:56.142ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
5132025-09-06T02:14:56.151ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5142025-09-06T02:14:56.320ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 18184527020775975995 n_samples = 6 unit = oximeter
5152025-09-06T02:14:57.125ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 1305892679055758413 n_samples = 6 unit = oximeter
5162025-09-06T02:14:57.412ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5172025-09-06T02:14:57.430ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
5182025-09-06T02:14:57.441ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5192025-09-06T02:14:58.248ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5202025-09-06T02:14:58.260ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
5212025-09-06T02:14:58.267ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5222025-09-06T02:14:58.829ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5232025-09-06T02:14:58.841ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
5242025-09-06T02:14:58.849ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5252025-09-06T02:15:00.157ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5262025-09-06T02:15:00.178ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
5272025-09-06T02:15:00.191ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5282025-09-06T02:15:00.932ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5292025-09-06T02:15:00.956ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::42c:bdff:fe8b:1bff]
5302025-09-06T02:15:00.968ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]