Max level shown:
1 [ Dec 20 01:26:38 Enabled. ]
2 [ Dec 20 01:26:38 Rereading configuration. ]
3 [ Dec 20 01:26:39 Rereading configuration. ]
4 [ Dec 20 01:26:50 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dendrite/bin/tfportd --sync-only &"). ]
5 [ Dec 20 01:26:50 Method "start" exited with status 0. ]
6 No non-localhost IPv6 addresses found in SMF properties
72025-12-20T01:26:50.635ZINFOtfportd: connecting to dpd host = [::1] port = 12224
82025-12-20T01:26:50.676ZINFOtfportd: connected to dpd running softnpu-606c0be8
92025-12-20T01:26:50.677ZINFOtfportd: running in sync-only mode
102025-12-20T01:26:50.677ZINFOtfportd: no non-localhost IPv6 listen address available, waiting for SMF update unit = oximeter
112025-12-20T01:26:50.679ZINFOtfportd: refreshing SMF config prior to waiting on signals unit = signal_handler
12 No non-localhost IPv6 addresses found in SMF properties
132025-12-20T01:26:50.680ZINFOtfportd: refreshed config: Config { log_file: None, log_format: Json, listen_addresses: [ [::1]:12231, ], pkt_source: None, dpd_host: "[::1]", dpd_port: 12224, vlan_link: None, vlan_data: None, techport0_prefix: None, techport1_prefix: None, rack_id: Some( 03ea191c-eb71-467f-ae68-5238e496a184, ), sled_id: Some( 326093d1-93b1-432d-a0d4-ebe1e88ea6f3, ), sled_model: Some( "i86pc", ), sled_revision: Some( 0, ), sled_serial: Some( "buskin", ), }
142025-12-20T01:26:50.680ZINFOtfportd: no non-localhost IPv6 listen address available, waiting for SMF update unit = oximeter
152025-12-20T01:26:50.685ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::743a:11ff:fe9e:ae4c->76:3a:11:9e:ae:4c interface = tfportrear0_0
162025-12-20T01:26:50.687ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
172025-12-20T01:26:50.693ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
182025-12-20T01:26:50.698ZWARNtfportd: tfportqsfp0_0 has no addrs
19 [ Dec 20 01:26:51 Rereading configuration. ]
20 [ Dec 20 01:26:51 Executing refresh method (:kill). ]
21 [ Dec 20 01:26:51 Stopping because all processes in service exited. ]
22 [ Dec 20 01:26:51 Executing stop method (:kill). ]
23 [ Dec 20 01:26:51 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dendrite/bin/tfportd --sync-only &"). ]
24 [ Dec 20 01:26:51 Method "start" exited with status 0. ]
252025-12-20T01:26:51.339ZINFOtfportd: connecting to dpd host = [::1] port = 12224
262025-12-20T01:26:51.381ZINFOtfportd: connected to dpd running softnpu-606c0be8
272025-12-20T01:26:51.381ZINFOtfportd: running in sync-only mode
282025-12-20T01:26:51.381ZINFOtfportd: found suitable IPv6 address for oximeter producer server address = fd00:1122:3344:101::2 unit = oximeter
292025-12-20T01:26:51.383ZINFOtfportd: refreshing SMF config prior to waiting on signals unit = signal_handler
302025-12-20T01:26:51.383ZDEBGtfportd: extracted oximeter configuration data config = OximeterConfig { listen_address: fd00:1122:3344:101::2, sled_identifiers: SledIdentifiers { rack_id: 03ea191c-eb71-467f-ae68-5238e496a184, sled_id: 326093d1-93b1-432d-a0d4-ebe1e88ea6f3, model: "i86pc", revision: 0, serial: "buskin" }, switch_identifiers: SwitchIdentifiers { asic_backend: "softnpu", fab: None, lot: None, model: "FAKE_SIM_SIDECAR", revision: 0, serial: "SimSidecar0", sidecar_id: a1014f79-15a5-4351-bb19-3a4b63986431, slot: 0, wafer: None, wafer_loc: None } } unit = oximeter
312025-12-20T01:26:51.383ZDEBGtfportd: created producer ID producer_id = 908bc5b4-6d65-4603-b5a5-83926f806346 unit = oximeter
322025-12-20T01:26:51.385ZINFOtfportd: refreshed config: Config { log_file: None, log_format: Json, listen_addresses: [ [fd00:1122:3344:101::2]:12231, [::1]:12231, ], pkt_source: None, dpd_host: "[::1]", dpd_port: 12224, vlan_link: None, vlan_data: None, techport0_prefix: None, techport1_prefix: None, rack_id: Some( 03ea191c-eb71-467f-ae68-5238e496a184, ), sled_id: Some( 326093d1-93b1-432d-a0d4-ebe1e88ea6f3, ), sled_model: Some( "i86pc", ), sled_revision: Some( 0, ), sled_serial: Some( "buskin", ), }
332025-12-20T01:26:51.391ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
342025-12-20T01:26:51.393ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::3c82:b1ff:feb0:4772->3e:82:b1:b0:47:72 interface = tfportrear0_0
352025-12-20T01:26:51.394ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::743a:11ff:fe9e:ae4c->76:3a:11:9e:ae:4c interface = tfportrear0_0
362025-12-20T01:26:51.395ZDEBGtfportd: registered DTrace probes unit = producer-server
372025-12-20T01:26:51.396ZDEBGtfportd (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::2]:52703 method = GET path = /{producer_id} unit = producer-server versions = all
382025-12-20T01:26:51.396ZINFOtfportd (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.4/src/server.rs:328 local_addr = [fd00:1122:3344:101::2]:52703 unit = producer-server
392025-12-20T01:26:51.396ZDEBGtfportd (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::2]:52703 unit = producer-server
402025-12-20T01:26:51.396ZDEBGtfportd: Requested any available port, Dropshot server has been bound to [fd00:1122:3344:101::2]:52703 unit = producer-server
412025-12-20T01:26:51.396ZDEBGtfportd: Nexus IP not provided, will use DNS to resolve it unit = producer-server
422025-12-20T01:26:51.396ZINFOtfportd (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/e76962a/internal-dns/resolver/src/resolver.rs:144 unit = producer-server
432025-12-20T01:26:51.396ZDEBGtfportd: starting producer registration task unit = producer-server
442025-12-20T01:26:51.396ZINFOtfportd: starting oximeter metric producer server address = [fd00:1122:3344:101::2]:52703 file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/e76962a/oximeter/producer/src/lib.rs:279 interval = 30s producer_id = 908bc5b4-6d65-4603-b5a5-83926f806346 unit = producer-server
452025-12-20T01:26:51.397ZINFOtfportd: created oximeter producer server unit = oximeter
462025-12-20T01:26:51.397ZDEBGtfportd (producer-registration-task): registering as oximeter producer with Nexus registration_count = 0 unit = producer-server
472025-12-20T01:26:51.397ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
482025-12-20T01:26:51.398ZDEBGtfportd (kstat-sampler): adding new target unit = oximeter
492025-12-20T01:26:51.398ZDEBGtfportd (kstat-sampler-worker): storing new creation time for tracked target creation_time = 2025-12-20T01:26:34.663396825Z path = KstatPath { module: "link", instance: 0, name: "tfportrear0_0" } unit = oximeter
502025-12-20T01:26:51.398ZDEBGtfportd (kstat-sampler-worker): inserted empty per-target sample queue id = 13616609735993055790 unit = oximeter
512025-12-20T01:26:51.398ZDEBGtfportd: added new link to kstat sampler link_kind = switch-port-control link_name = tfportrear0_0 unit = metrics-task-tracker
522025-12-20T01:26:51.400ZWARNtfportd: tfportqsfp0_0 has no addrs
532025-12-20T01:26:52.046ZINFOtfportd: added new ARP entry entry = 10.151.1.174->5a:24:2f:6b:36:66 interface = tfportqsfp0_0
542025-12-20T01:26:52.449ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
552025-12-20T01:26:52.456ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
562025-12-20T01:26:52.460ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
572025-12-20T01:26:52.461ZDEBGtfportd (kstat-sampler): adding new target unit = oximeter
582025-12-20T01:26:52.462ZDEBGtfportd (kstat-sampler-worker): storing new creation time for tracked target creation_time = 2025-12-20T01:26:34.663261183Z path = KstatPath { module: "link", instance: 0, name: "tfportqsfp0_0" } unit = oximeter
592025-12-20T01:26:52.462ZDEBGtfportd (kstat-sampler-worker): inserted empty per-target sample queue id = 5547863117464175049 unit = oximeter
602025-12-20T01:26:52.462ZDEBGtfportd: added new link to kstat sampler link_kind = switch-port-control link_name = tfportqsfp0_0 unit = metrics-task-tracker
612025-12-20T01:26:53.003ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
622025-12-20T01:26:53.007ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
632025-12-20T01:26:53.011ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
642025-12-20T01:26:53.993ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
652025-12-20T01:26:53.999ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
662025-12-20T01:26:54.001ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
672025-12-20T01:26:54.790ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
682025-12-20T01:26:54.795ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
692025-12-20T01:26:54.798ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
702025-12-20T01:26:55.336ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
712025-12-20T01:26:55.341ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
722025-12-20T01:26:55.344ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
732025-12-20T01:26:55.921ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
742025-12-20T01:26:55.926ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
752025-12-20T01:26:55.928ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
762025-12-20T01:26:56.400ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("35a0b243-615d-49dc-9864-0e1640115f12.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("81c11ffb-8a21-4f98-bc57-2ec16e7247b1.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("a31a192d-34b7-47d9-841b-e667d9510530.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("a31a192d-34b7-47d9-841b-e667d9510530.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 849, tv_nsec: 388128323 } }) unit = producer-server
772025-12-20T01:26:56.400ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221 unit = producer-server
782025-12-20T01:26:56.432ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
792025-12-20T01:26:56.698ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
802025-12-20T01:26:56.702ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
812025-12-20T01:26:56.705ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
822025-12-20T01:26:57.443ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
832025-12-20T01:26:57.448ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
842025-12-20T01:26:57.451ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
852025-12-20T01:26:58.628ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
862025-12-20T01:26:58.633ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
872025-12-20T01:26:58.635ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
882025-12-20T01:26:59.338ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
892025-12-20T01:26:59.344ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
902025-12-20T01:26:59.346ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
912025-12-20T01:27:00.053ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
922025-12-20T01:27:00.058ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
932025-12-20T01:27:00.060ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
942025-12-20T01:27:00.640ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
952025-12-20T01:27:00.644ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
962025-12-20T01:27:00.647ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
972025-12-20T01:27:01.403ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 13616609735993055790 n_samples = 6 unit = oximeter
982025-12-20T01:27:01.766ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
992025-12-20T01:27:01.771ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
1002025-12-20T01:27:01.774ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1012025-12-20T01:27:02.465ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5547863117464175049 n_samples = 6 unit = oximeter
1022025-12-20T01:27:02.597ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1032025-12-20T01:27:02.602ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
1042025-12-20T01:27:02.606ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1052025-12-20T01:27:03.339ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1062025-12-20T01:27:03.344ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
1072025-12-20T01:27:03.346ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1082025-12-20T01:27:04.321ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1092025-12-20T01:27:04.325ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
1102025-12-20T01:27:04.328ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1112025-12-20T01:27:05.334ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1122025-12-20T01:27:05.340ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
1132025-12-20T01:27:05.343ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1142025-12-20T01:27:06.213ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1152025-12-20T01:27:06.219ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
1162025-12-20T01:27:06.222ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1172025-12-20T01:27:07.520ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1182025-12-20T01:27:07.525ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
1192025-12-20T01:27:07.528ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1202025-12-20T01:27:08.257ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1212025-12-20T01:27:08.262ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
1222025-12-20T01:27:08.265ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1232025-12-20T01:27:08.988ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1242025-12-20T01:27:08.992ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
1252025-12-20T01:27:08.995ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1262025-12-20T01:27:10.256ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1272025-12-20T01:27:10.260ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
1282025-12-20T01:27:10.263ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1292025-12-20T01:27:10.930ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1302025-12-20T01:27:10.934ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
1312025-12-20T01:27:10.937ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1322025-12-20T01:27:11.056ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 13616609735993055790 n_samples = 6 unit = oximeter
1332025-12-20T01:27:11.084ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }) unit = producer-server
1342025-12-20T01:27:11.085ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 0 delay = 20.037188284s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/e76962a/oximeter/producer/src/lib.rs:371 unit = producer-server
1352025-12-20T01:27:11.216ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("35a0b243-615d-49dc-9864-0e1640115f12.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("81c11ffb-8a21-4f98-bc57-2ec16e7247b1.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("a31a192d-34b7-47d9-841b-e667d9510530.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("a31a192d-34b7-47d9-841b-e667d9510530.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 864, tv_nsec: 554008961 } }) unit = producer-server
1362025-12-20T01:27:11.217ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221 unit = producer-server
1372025-12-20T01:27:11.247ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
1382025-12-20T01:27:11.744ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1392025-12-20T01:27:11.748ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
1402025-12-20T01:27:11.751ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1412025-12-20T01:27:12.115ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5547863117464175049 n_samples = 6 unit = oximeter
1422025-12-20T01:27:13.069ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1432025-12-20T01:27:13.074ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
1442025-12-20T01:27:13.077ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1452025-12-20T01:27:13.615ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1462025-12-20T01:27:13.620ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
1472025-12-20T01:27:13.623ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1482025-12-20T01:27:14.593ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1492025-12-20T01:27:14.598ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
1502025-12-20T01:27:14.601ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1512025-12-20T01:27:15.882ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1522025-12-20T01:27:15.887ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
1532025-12-20T01:27:15.890ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1542025-12-20T01:27:16.515ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1552025-12-20T01:27:16.519ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
1562025-12-20T01:27:16.522ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1572025-12-20T01:27:17.462ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1582025-12-20T01:27:17.466ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
1592025-12-20T01:27:17.469ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1602025-12-20T01:27:18.846ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1612025-12-20T01:27:18.851ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
1622025-12-20T01:27:18.853ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1632025-12-20T01:27:19.897ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1642025-12-20T01:27:19.901ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
1652025-12-20T01:27:19.904ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1662025-12-20T01:27:20.987ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1672025-12-20T01:27:20.993ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
1682025-12-20T01:27:20.995ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1692025-12-20T01:27:21.032ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 13616609735993055790 n_samples = 6 unit = oximeter
1702025-12-20T01:27:21.818ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1712025-12-20T01:27:21.823ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
1722025-12-20T01:27:21.826ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1732025-12-20T01:27:22.091ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5547863117464175049 n_samples = 6 unit = oximeter
1742025-12-20T01:27:22.409ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1752025-12-20T01:27:22.413ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
1762025-12-20T01:27:22.416ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1772025-12-20T01:27:23.364ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1782025-12-20T01:27:23.369ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
1792025-12-20T01:27:23.373ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1802025-12-20T01:27:23.953ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1812025-12-20T01:27:23.957ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
1822025-12-20T01:27:23.960ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1832025-12-20T01:27:24.778ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1842025-12-20T01:27:24.782ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
1852025-12-20T01:27:24.785ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1862025-12-20T01:27:25.679ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1872025-12-20T01:27:25.684ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
1882025-12-20T01:27:25.687ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1892025-12-20T01:27:26.207ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }) unit = producer-server
1902025-12-20T01:27:26.209ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 1 delay = 35.202429167s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/e76962a/oximeter/producer/src/lib.rs:371 unit = producer-server
1912025-12-20T01:27:26.895ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("35a0b243-615d-49dc-9864-0e1640115f12.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("81c11ffb-8a21-4f98-bc57-2ec16e7247b1.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("a31a192d-34b7-47d9-841b-e667d9510530.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("a31a192d-34b7-47d9-841b-e667d9510530.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 880, tv_nsec: 275645367 } }) unit = producer-server
1922025-12-20T01:27:26.895ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221 unit = producer-server
1932025-12-20T01:27:26.926ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
1942025-12-20T01:27:27.139ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1952025-12-20T01:27:27.144ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
1962025-12-20T01:27:27.146ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1972025-12-20T01:27:28.594ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1982025-12-20T01:27:28.599ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
1992025-12-20T01:27:28.602ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2002025-12-20T01:27:29.478ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2012025-12-20T01:27:29.482ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
2022025-12-20T01:27:29.485ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2032025-12-20T01:27:30.505ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2042025-12-20T01:27:30.510ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
2052025-12-20T01:27:30.513ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2062025-12-20T01:27:31.007ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 13616609735993055790 n_samples = 6 unit = oximeter
2072025-12-20T01:27:31.383ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2082025-12-20T01:27:31.388ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
2092025-12-20T01:27:31.391ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2102025-12-20T01:27:32.067ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5547863117464175049 n_samples = 6 unit = oximeter
2112025-12-20T01:27:32.535ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2122025-12-20T01:27:32.540ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
2132025-12-20T01:27:32.542ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2142025-12-20T01:27:33.956ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2152025-12-20T01:27:33.961ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
2162025-12-20T01:27:33.964ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2172025-12-20T01:27:34.524ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2182025-12-20T01:27:34.528ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
2192025-12-20T01:27:34.531ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2202025-12-20T01:27:35.413ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2212025-12-20T01:27:35.417ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
2222025-12-20T01:27:35.420ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2232025-12-20T01:27:36.086ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2242025-12-20T01:27:36.091ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
2252025-12-20T01:27:36.093ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2262025-12-20T01:27:36.852ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2272025-12-20T01:27:36.857ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
2282025-12-20T01:27:36.859ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2292025-12-20T01:27:37.467ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2302025-12-20T01:27:37.472ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
2312025-12-20T01:27:37.474ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2322025-12-20T01:27:38.271ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2332025-12-20T01:27:38.276ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
2342025-12-20T01:27:38.278ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2352025-12-20T01:27:38.788ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2362025-12-20T01:27:38.793ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
2372025-12-20T01:27:38.796ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2382025-12-20T01:27:39.800ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2392025-12-20T01:27:39.805ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
2402025-12-20T01:27:39.808ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2412025-12-20T01:27:40.983ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 13616609735993055790 n_samples = 6 unit = oximeter
2422025-12-20T01:27:41.022ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2432025-12-20T01:27:41.027ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
2442025-12-20T01:27:41.029ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2452025-12-20T01:27:41.652ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2462025-12-20T01:27:41.657ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
2472025-12-20T01:27:41.659ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2482025-12-20T01:27:41.886ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }) unit = producer-server
2492025-12-20T01:27:41.887ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 2 delay = 50.923567563s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/e76962a/oximeter/producer/src/lib.rs:371 unit = producer-server
2502025-12-20T01:27:42.043ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5547863117464175049 n_samples = 6 unit = oximeter
2512025-12-20T01:27:42.735ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2522025-12-20T01:27:42.740ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
2532025-12-20T01:27:42.743ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2542025-12-20T01:27:42.984ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("35a0b243-615d-49dc-9864-0e1640115f12.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("81c11ffb-8a21-4f98-bc57-2ec16e7247b1.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("a31a192d-34b7-47d9-841b-e667d9510530.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("a31a192d-34b7-47d9-841b-e667d9510530.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 896, tv_nsec: 408048246 } }) unit = producer-server
2552025-12-20T01:27:42.984ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221 unit = producer-server
2562025-12-20T01:27:43.014ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
2572025-12-20T01:27:43.306ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2582025-12-20T01:27:43.310ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
2592025-12-20T01:27:43.313ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2602025-12-20T01:27:44.103ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2612025-12-20T01:27:44.107ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
2622025-12-20T01:27:44.110ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2632025-12-20T01:27:44.843ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2642025-12-20T01:27:44.849ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
2652025-12-20T01:27:44.852ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2662025-12-20T01:27:45.503ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2672025-12-20T01:27:45.508ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
2682025-12-20T01:27:45.511ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2692025-12-20T01:27:46.420ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2702025-12-20T01:27:46.425ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
2712025-12-20T01:27:46.428ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2722025-12-20T01:27:47.350ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2732025-12-20T01:27:47.355ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
2742025-12-20T01:27:47.358ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2752025-12-20T01:27:48.495ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2762025-12-20T01:27:48.499ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
2772025-12-20T01:27:48.502ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2782025-12-20T01:27:49.788ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2792025-12-20T01:27:49.792ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
2802025-12-20T01:27:49.795ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2812025-12-20T01:27:50.329ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2822025-12-20T01:27:50.334ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
2832025-12-20T01:27:50.337ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2842025-12-20T01:27:50.959ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 13616609735993055790 n_samples = 6 unit = oximeter
2852025-12-20T01:27:51.121ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2862025-12-20T01:27:51.125ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
2872025-12-20T01:27:51.128ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2882025-12-20T01:27:52.018ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5547863117464175049 n_samples = 6 unit = oximeter
2892025-12-20T01:27:52.156ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2902025-12-20T01:27:52.160ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
2912025-12-20T01:27:52.163ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2922025-12-20T01:27:53.335ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2932025-12-20T01:27:53.340ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
2942025-12-20T01:27:53.343ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2952025-12-20T01:27:54.775ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2962025-12-20T01:27:54.780ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
2972025-12-20T01:27:54.782ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2982025-12-20T01:27:55.975ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2992025-12-20T01:27:55.979ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
3002025-12-20T01:27:55.982ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3012025-12-20T01:27:57.359ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3022025-12-20T01:27:57.364ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
3032025-12-20T01:27:57.366ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3042025-12-20T01:27:57.974ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }) unit = producer-server
3052025-12-20T01:27:57.975ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 3 delay = 67.05523413s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/e76962a/oximeter/producer/src/lib.rs:371 unit = producer-server
3062025-12-20T01:27:58.112ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3072025-12-20T01:27:58.117ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
3082025-12-20T01:27:58.120ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3092025-12-20T01:27:59.365ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3102025-12-20T01:27:59.370ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
3112025-12-20T01:27:59.372ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3122025-12-20T01:28:00.014ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("35a0b243-615d-49dc-9864-0e1640115f12.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("81c11ffb-8a21-4f98-bc57-2ec16e7247b1.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("a31a192d-34b7-47d9-841b-e667d9510530.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("a31a192d-34b7-47d9-841b-e667d9510530.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 913, tv_nsec: 484073481 } }) unit = producer-server
3132025-12-20T01:28:00.014ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221 unit = producer-server
3142025-12-20T01:28:00.043ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
3152025-12-20T01:28:00.443ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3162025-12-20T01:28:00.447ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
3172025-12-20T01:28:00.450ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3182025-12-20T01:28:00.933ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 13616609735993055790 n_samples = 6 unit = oximeter
3192025-12-20T01:28:01.138ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3202025-12-20T01:28:01.142ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
3212025-12-20T01:28:01.145ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3222025-12-20T01:28:01.993ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5547863117464175049 n_samples = 6 unit = oximeter
3232025-12-20T01:28:02.068ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3242025-12-20T01:28:02.073ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
3252025-12-20T01:28:02.076ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3262025-12-20T01:28:03.200ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3272025-12-20T01:28:03.204ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
3282025-12-20T01:28:03.207ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3292025-12-20T01:28:03.763ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3302025-12-20T01:28:03.768ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
3312025-12-20T01:28:03.770ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3322025-12-20T01:28:04.584ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3332025-12-20T01:28:04.587ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
3342025-12-20T01:28:04.590ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3352025-12-20T01:28:05.369ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3362025-12-20T01:28:05.373ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
3372025-12-20T01:28:05.376ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3382025-12-20T01:28:06.006ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3392025-12-20T01:28:06.010ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
3402025-12-20T01:28:06.013ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3412025-12-20T01:28:07.037ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3422025-12-20T01:28:07.041ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
3432025-12-20T01:28:07.044ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3442025-12-20T01:28:08.486ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3452025-12-20T01:28:08.490ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
3462025-12-20T01:28:08.493ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3472025-12-20T01:28:09.396ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3482025-12-20T01:28:09.400ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
3492025-12-20T01:28:09.403ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3502025-12-20T01:28:10.176ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3512025-12-20T01:28:10.180ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
3522025-12-20T01:28:10.183ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3532025-12-20T01:28:10.909ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 13616609735993055790 n_samples = 6 unit = oximeter
3542025-12-20T01:28:10.943ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3552025-12-20T01:28:10.947ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
3562025-12-20T01:28:10.950ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3572025-12-20T01:28:11.969ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5547863117464175049 n_samples = 6 unit = oximeter
3582025-12-20T01:28:12.197ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3592025-12-20T01:28:12.202ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
3602025-12-20T01:28:12.204ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3612025-12-20T01:28:13.121ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3622025-12-20T01:28:13.126ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
3632025-12-20T01:28:13.129ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3642025-12-20T01:28:14.222ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3652025-12-20T01:28:14.227ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
3662025-12-20T01:28:14.229ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3672025-12-20T01:28:15.004ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }) unit = producer-server
3682025-12-20T01:28:15.005ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 4 delay = 84.13112379s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/e76962a/oximeter/producer/src/lib.rs:371 unit = producer-server
3692025-12-20T01:28:15.416ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3702025-12-20T01:28:15.421ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
3712025-12-20T01:28:15.424ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3722025-12-20T01:28:16.815ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3732025-12-20T01:28:16.823ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
3742025-12-20T01:28:16.829ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3752025-12-20T01:28:17.616ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3762025-12-20T01:28:17.622ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
3772025-12-20T01:28:17.625ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3782025-12-20T01:28:18.251ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3792025-12-20T01:28:18.257ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
3802025-12-20T01:28:18.261ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3812025-12-20T01:28:18.431ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("35a0b243-615d-49dc-9864-0e1640115f12.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("81c11ffb-8a21-4f98-bc57-2ec16e7247b1.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("a31a192d-34b7-47d9-841b-e667d9510530.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("a31a192d-34b7-47d9-841b-e667d9510530.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 931, tv_nsec: 951112361 } }) unit = producer-server
3822025-12-20T01:28:18.432ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221 unit = producer-server
3832025-12-20T01:28:18.466ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
3842025-12-20T01:28:19.754ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3852025-12-20T01:28:19.762ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
3862025-12-20T01:28:19.770ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3872025-12-20T01:28:20.459ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3882025-12-20T01:28:20.526ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
3892025-12-20T01:28:20.546ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3902025-12-20T01:28:20.885ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 13616609735993055790 n_samples = 6 unit = oximeter
3912025-12-20T01:28:21.435ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3922025-12-20T01:28:21.442ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
3932025-12-20T01:28:21.446ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3942025-12-20T01:28:21.945ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5547863117464175049 n_samples = 6 unit = oximeter
3952025-12-20T01:28:22.237ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3962025-12-20T01:28:22.242ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
3972025-12-20T01:28:22.246ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3982025-12-20T01:28:23.486ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3992025-12-20T01:28:23.492ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
4002025-12-20T01:28:23.495ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4012025-12-20T01:28:24.199ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4022025-12-20T01:28:24.204ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
4032025-12-20T01:28:24.207ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4042025-12-20T01:28:25.378ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4052025-12-20T01:28:25.385ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
4062025-12-20T01:28:25.388ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4072025-12-20T01:28:25.932ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4082025-12-20T01:28:25.938ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
4092025-12-20T01:28:25.941ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4102025-12-20T01:28:27.000ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4112025-12-20T01:28:27.005ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
4122025-12-20T01:28:27.009ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4132025-12-20T01:28:28.024ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4142025-12-20T01:28:28.029ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
4152025-12-20T01:28:28.032ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4162025-12-20T01:28:29.290ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4172025-12-20T01:28:29.298ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
4182025-12-20T01:28:29.302ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4192025-12-20T01:28:29.939ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4202025-12-20T01:28:29.943ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
4212025-12-20T01:28:29.945ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4222025-12-20T01:28:30.885ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 13616609735993055790 n_samples = 6 unit = oximeter
4232025-12-20T01:28:31.320ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4242025-12-20T01:28:31.325ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
4252025-12-20T01:28:31.328ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4262025-12-20T01:28:31.948ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5547863117464175049 n_samples = 6 unit = oximeter
4272025-12-20T01:28:32.749ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4282025-12-20T01:28:32.754ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
4292025-12-20T01:28:32.757ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4302025-12-20T01:28:33.458ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }) unit = producer-server
4312025-12-20T01:28:33.460ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 5 delay = 102.604167464s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/e76962a/oximeter/producer/src/lib.rs:371 unit = producer-server
4322025-12-20T01:28:33.703ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4332025-12-20T01:28:33.708ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
4342025-12-20T01:28:33.711ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4352025-12-20T01:28:34.917ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4362025-12-20T01:28:34.923ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
4372025-12-20T01:28:34.925ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4382025-12-20T01:28:36.011ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4392025-12-20T01:28:36.016ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
4402025-12-20T01:28:36.018ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4412025-12-20T01:28:37.322ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4422025-12-20T01:28:37.327ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
4432025-12-20T01:28:37.330ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4442025-12-20T01:28:38.788ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4452025-12-20T01:28:38.793ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
4462025-12-20T01:28:38.796ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4472025-12-20T01:28:39.867ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4482025-12-20T01:28:39.872ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
4492025-12-20T01:28:39.875ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4502025-12-20T01:28:40.752ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4512025-12-20T01:28:40.760ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
4522025-12-20T01:28:40.764ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4532025-12-20T01:28:40.894ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 13616609735993055790 n_samples = 6 unit = oximeter
4542025-12-20T01:28:44.490ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5547863117464175049 n_samples = 6 unit = oximeter
4552025-12-20T01:28:44.490ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4562025-12-20T01:28:44.497ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
4572025-12-20T01:28:44.510ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4582025-12-20T01:28:44.928ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("35a0b243-615d-49dc-9864-0e1640115f12.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("81c11ffb-8a21-4f98-bc57-2ec16e7247b1.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("a31a192d-34b7-47d9-841b-e667d9510530.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("a31a192d-34b7-47d9-841b-e667d9510530.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 958, tv_nsec: 453357150 } }) unit = producer-server
4592025-12-20T01:28:44.929ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221 unit = producer-server
4602025-12-20T01:28:44.979ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
4612025-12-20T01:28:45.779ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4622025-12-20T01:28:45.786ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
4632025-12-20T01:28:45.790ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4642025-12-20T01:28:47.260ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4652025-12-20T01:28:47.268ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
4662025-12-20T01:28:47.273ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4672025-12-20T01:28:48.155ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4682025-12-20T01:28:48.163ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
4692025-12-20T01:28:48.168ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4702025-12-20T01:28:49.048ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4712025-12-20T01:28:49.053ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
4722025-12-20T01:28:49.056ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4732025-12-20T01:28:49.667ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4742025-12-20T01:28:49.672ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
4752025-12-20T01:28:49.674ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4762025-12-20T01:28:50.699ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4772025-12-20T01:28:50.704ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
4782025-12-20T01:28:50.707ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4792025-12-20T01:28:50.896ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 13616609735993055790 n_samples = 6 unit = oximeter
4802025-12-20T01:28:51.558ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4812025-12-20T01:28:51.563ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
4822025-12-20T01:28:51.566ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4832025-12-20T01:28:52.704ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4842025-12-20T01:28:52.709ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
4852025-12-20T01:28:52.712ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4862025-12-20T01:28:54.193ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4872025-12-20T01:28:54.199ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
4882025-12-20T01:28:54.202ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4892025-12-20T01:28:54.491ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5547863117464175049 n_samples = 6 unit = oximeter
4902025-12-20T01:28:55.029ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4912025-12-20T01:28:55.035ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
4922025-12-20T01:28:55.039ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4932025-12-20T01:28:55.990ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4942025-12-20T01:28:55.996ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
4952025-12-20T01:28:55.999ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4962025-12-20T01:28:56.816ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4972025-12-20T01:28:56.822ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
4982025-12-20T01:28:56.825ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4992025-12-20T01:28:57.669ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5002025-12-20T01:28:57.674ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
5012025-12-20T01:28:57.677ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5022025-12-20T01:28:58.393ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5032025-12-20T01:28:58.398ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
5042025-12-20T01:28:58.401ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5052025-12-20T01:28:59.562ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5062025-12-20T01:28:59.568ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
5072025-12-20T01:28:59.571ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5082025-12-20T01:28:59.981ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }) unit = producer-server
5092025-12-20T01:28:59.982ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 6 delay = 129.126254675s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/e76962a/oximeter/producer/src/lib.rs:371 unit = producer-server
5102025-12-20T01:29:00.200ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5112025-12-20T01:29:00.205ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
5122025-12-20T01:29:00.208ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5132025-12-20T01:29:00.899ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 13616609735993055790 n_samples = 6 unit = oximeter
5142025-12-20T01:29:01.062ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5152025-12-20T01:29:01.067ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
5162025-12-20T01:29:01.071ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5172025-12-20T01:29:01.855ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5182025-12-20T01:29:01.861ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
5192025-12-20T01:29:01.864ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5202025-12-20T01:29:02.785ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5212025-12-20T01:29:02.791ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
5222025-12-20T01:29:02.795ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5232025-12-20T01:29:03.386ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5242025-12-20T01:29:03.392ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
5252025-12-20T01:29:03.395ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5262025-12-20T01:29:04.254ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5272025-12-20T01:29:04.260ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
5282025-12-20T01:29:04.263ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5292025-12-20T01:29:04.494ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5547863117464175049 n_samples = 6 unit = oximeter
5302025-12-20T01:29:05.449ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5312025-12-20T01:29:05.456ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
5322025-12-20T01:29:05.460ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5332025-12-20T01:29:06.702ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5342025-12-20T01:29:06.710ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
5352025-12-20T01:29:06.715ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5362025-12-20T01:29:08.065ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5372025-12-20T01:29:08.073ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
5382025-12-20T01:29:10.011ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5392025-12-20T01:29:10.335ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("35a0b243-615d-49dc-9864-0e1640115f12.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("81c11ffb-8a21-4f98-bc57-2ec16e7247b1.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("a31a192d-34b7-47d9-841b-e667d9510530.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("a31a192d-34b7-47d9-841b-e667d9510530.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 983, tv_nsec: 861287252 } }) unit = producer-server
5402025-12-20T01:29:10.344ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221 unit = producer-server
5412025-12-20T01:29:10.491ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
5422025-12-20T01:29:10.914ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 13616609735993055790 n_samples = 6 unit = oximeter
5432025-12-20T01:29:12.350ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5442025-12-20T01:29:12.358ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
5452025-12-20T01:29:12.363ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5462025-12-20T01:29:13.699ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5472025-12-20T01:29:13.706ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
5482025-12-20T01:29:13.710ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5492025-12-20T01:29:14.518ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5547863117464175049 n_samples = 6 unit = oximeter
5502025-12-20T01:29:14.638ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5512025-12-20T01:29:14.648ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
5522025-12-20T01:29:14.658ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5532025-12-20T01:29:15.909ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5542025-12-20T01:29:15.916ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
5552025-12-20T01:29:15.925ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5562025-12-20T01:29:16.966ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5572025-12-20T01:29:16.973ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
5582025-12-20T01:29:16.977ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5592025-12-20T01:29:17.714ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5602025-12-20T01:29:17.744ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
5612025-12-20T01:29:17.759ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5622025-12-20T01:29:18.593ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5632025-12-20T01:29:18.601ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
5642025-12-20T01:29:18.605ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5652025-12-20T01:29:19.759ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5662025-12-20T01:29:19.766ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
5672025-12-20T01:29:19.782ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5682025-12-20T01:29:20.971ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 13616609735993055790 n_samples = 6 unit = oximeter
5692025-12-20T01:29:21.157ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5702025-12-20T01:29:21.168ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
5712025-12-20T01:29:21.176ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5722025-12-20T01:29:22.219ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5732025-12-20T01:29:22.225ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
5742025-12-20T01:29:22.228ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5752025-12-20T01:29:23.040ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5762025-12-20T01:29:23.045ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
5772025-12-20T01:29:23.120ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5782025-12-20T01:29:24.112ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5792025-12-20T01:29:24.116ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
5802025-12-20T01:29:24.119ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5812025-12-20T01:29:24.521ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5547863117464175049 n_samples = 6 unit = oximeter
5822025-12-20T01:29:24.901ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5832025-12-20T01:29:24.907ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
5842025-12-20T01:29:24.910ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5852025-12-20T01:29:25.496ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }) unit = producer-server
5862025-12-20T01:29:25.502ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 7 delay = 154.645737116s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/e76962a/oximeter/producer/src/lib.rs:371 unit = producer-server
5872025-12-20T01:29:26.155ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5882025-12-20T01:29:26.162ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
5892025-12-20T01:29:26.166ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5902025-12-20T01:29:26.723ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5912025-12-20T01:29:26.732ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
5922025-12-20T01:29:26.737ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5932025-12-20T01:29:28.152ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5942025-12-20T01:29:28.157ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
5952025-12-20T01:29:28.161ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5962025-12-20T01:29:29.232ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5972025-12-20T01:29:29.239ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
5982025-12-20T01:29:29.243ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5992025-12-20T01:29:30.056ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6002025-12-20T01:29:30.065ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
6012025-12-20T01:29:30.069ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6022025-12-20T01:29:30.975ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 13616609735993055790 n_samples = 6 unit = oximeter
6032025-12-20T01:29:31.091ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6042025-12-20T01:29:31.100ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
6052025-12-20T01:29:31.104ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6062025-12-20T01:29:32.365ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6072025-12-20T01:29:32.370ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
6082025-12-20T01:29:32.374ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6092025-12-20T01:29:33.522ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6102025-12-20T01:29:33.527ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
6112025-12-20T01:29:33.530ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6122025-12-20T01:29:34.529ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5547863117464175049 n_samples = 6 unit = oximeter
6132025-12-20T01:29:34.830ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6142025-12-20T01:29:34.838ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
6152025-12-20T01:29:34.842ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6162025-12-20T01:29:36.015ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6172025-12-20T01:29:36.022ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
6182025-12-20T01:29:36.025ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6192025-12-20T01:29:36.753ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6202025-12-20T01:29:36.761ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
6212025-12-20T01:29:36.766ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6222025-12-20T01:29:38.132ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6232025-12-20T01:29:38.139ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
6242025-12-20T01:29:38.142ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6252025-12-20T01:29:39.142ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6262025-12-20T01:29:39.148ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
6272025-12-20T01:29:39.151ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6282025-12-20T01:29:40.159ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6292025-12-20T01:29:40.165ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
6302025-12-20T01:29:40.168ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6312025-12-20T01:29:40.952ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6322025-12-20T01:29:40.957ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
6332025-12-20T01:29:40.960ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6342025-12-20T01:29:40.977ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 13616609735993055790 n_samples = 6 unit = oximeter
6352025-12-20T01:29:41.716ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6362025-12-20T01:29:41.721ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
6372025-12-20T01:29:41.724ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6382025-12-20T01:29:43.054ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6392025-12-20T01:29:43.060ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
6402025-12-20T01:29:43.063ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6412025-12-20T01:29:43.637ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6422025-12-20T01:29:43.643ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
6432025-12-20T01:29:43.646ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6442025-12-20T01:29:44.534ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5547863117464175049 n_samples = 6 unit = oximeter
6452025-12-20T01:29:44.573ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6462025-12-20T01:29:44.579ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
6472025-12-20T01:29:44.583ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6482025-12-20T01:29:45.875ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6492025-12-20T01:29:45.882ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
6502025-12-20T01:29:45.885ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6512025-12-20T01:29:46.972ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6522025-12-20T01:29:46.977ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
6532025-12-20T01:29:46.980ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6542025-12-20T01:29:48.388ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6552025-12-20T01:29:48.397ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
6562025-12-20T01:29:48.401ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6572025-12-20T01:29:49.858ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6582025-12-20T01:29:49.864ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
6592025-12-20T01:29:49.868ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6602025-12-20T01:29:50.465ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6612025-12-20T01:29:50.478ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
6622025-12-20T01:29:50.481ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6632025-12-20T01:29:50.991ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 13616609735993055790 n_samples = 6 unit = oximeter
6642025-12-20T01:29:51.350ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6652025-12-20T01:29:51.355ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
6662025-12-20T01:29:51.358ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6672025-12-20T01:29:52.570ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6682025-12-20T01:29:52.577ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
6692025-12-20T01:29:52.581ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6702025-12-20T01:29:53.841ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6712025-12-20T01:29:53.847ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
6722025-12-20T01:29:53.850ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6732025-12-20T01:29:54.539ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5547863117464175049 n_samples = 6 unit = oximeter
6742025-12-20T01:29:55.283ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6752025-12-20T01:29:55.288ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
6762025-12-20T01:29:55.292ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6772025-12-20T01:29:56.664ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6782025-12-20T01:29:56.669ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
6792025-12-20T01:29:56.673ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6802025-12-20T01:29:57.570ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6812025-12-20T01:29:57.577ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
6822025-12-20T01:29:57.580ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6832025-12-20T01:29:57.784ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("35a0b243-615d-49dc-9864-0e1640115f12.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("81c11ffb-8a21-4f98-bc57-2ec16e7247b1.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("a31a192d-34b7-47d9-841b-e667d9510530.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("a31a192d-34b7-47d9-841b-e667d9510530.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 1031, tv_nsec: 311550447 } }) unit = producer-server
6842025-12-20T01:29:57.786ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221 unit = producer-server
6852025-12-20T01:29:57.818ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
6862025-12-20T01:29:57.828ZDEBGtfportd (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "ef1c16c9-9c03-4baa-9ce1-177fbc6e2043", "content-length": "41", "date": "Sat, 20 Dec 2025 01:29:57 GMT"} }) unit = producer-server
6872025-12-20T01:29:57.830ZDEBGtfportd (producer-registration-task): successfully registered with Nexus, pausing until time to renew lease lease_duration = 600s unit = producer-server wait_period = 150s
6882025-12-20T01:29:58.183ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6892025-12-20T01:29:58.189ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
6902025-12-20T01:29:58.192ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6912025-12-20T01:29:59.298ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6922025-12-20T01:29:59.304ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
6932025-12-20T01:29:59.308ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6942025-12-20T01:30:00.223ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6952025-12-20T01:30:00.229ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::743a:11ff:fe9e:ae4c]
6962025-12-20T01:30:00.232ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]