Max level shown:
1 [ Dec 27 22:43:09 Enabled. ]
2 [ Dec 27 22:43:09 Rereading configuration. ]
3 [ Dec 27 22:43:10 Rereading configuration. ]
4 [ Dec 27 22:43:21 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dendrite/bin/tfportd --sync-only &"). ]
5 [ Dec 27 22:43:21 Method "start" exited with status 0. ]
6 No non-localhost IPv6 addresses found in SMF properties
72025-12-27T22:43:21.688ZINFOtfportd: connecting to dpd host = [::1] port = 12224
82025-12-27T22:43:21.729ZINFOtfportd: connected to dpd running softnpu-c9bf538d
92025-12-27T22:43:21.729ZINFOtfportd: running in sync-only mode
102025-12-27T22:43:21.730ZINFOtfportd: no non-localhost IPv6 listen address available, waiting for SMF update unit = oximeter
112025-12-27T22:43:21.731ZINFOtfportd: refreshing SMF config prior to waiting on signals unit = signal_handler
12 No non-localhost IPv6 addresses found in SMF properties
132025-12-27T22:43:21.733ZINFOtfportd: refreshed config: Config { log_file: None, log_format: Json, listen_addresses: [ [::1]:12231, ], pkt_source: None, dpd_host: "[::1]", dpd_port: 12224, vlan_link: None, vlan_data: None, techport0_prefix: None, techport1_prefix: None, rack_id: Some( 104aeeb2-f645-448d-8d56-327a38a18686, ), sled_id: Some( 5684ff92-1236-47a8-845b-bbb75ad0c8f2, ), sled_model: Some( "i86pc", ), sled_revision: Some( 0, ), sled_serial: Some( "buskin", ), }
142025-12-27T22:43:21.733ZINFOtfportd: no non-localhost IPv6 listen address available, waiting for SMF update unit = oximeter
152025-12-27T22:43:21.737ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::ac5f:81ff:feb7:9201->ae:5f:81:b7:92:01 interface = tfportrear0_0
162025-12-27T22:43:21.740ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
172025-12-27T22:43:21.747ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
182025-12-27T22:43:21.753ZWARNtfportd: tfportqsfp0_0 has no addrs
19 [ Dec 27 22:43:22 Rereading configuration. ]
20 [ Dec 27 22:43:22 Executing refresh method (:kill). ]
21 [ Dec 27 22:43:22 Stopping because all processes in service exited. ]
22 [ Dec 27 22:43:22 Executing stop method (:kill). ]
23 [ Dec 27 22:43:22 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dendrite/bin/tfportd --sync-only &"). ]
24 [ Dec 27 22:43:22 Method "start" exited with status 0. ]
252025-12-27T22:43:22.307ZINFOtfportd: connecting to dpd host = [::1] port = 12224
262025-12-27T22:43:22.346ZINFOtfportd: connected to dpd running softnpu-c9bf538d
272025-12-27T22:43:22.346ZINFOtfportd: running in sync-only mode
282025-12-27T22:43:22.346ZINFOtfportd: found suitable IPv6 address for oximeter producer server address = fd00:1122:3344:101::2 unit = oximeter
292025-12-27T22:43:22.348ZINFOtfportd: refreshing SMF config prior to waiting on signals unit = signal_handler
302025-12-27T22:43:22.348ZDEBGtfportd: extracted oximeter configuration data config = OximeterConfig { listen_address: fd00:1122:3344:101::2, sled_identifiers: SledIdentifiers { rack_id: 104aeeb2-f645-448d-8d56-327a38a18686, sled_id: 5684ff92-1236-47a8-845b-bbb75ad0c8f2, model: "i86pc", revision: 0, serial: "buskin" }, switch_identifiers: SwitchIdentifiers { asic_backend: "softnpu", fab: None, lot: None, model: "FAKE_SIM_SIDECAR", revision: 0, serial: "SimSidecar0", sidecar_id: 5b56d23c-8595-4891-bdb3-3e3ecb9cade8, slot: 0, wafer: None, wafer_loc: None } } unit = oximeter
312025-12-27T22:43:22.348ZDEBGtfportd: created producer ID producer_id = 1d98c31c-61e6-4bb4-b4be-b7f3a9ede39c unit = oximeter
322025-12-27T22:43:22.349ZINFOtfportd: refreshed config: Config { log_file: None, log_format: Json, listen_addresses: [ [fd00:1122:3344:101::2]:12231, [::1]:12231, ], pkt_source: None, dpd_host: "[::1]", dpd_port: 12224, vlan_link: None, vlan_data: None, techport0_prefix: None, techport1_prefix: None, rack_id: Some( 104aeeb2-f645-448d-8d56-327a38a18686, ), sled_id: Some( 5684ff92-1236-47a8-845b-bbb75ad0c8f2, ), sled_model: Some( "i86pc", ), sled_revision: Some( 0, ), sled_serial: Some( "buskin", ), }
332025-12-27T22:43:22.357ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
342025-12-27T22:43:22.358ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::3cd0:74ff:fe4b:f8f5->3e:d0:74:4b:f8:f5 interface = tfportrear0_0
352025-12-27T22:43:22.358ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::ac5f:81ff:feb7:9201->ae:5f:81:b7:92:01 interface = tfportrear0_0
362025-12-27T22:43:22.359ZDEBGtfportd: registered DTrace probes unit = producer-server
372025-12-27T22:43:22.359ZDEBGtfportd (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::2]:42876 method = GET path = /{producer_id} unit = producer-server versions = all
382025-12-27T22:43:22.359ZINFOtfportd (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.4/src/server.rs:328 local_addr = [fd00:1122:3344:101::2]:42876 unit = producer-server
392025-12-27T22:43:22.359ZDEBGtfportd (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::2]:42876 unit = producer-server
402025-12-27T22:43:22.359ZDEBGtfportd: Requested any available port, Dropshot server has been bound to [fd00:1122:3344:101::2]:42876 unit = producer-server
412025-12-27T22:43:22.359ZDEBGtfportd: Nexus IP not provided, will use DNS to resolve it unit = producer-server
422025-12-27T22:43:22.360ZINFOtfportd (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/64b40cb/internal-dns/resolver/src/resolver.rs:144 unit = producer-server
432025-12-27T22:43:22.361ZDEBGtfportd: starting producer registration task unit = producer-server
442025-12-27T22:43:22.361ZINFOtfportd: starting oximeter metric producer server address = [fd00:1122:3344:101::2]:42876 file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/64b40cb/oximeter/producer/src/lib.rs:279 interval = 30s producer_id = 1d98c31c-61e6-4bb4-b4be-b7f3a9ede39c unit = producer-server
452025-12-27T22:43:22.361ZDEBGtfportd (producer-registration-task): registering as oximeter producer with Nexus registration_count = 0 unit = producer-server
462025-12-27T22:43:22.361ZINFOtfportd: created oximeter producer server unit = oximeter
472025-12-27T22:43:22.362ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
482025-12-27T22:43:22.362ZDEBGtfportd (kstat-sampler): adding new target unit = oximeter
492025-12-27T22:43:22.362ZDEBGtfportd (kstat-sampler-worker): storing new creation time for tracked target creation_time = 2025-12-27T22:43:05.703200028Z path = KstatPath { module: "link", instance: 0, name: "tfportrear0_0" } unit = oximeter
502025-12-27T22:43:22.363ZDEBGtfportd (kstat-sampler-worker): inserted empty per-target sample queue id = 865447881555518831 unit = oximeter
512025-12-27T22:43:22.363ZDEBGtfportd: added new link to kstat sampler link_kind = switch-port-control link_name = tfportrear0_0 unit = metrics-task-tracker
522025-12-27T22:43:22.365ZWARNtfportd: tfportqsfp0_0 has no addrs
532025-12-27T22:43:23.163ZINFOtfportd: added new ARP entry entry = 10.151.1.174->56:0e:85:9f:b9:1c interface = tfportqsfp0_0
542025-12-27T22:43:23.280ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
552025-12-27T22:43:23.286ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
562025-12-27T22:43:23.289ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
572025-12-27T22:43:23.289ZDEBGtfportd (kstat-sampler): adding new target unit = oximeter
582025-12-27T22:43:23.290ZDEBGtfportd (kstat-sampler-worker): storing new creation time for tracked target creation_time = 2025-12-27T22:43:05.703067644Z path = KstatPath { module: "link", instance: 0, name: "tfportqsfp0_0" } unit = oximeter
592025-12-27T22:43:23.290ZDEBGtfportd (kstat-sampler-worker): inserted empty per-target sample queue id = 5947198693629191193 unit = oximeter
602025-12-27T22:43:23.290ZDEBGtfportd: added new link to kstat sampler link_kind = switch-port-control link_name = tfportqsfp0_0 unit = metrics-task-tracker
612025-12-27T22:43:24.562ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
622025-12-27T22:43:24.567ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
632025-12-27T22:43:24.570ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
642025-12-27T22:43:25.502ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
652025-12-27T22:43:25.508ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
662025-12-27T22:43:25.511ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
672025-12-27T22:43:26.819ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
682025-12-27T22:43:26.826ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
692025-12-27T22:43:26.829ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
702025-12-27T22:43:27.363ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("2020e2ce-bd2f-46c9-a8fb-7d5cbd4017a9.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("c1199a26-dd00-45a2-8af7-9c9db9218aaa.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("d748354b-24a4-4ec4-bed9-d3e0812365c8.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("d748354b-24a4-4ec4-bed9-d3e0812365c8.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 650, tv_nsec: 844096656 } }) unit = producer-server
712025-12-27T22:43:27.363ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221 unit = producer-server
722025-12-27T22:43:27.395ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
732025-12-27T22:43:28.288ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
742025-12-27T22:43:28.293ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
752025-12-27T22:43:28.296ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
762025-12-27T22:43:29.574ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
772025-12-27T22:43:29.579ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
782025-12-27T22:43:29.582ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
792025-12-27T22:43:30.434ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
802025-12-27T22:43:30.439ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
812025-12-27T22:43:30.441ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
822025-12-27T22:43:31.513ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
832025-12-27T22:43:31.518ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
842025-12-27T22:43:31.521ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
852025-12-27T22:43:32.367ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 865447881555518831 n_samples = 6 unit = oximeter
862025-12-27T22:43:32.968ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
872025-12-27T22:43:32.972ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
882025-12-27T22:43:32.975ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
892025-12-27T22:43:33.293ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5947198693629191193 n_samples = 6 unit = oximeter
902025-12-27T22:43:33.514ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
912025-12-27T22:43:33.518ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
922025-12-27T22:43:33.520ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
932025-12-27T22:43:34.419ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
942025-12-27T22:43:34.423ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
952025-12-27T22:43:34.426ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
962025-12-27T22:43:35.147ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
972025-12-27T22:43:35.152ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
982025-12-27T22:43:35.154ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
992025-12-27T22:43:36.276ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1002025-12-27T22:43:36.281ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
1012025-12-27T22:43:36.284ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1022025-12-27T22:43:37.453ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1032025-12-27T22:43:37.457ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
1042025-12-27T22:43:37.461ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1052025-12-27T22:43:38.725ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1062025-12-27T22:43:38.729ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
1072025-12-27T22:43:38.732ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1082025-12-27T22:43:40.206ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1092025-12-27T22:43:40.211ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
1102025-12-27T22:43:40.214ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1112025-12-27T22:43:41.502ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1122025-12-27T22:43:41.505ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
1132025-12-27T22:43:41.508ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1142025-12-27T22:43:42.370ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 865447881555518831 n_samples = 6 unit = oximeter
1152025-12-27T22:43:42.396ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }) unit = producer-server
1162025-12-27T22:43:42.397ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 0 delay = 20.036532564s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/64b40cb/oximeter/producer/src/lib.rs:371 unit = producer-server
1172025-12-27T22:43:42.598ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("2020e2ce-bd2f-46c9-a8fb-7d5cbd4017a9.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("c1199a26-dd00-45a2-8af7-9c9db9218aaa.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("d748354b-24a4-4ec4-bed9-d3e0812365c8.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("d748354b-24a4-4ec4-bed9-d3e0812365c8.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 666, tv_nsec: 79576368 } }) unit = producer-server
1182025-12-27T22:43:42.599ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221 unit = producer-server
1192025-12-27T22:43:42.629ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
1202025-12-27T22:43:42.679ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1212025-12-27T22:43:42.683ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
1222025-12-27T22:43:42.685ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1232025-12-27T22:43:43.296ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5947198693629191193 n_samples = 6 unit = oximeter
1242025-12-27T22:43:43.761ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1252025-12-27T22:43:43.765ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
1262025-12-27T22:43:43.768ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1272025-12-27T22:43:45.241ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1282025-12-27T22:43:45.246ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
1292025-12-27T22:43:45.248ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1302025-12-27T22:43:46.563ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1312025-12-27T22:43:46.567ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
1322025-12-27T22:43:46.570ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1332025-12-27T22:43:47.969ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1342025-12-27T22:43:47.973ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
1352025-12-27T22:43:47.976ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1362025-12-27T22:43:49.157ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1372025-12-27T22:43:49.162ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
1382025-12-27T22:43:49.164ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1392025-12-27T22:43:50.103ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1402025-12-27T22:43:50.107ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
1412025-12-27T22:43:50.110ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1422025-12-27T22:43:50.894ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1432025-12-27T22:43:50.899ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
1442025-12-27T22:43:50.901ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1452025-12-27T22:43:51.682ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1462025-12-27T22:43:51.689ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
1472025-12-27T22:43:51.691ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1482025-12-27T22:43:52.373ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 865447881555518831 n_samples = 6 unit = oximeter
1492025-12-27T22:43:52.778ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1502025-12-27T22:43:52.782ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
1512025-12-27T22:43:52.785ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1522025-12-27T22:43:53.298ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5947198693629191193 n_samples = 6 unit = oximeter
1532025-12-27T22:43:54.106ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1542025-12-27T22:43:54.110ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
1552025-12-27T22:43:54.113ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1562025-12-27T22:43:54.696ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1572025-12-27T22:43:54.701ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
1582025-12-27T22:43:54.704ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1592025-12-27T22:43:55.762ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1602025-12-27T22:43:55.766ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
1612025-12-27T22:43:55.769ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1622025-12-27T22:43:56.982ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1632025-12-27T22:43:56.986ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
1642025-12-27T22:43:56.988ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1652025-12-27T22:43:57.631ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }) unit = producer-server
1662025-12-27T22:43:57.632ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 1 delay = 35.271589367s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/64b40cb/oximeter/producer/src/lib.rs:371 unit = producer-server
1672025-12-27T22:43:58.096ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("2020e2ce-bd2f-46c9-a8fb-7d5cbd4017a9.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("c1199a26-dd00-45a2-8af7-9c9db9218aaa.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("d748354b-24a4-4ec4-bed9-d3e0812365c8.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("d748354b-24a4-4ec4-bed9-d3e0812365c8.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 681, tv_nsec: 577863365 } }) unit = producer-server
1682025-12-27T22:43:58.097ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221 unit = producer-server
1692025-12-27T22:43:58.127ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
1702025-12-27T22:43:58.172ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1712025-12-27T22:43:58.177ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
1722025-12-27T22:43:58.180ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1732025-12-27T22:43:59.512ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1742025-12-27T22:43:59.517ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
1752025-12-27T22:43:59.519ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1762025-12-27T22:44:00.559ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1772025-12-27T22:44:00.563ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
1782025-12-27T22:44:00.566ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1792025-12-27T22:44:01.370ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1802025-12-27T22:44:01.375ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
1812025-12-27T22:44:01.377ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1822025-12-27T22:44:02.037ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1832025-12-27T22:44:02.041ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
1842025-12-27T22:44:02.044ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1852025-12-27T22:44:02.376ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 865447881555518831 n_samples = 6 unit = oximeter
1862025-12-27T22:44:03.114ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1872025-12-27T22:44:03.119ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
1882025-12-27T22:44:03.122ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1892025-12-27T22:44:03.301ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5947198693629191193 n_samples = 6 unit = oximeter
1902025-12-27T22:44:03.701ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1912025-12-27T22:44:03.705ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
1922025-12-27T22:44:03.708ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1932025-12-27T22:44:04.875ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1942025-12-27T22:44:04.879ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
1952025-12-27T22:44:04.882ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1962025-12-27T22:44:05.419ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1972025-12-27T22:44:05.423ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
1982025-12-27T22:44:05.426ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1992025-12-27T22:44:06.451ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2002025-12-27T22:44:06.457ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
2012025-12-27T22:44:06.460ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2022025-12-27T22:44:07.310ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2032025-12-27T22:44:07.314ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
2042025-12-27T22:44:07.317ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2052025-12-27T22:44:08.661ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2062025-12-27T22:44:08.665ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
2072025-12-27T22:44:08.668ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2082025-12-27T22:44:09.449ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2092025-12-27T22:44:09.454ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
2102025-12-27T22:44:09.456ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2112025-12-27T22:44:10.451ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2122025-12-27T22:44:10.455ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
2132025-12-27T22:44:10.458ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2142025-12-27T22:44:11.138ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2152025-12-27T22:44:11.142ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
2162025-12-27T22:44:11.145ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2172025-12-27T22:44:12.378ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 865447881555518831 n_samples = 6 unit = oximeter
2182025-12-27T22:44:12.387ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2192025-12-27T22:44:12.391ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
2202025-12-27T22:44:12.394ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2212025-12-27T22:44:13.128ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }) unit = producer-server
2222025-12-27T22:44:13.130ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 2 delay = 50.769463562s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/64b40cb/oximeter/producer/src/lib.rs:371 unit = producer-server
2232025-12-27T22:44:13.302ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5947198693629191193 n_samples = 6 unit = oximeter
2242025-12-27T22:44:13.408ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2252025-12-27T22:44:13.412ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
2262025-12-27T22:44:13.415ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2272025-12-27T22:44:14.064ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("2020e2ce-bd2f-46c9-a8fb-7d5cbd4017a9.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("c1199a26-dd00-45a2-8af7-9c9db9218aaa.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("d748354b-24a4-4ec4-bed9-d3e0812365c8.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("d748354b-24a4-4ec4-bed9-d3e0812365c8.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 697, tv_nsec: 545755179 } }) unit = producer-server
2282025-12-27T22:44:14.065ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221 unit = producer-server
2292025-12-27T22:44:14.095ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
2302025-12-27T22:44:14.477ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2312025-12-27T22:44:14.482ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
2322025-12-27T22:44:14.484ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2332025-12-27T22:44:15.860ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2342025-12-27T22:44:15.864ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
2352025-12-27T22:44:15.867ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2362025-12-27T22:44:16.821ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2372025-12-27T22:44:16.825ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
2382025-12-27T22:44:16.828ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2392025-12-27T22:44:18.095ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2402025-12-27T22:44:18.099ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
2412025-12-27T22:44:18.102ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2422025-12-27T22:44:19.000ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2432025-12-27T22:44:19.005ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
2442025-12-27T22:44:19.008ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2452025-12-27T22:44:20.385ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2462025-12-27T22:44:20.390ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
2472025-12-27T22:44:20.392ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2482025-12-27T22:44:21.396ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2492025-12-27T22:44:21.401ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
2502025-12-27T22:44:21.404ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2512025-12-27T22:44:22.099ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2522025-12-27T22:44:22.104ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
2532025-12-27T22:44:22.107ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2542025-12-27T22:44:22.379ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 865447881555518831 n_samples = 6 unit = oximeter
2552025-12-27T22:44:22.664ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2562025-12-27T22:44:22.669ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
2572025-12-27T22:44:22.671ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2582025-12-27T22:44:23.305ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5947198693629191193 n_samples = 6 unit = oximeter
2592025-12-27T22:44:23.511ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2602025-12-27T22:44:23.515ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
2612025-12-27T22:44:23.517ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2622025-12-27T22:44:24.112ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2632025-12-27T22:44:24.117ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
2642025-12-27T22:44:24.120ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2652025-12-27T22:44:25.007ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2662025-12-27T22:44:25.011ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
2672025-12-27T22:44:25.013ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2682025-12-27T22:44:25.862ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2692025-12-27T22:44:25.867ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
2702025-12-27T22:44:25.869ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2712025-12-27T22:44:27.358ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2722025-12-27T22:44:27.362ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
2732025-12-27T22:44:27.365ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2742025-12-27T22:44:28.454ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2752025-12-27T22:44:28.458ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
2762025-12-27T22:44:28.461ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2772025-12-27T22:44:29.095ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }) unit = producer-server
2782025-12-27T22:44:29.096ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 3 delay = 66.735524692s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/64b40cb/oximeter/producer/src/lib.rs:371 unit = producer-server
2792025-12-27T22:44:29.800ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2802025-12-27T22:44:29.805ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
2812025-12-27T22:44:29.808ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2822025-12-27T22:44:30.379ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2832025-12-27T22:44:30.384ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
2842025-12-27T22:44:30.387ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2852025-12-27T22:44:31.682ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2862025-12-27T22:44:31.687ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
2872025-12-27T22:44:31.690ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2882025-12-27T22:44:31.736ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("2020e2ce-bd2f-46c9-a8fb-7d5cbd4017a9.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("c1199a26-dd00-45a2-8af7-9c9db9218aaa.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("d748354b-24a4-4ec4-bed9-d3e0812365c8.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("d748354b-24a4-4ec4-bed9-d3e0812365c8.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 715, tv_nsec: 217059077 } }) unit = producer-server
2892025-12-27T22:44:31.736ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221 unit = producer-server
2902025-12-27T22:44:31.766ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
2912025-12-27T22:44:32.382ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 865447881555518831 n_samples = 6 unit = oximeter
2922025-12-27T22:44:32.896ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2932025-12-27T22:44:32.901ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
2942025-12-27T22:44:32.904ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2952025-12-27T22:44:33.307ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5947198693629191193 n_samples = 6 unit = oximeter
2962025-12-27T22:44:34.305ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2972025-12-27T22:44:34.310ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
2982025-12-27T22:44:34.313ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2992025-12-27T22:44:35.264ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3002025-12-27T22:44:35.268ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
3012025-12-27T22:44:35.270ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3022025-12-27T22:44:36.724ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3032025-12-27T22:44:36.728ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
3042025-12-27T22:44:36.731ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3052025-12-27T22:44:37.823ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3062025-12-27T22:44:37.826ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
3072025-12-27T22:44:37.829ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3082025-12-27T22:44:38.614ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3092025-12-27T22:44:38.619ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
3102025-12-27T22:44:38.622ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3112025-12-27T22:44:39.657ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3122025-12-27T22:44:39.662ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
3132025-12-27T22:44:39.664ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3142025-12-27T22:44:41.026ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3152025-12-27T22:44:41.030ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
3162025-12-27T22:44:41.033ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3172025-12-27T22:44:41.620ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3182025-12-27T22:44:41.624ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
3192025-12-27T22:44:41.627ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3202025-12-27T22:44:42.292ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3212025-12-27T22:44:42.296ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
3222025-12-27T22:44:42.299ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3232025-12-27T22:44:42.383ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 865447881555518831 n_samples = 6 unit = oximeter
3242025-12-27T22:44:43.310ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5947198693629191193 n_samples = 6 unit = oximeter
3252025-12-27T22:44:43.534ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3262025-12-27T22:44:43.538ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
3272025-12-27T22:44:43.541ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3282025-12-27T22:44:44.466ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3292025-12-27T22:44:44.470ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
3302025-12-27T22:44:44.473ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3312025-12-27T22:44:45.382ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3322025-12-27T22:44:45.387ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
3332025-12-27T22:44:45.389ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3342025-12-27T22:44:46.237ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3352025-12-27T22:44:46.242ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
3362025-12-27T22:44:46.245ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3372025-12-27T22:44:46.767ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }) unit = producer-server
3382025-12-27T22:44:46.768ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 4 delay = 84.407546666s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/64b40cb/oximeter/producer/src/lib.rs:371 unit = producer-server
3392025-12-27T22:44:46.894ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3402025-12-27T22:44:46.899ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
3412025-12-27T22:44:46.901ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3422025-12-27T22:44:47.629ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3432025-12-27T22:44:47.634ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
3442025-12-27T22:44:47.636ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3452025-12-27T22:44:49.057ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3462025-12-27T22:44:49.062ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
3472025-12-27T22:44:49.065ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3482025-12-27T22:44:50.270ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3492025-12-27T22:44:50.274ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
3502025-12-27T22:44:50.277ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3512025-12-27T22:44:50.553ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("2020e2ce-bd2f-46c9-a8fb-7d5cbd4017a9.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("c1199a26-dd00-45a2-8af7-9c9db9218aaa.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("d748354b-24a4-4ec4-bed9-d3e0812365c8.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("d748354b-24a4-4ec4-bed9-d3e0812365c8.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 734, tv_nsec: 34452218 } }) unit = producer-server
3522025-12-27T22:44:50.554ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221 unit = producer-server
3532025-12-27T22:44:50.584ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
3542025-12-27T22:44:51.019ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3552025-12-27T22:44:51.024ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
3562025-12-27T22:44:51.026ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3572025-12-27T22:44:51.665ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3582025-12-27T22:44:51.670ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
3592025-12-27T22:44:51.672ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3602025-12-27T22:44:52.385ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 865447881555518831 n_samples = 6 unit = oximeter
3612025-12-27T22:44:52.859ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3622025-12-27T22:44:52.864ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
3632025-12-27T22:44:52.867ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3642025-12-27T22:44:53.313ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5947198693629191193 n_samples = 6 unit = oximeter
3652025-12-27T22:44:53.689ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3662025-12-27T22:44:53.693ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
3672025-12-27T22:44:53.696ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3682025-12-27T22:44:54.226ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3692025-12-27T22:44:54.230ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
3702025-12-27T22:44:54.233ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3712025-12-27T22:44:55.246ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3722025-12-27T22:44:55.252ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
3732025-12-27T22:44:55.254ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3742025-12-27T22:44:55.840ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3752025-12-27T22:44:55.845ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
3762025-12-27T22:44:55.847ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3772025-12-27T22:44:56.402ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3782025-12-27T22:44:56.407ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
3792025-12-27T22:44:56.409ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3802025-12-27T22:44:57.780ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3812025-12-27T22:44:57.784ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
3822025-12-27T22:44:57.786ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3832025-12-27T22:44:58.745ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3842025-12-27T22:44:58.749ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
3852025-12-27T22:44:58.752ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3862025-12-27T22:44:59.822ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3872025-12-27T22:44:59.826ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
3882025-12-27T22:44:59.829ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3892025-12-27T22:45:00.769ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3902025-12-27T22:45:00.774ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::ac5f:81ff:feb7:9201]
3912025-12-27T22:45:00.777ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]