Max level shown:
1 [ Dec 18 18:28:58 Enabled. ]
2 [ Dec 18 18:28:58 Rereading configuration. ]
3 [ Dec 18 18:28:59 Rereading configuration. ]
4 [ Dec 18 18:29:10 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dendrite/bin/tfportd --sync-only &"). ]
5 [ Dec 18 18:29:10 Method "start" exited with status 0. ]
6 No non-localhost IPv6 addresses found in SMF properties
72025-12-18T18:29:10.308ZINFOtfportd: connecting to dpd host = [::1] port = 12224
82025-12-18T18:29:10.349ZINFOtfportd: connected to dpd running softnpu-606c0be8
92025-12-18T18:29:10.349ZINFOtfportd: running in sync-only mode
102025-12-18T18:29:10.350ZINFOtfportd: no non-localhost IPv6 listen address available, waiting for SMF update unit = oximeter
112025-12-18T18:29:10.352ZINFOtfportd: refreshing SMF config prior to waiting on signals unit = signal_handler
12 No non-localhost IPv6 addresses found in SMF properties
132025-12-18T18:29:10.353ZINFOtfportd: refreshed config: Config { log_file: None, log_format: Json, listen_addresses: [ [::1]:12231, ], pkt_source: None, dpd_host: "[::1]", dpd_port: 12224, vlan_link: None, vlan_data: None, techport0_prefix: None, techport1_prefix: None, rack_id: Some( 0ecd59bd-b90e-417c-bc9f-678313fe2f4a, ), sled_id: Some( 1c00ae49-b1fb-4152-9fe1-51042445935b, ), sled_model: Some( "i86pc", ), sled_revision: Some( 0, ), sled_serial: Some( "buskin", ), }
142025-12-18T18:29:10.353ZINFOtfportd: no non-localhost IPv6 listen address available, waiting for SMF update unit = oximeter
152025-12-18T18:29:10.357ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::f47f:b4ff:fe09:b5ff->f6:7f:b4:09:b5:ff interface = tfportrear0_0
162025-12-18T18:29:10.359ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
172025-12-18T18:29:10.364ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f47f:b4ff:fe09:b5ff]
182025-12-18T18:29:10.369ZWARNtfportd: tfportqsfp0_0 has no addrs
19 [ Dec 18 18:29:10 Rereading configuration. ]
20 [ Dec 18 18:29:10 Executing refresh method (:kill). ]
21 [ Dec 18 18:29:10 Stopping because all processes in service exited. ]
22 [ Dec 18 18:29:10 Executing stop method (:kill). ]
23 [ Dec 18 18:29:10 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dendrite/bin/tfportd --sync-only &"). ]
24 [ Dec 18 18:29:10 Method "start" exited with status 0. ]
252025-12-18T18:29:10.880ZINFOtfportd: connecting to dpd host = [::1] port = 12224
262025-12-18T18:29:10.920ZINFOtfportd: connected to dpd running softnpu-606c0be8
272025-12-18T18:29:10.920ZINFOtfportd: running in sync-only mode
282025-12-18T18:29:10.920ZINFOtfportd: found suitable IPv6 address for oximeter producer server address = fd00:1122:3344:101::2 unit = oximeter
292025-12-18T18:29:10.922ZINFOtfportd: refreshing SMF config prior to waiting on signals unit = signal_handler
302025-12-18T18:29:10.922ZDEBGtfportd: extracted oximeter configuration data config = OximeterConfig { listen_address: fd00:1122:3344:101::2, sled_identifiers: SledIdentifiers { rack_id: 0ecd59bd-b90e-417c-bc9f-678313fe2f4a, sled_id: 1c00ae49-b1fb-4152-9fe1-51042445935b, model: "i86pc", revision: 0, serial: "buskin" }, switch_identifiers: SwitchIdentifiers { asic_backend: "softnpu", fab: None, lot: None, model: "FAKE_SIM_SIDECAR", revision: 0, serial: "SimSidecar0", sidecar_id: 4823714e-871c-4dc1-8c30-c3d70f0b34fa, slot: 0, wafer: None, wafer_loc: None } } unit = oximeter
312025-12-18T18:29:10.923ZDEBGtfportd: created producer ID producer_id = 5aee86ba-8fe9-4def-af4e-f55038b088eb unit = oximeter
322025-12-18T18:29:10.924ZINFOtfportd: refreshed config: Config { log_file: None, log_format: Json, listen_addresses: [ [fd00:1122:3344:101::2]:12231, [::1]:12231, ], pkt_source: None, dpd_host: "[::1]", dpd_port: 12224, vlan_link: None, vlan_data: None, techport0_prefix: None, techport1_prefix: None, rack_id: Some( 0ecd59bd-b90e-417c-bc9f-678313fe2f4a, ), sled_id: Some( 1c00ae49-b1fb-4152-9fe1-51042445935b, ), sled_model: Some( "i86pc", ), sled_revision: Some( 0, ), sled_serial: Some( "buskin", ), }
332025-12-18T18:29:10.932ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
342025-12-18T18:29:10.934ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::e0e1:4fff:fe0a:a462->e2:e1:4f:0a:a4:62 interface = tfportrear0_0
352025-12-18T18:29:10.934ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::f47f:b4ff:fe09:b5ff->f6:7f:b4:09:b5:ff interface = tfportrear0_0
362025-12-18T18:29:10.935ZDEBGtfportd: registered DTrace probes unit = producer-server
372025-12-18T18:29:10.935ZDEBGtfportd (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::2]:45590 method = GET path = /{producer_id} unit = producer-server versions = all
382025-12-18T18:29:10.936ZINFOtfportd (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.4/src/server.rs:328 local_addr = [fd00:1122:3344:101::2]:45590 unit = producer-server
392025-12-18T18:29:10.936ZDEBGtfportd (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::2]:45590 unit = producer-server
402025-12-18T18:29:10.936ZDEBGtfportd: Requested any available port, Dropshot server has been bound to [fd00:1122:3344:101::2]:45590 unit = producer-server
412025-12-18T18:29:10.936ZDEBGtfportd: Nexus IP not provided, will use DNS to resolve it unit = producer-server
422025-12-18T18:29:10.936ZINFOtfportd (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/e76962a/internal-dns/resolver/src/resolver.rs:144 unit = producer-server
432025-12-18T18:29:10.937ZDEBGtfportd: starting producer registration task unit = producer-server
442025-12-18T18:29:10.937ZINFOtfportd: starting oximeter metric producer server address = [fd00:1122:3344:101::2]:45590 file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/e76962a/oximeter/producer/src/lib.rs:279 interval = 30s producer_id = 5aee86ba-8fe9-4def-af4e-f55038b088eb unit = producer-server
452025-12-18T18:29:10.937ZINFOtfportd: created oximeter producer server unit = oximeter
462025-12-18T18:29:10.937ZDEBGtfportd (producer-registration-task): registering as oximeter producer with Nexus registration_count = 0 unit = producer-server
472025-12-18T18:29:10.938ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f47f:b4ff:fe09:b5ff]
482025-12-18T18:29:10.939ZDEBGtfportd (kstat-sampler): adding new target unit = oximeter
492025-12-18T18:29:10.939ZDEBGtfportd (kstat-sampler-worker): storing new creation time for tracked target creation_time = 2025-12-18T18:28:54.312411885Z path = KstatPath { module: "link", instance: 0, name: "tfportrear0_0" } unit = oximeter
502025-12-18T18:29:10.939ZDEBGtfportd (kstat-sampler-worker): inserted empty per-target sample queue id = 11314526305943420077 unit = oximeter
512025-12-18T18:29:10.939ZDEBGtfportd: added new link to kstat sampler link_kind = switch-port-control link_name = tfportrear0_0 unit = metrics-task-tracker
522025-12-18T18:29:10.941ZWARNtfportd: tfportqsfp0_0 has no addrs
532025-12-18T18:29:11.512ZINFOtfportd: added new ARP entry entry = 10.151.1.174->9a:95:2a:3d:9b:9e interface = tfportqsfp0_0
542025-12-18T18:29:12.029ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
552025-12-18T18:29:12.034ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f47f:b4ff:fe09:b5ff]
562025-12-18T18:29:12.037ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
572025-12-18T18:29:12.038ZDEBGtfportd (kstat-sampler): adding new target unit = oximeter
582025-12-18T18:29:12.039ZDEBGtfportd (kstat-sampler-worker): storing new creation time for tracked target creation_time = 2025-12-18T18:28:54.312278904Z path = KstatPath { module: "link", instance: 0, name: "tfportqsfp0_0" } unit = oximeter
592025-12-18T18:29:12.039ZDEBGtfportd (kstat-sampler-worker): inserted empty per-target sample queue id = 7620035178121244181 unit = oximeter
602025-12-18T18:29:12.039ZDEBGtfportd: added new link to kstat sampler link_kind = switch-port-control link_name = tfportqsfp0_0 unit = metrics-task-tracker
612025-12-18T18:29:12.675ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
622025-12-18T18:29:12.680ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f47f:b4ff:fe09:b5ff]
632025-12-18T18:29:12.683ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
642025-12-18T18:29:13.756ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
652025-12-18T18:29:13.761ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f47f:b4ff:fe09:b5ff]
662025-12-18T18:29:13.764ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
672025-12-18T18:29:14.528ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
682025-12-18T18:29:14.533ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f47f:b4ff:fe09:b5ff]
692025-12-18T18:29:14.535ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
702025-12-18T18:29:15.639ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
712025-12-18T18:29:15.644ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f47f:b4ff:fe09:b5ff]
722025-12-18T18:29:15.647ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
732025-12-18T18:29:15.940ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("9110312d-69d9-4c39-9061-7ff9ebe6c4b6.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("9c579180-e22b-444c-917f-494b9bb48667.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("a8cacfa7-cf12-4457-9c61-1c5c83af7cc9.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("a8cacfa7-cf12-4457-9c61-1c5c83af7cc9.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::c)) }], valid_until: Instant { tv_sec: 887, tv_nsec: 724247472 } }) unit = producer-server
742025-12-18T18:29:15.941ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
752025-12-18T18:29:15.971ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
762025-12-18T18:29:16.706ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
772025-12-18T18:29:16.711ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f47f:b4ff:fe09:b5ff]
782025-12-18T18:29:16.715ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
792025-12-18T18:29:18.186ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
802025-12-18T18:29:18.190ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f47f:b4ff:fe09:b5ff]
812025-12-18T18:29:18.193ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
822025-12-18T18:29:19.315ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
832025-12-18T18:29:19.321ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f47f:b4ff:fe09:b5ff]
842025-12-18T18:29:19.323ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
852025-12-18T18:29:20.219ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
862025-12-18T18:29:20.224ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f47f:b4ff:fe09:b5ff]
872025-12-18T18:29:20.227ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
882025-12-18T18:29:20.943ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 11314526305943420077 n_samples = 6 unit = oximeter
892025-12-18T18:29:21.376ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
902025-12-18T18:29:21.381ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f47f:b4ff:fe09:b5ff]
912025-12-18T18:29:21.384ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
922025-12-18T18:29:21.944ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
932025-12-18T18:29:21.948ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f47f:b4ff:fe09:b5ff]
942025-12-18T18:29:21.950ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
952025-12-18T18:29:22.042ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 7620035178121244181 n_samples = 6 unit = oximeter
962025-12-18T18:29:23.297ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
972025-12-18T18:29:23.302ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f47f:b4ff:fe09:b5ff]
982025-12-18T18:29:23.305ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
992025-12-18T18:29:24.440ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1002025-12-18T18:29:24.445ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f47f:b4ff:fe09:b5ff]
1012025-12-18T18:29:24.447ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1022025-12-18T18:29:25.374ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1032025-12-18T18:29:25.380ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f47f:b4ff:fe09:b5ff]
1042025-12-18T18:29:25.383ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1052025-12-18T18:29:26.853ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1062025-12-18T18:29:26.858ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f47f:b4ff:fe09:b5ff]
1072025-12-18T18:29:26.861ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1082025-12-18T18:29:27.577ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1092025-12-18T18:29:27.582ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f47f:b4ff:fe09:b5ff]
1102025-12-18T18:29:27.584ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1112025-12-18T18:29:28.943ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1122025-12-18T18:29:28.948ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f47f:b4ff:fe09:b5ff]
1132025-12-18T18:29:28.951ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1142025-12-18T18:29:30.391ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1152025-12-18T18:29:30.395ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f47f:b4ff:fe09:b5ff]
1162025-12-18T18:29:30.398ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1172025-12-18T18:29:30.945ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 11314526305943420077 n_samples = 6 unit = oximeter
1182025-12-18T18:29:30.973ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
1192025-12-18T18:29:30.974ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 0 delay = 20.037107164s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/e76962a/oximeter/producer/src/lib.rs:371 unit = producer-server
1202025-12-18T18:29:31.247ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("9110312d-69d9-4c39-9061-7ff9ebe6c4b6.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("9c579180-e22b-444c-917f-494b9bb48667.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("a8cacfa7-cf12-4457-9c61-1c5c83af7cc9.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("a8cacfa7-cf12-4457-9c61-1c5c83af7cc9.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::c)) }], valid_until: Instant { tv_sec: 903, tv_nsec: 31121916 } }) unit = producer-server
1212025-12-18T18:29:31.247ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
1222025-12-18T18:29:31.278ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
1232025-12-18T18:29:31.684ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1242025-12-18T18:29:31.689ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f47f:b4ff:fe09:b5ff]
1252025-12-18T18:29:31.691ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1262025-12-18T18:29:32.045ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 7620035178121244181 n_samples = 6 unit = oximeter
1272025-12-18T18:29:33.081ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1282025-12-18T18:29:33.086ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f47f:b4ff:fe09:b5ff]
1292025-12-18T18:29:33.089ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1302025-12-18T18:29:34.279ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1312025-12-18T18:29:34.285ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f47f:b4ff:fe09:b5ff]
1322025-12-18T18:29:34.288ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1332025-12-18T18:29:35.116ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1342025-12-18T18:29:35.121ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f47f:b4ff:fe09:b5ff]
1352025-12-18T18:29:35.124ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1362025-12-18T18:29:36.178ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1372025-12-18T18:29:36.196ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f47f:b4ff:fe09:b5ff]
1382025-12-18T18:29:36.201ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1392025-12-18T18:29:37.229ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1402025-12-18T18:29:37.237ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f47f:b4ff:fe09:b5ff]
1412025-12-18T18:29:37.240ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1422025-12-18T18:29:38.248ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1432025-12-18T18:29:38.253ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f47f:b4ff:fe09:b5ff]
1442025-12-18T18:29:38.256ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1452025-12-18T18:29:39.089ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1462025-12-18T18:29:39.102ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f47f:b4ff:fe09:b5ff]
1472025-12-18T18:29:39.111ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1482025-12-18T18:29:40.554ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1492025-12-18T18:29:40.559ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f47f:b4ff:fe09:b5ff]
1502025-12-18T18:29:40.562ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1512025-12-18T18:29:40.967ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 11314526305943420077 n_samples = 6 unit = oximeter
1522025-12-18T18:29:41.594ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1532025-12-18T18:29:41.600ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f47f:b4ff:fe09:b5ff]
1542025-12-18T18:29:41.603ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1552025-12-18T18:29:42.066ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 7620035178121244181 n_samples = 6 unit = oximeter
1562025-12-18T18:29:42.392ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1572025-12-18T18:29:42.397ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f47f:b4ff:fe09:b5ff]
1582025-12-18T18:29:42.400ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1592025-12-18T18:29:43.525ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1602025-12-18T18:29:43.534ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f47f:b4ff:fe09:b5ff]
1612025-12-18T18:29:43.568ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1622025-12-18T18:29:44.690ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1632025-12-18T18:29:44.696ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f47f:b4ff:fe09:b5ff]
1642025-12-18T18:29:44.699ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1652025-12-18T18:29:45.920ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1662025-12-18T18:29:45.926ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f47f:b4ff:fe09:b5ff]
1672025-12-18T18:29:45.929ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1682025-12-18T18:29:46.294ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
1692025-12-18T18:29:46.295ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 1 delay = 35.342518528s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/e76962a/oximeter/producer/src/lib.rs:371 unit = producer-server
1702025-12-18T18:29:46.720ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1712025-12-18T18:29:46.725ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f47f:b4ff:fe09:b5ff]
1722025-12-18T18:29:46.728ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1732025-12-18T18:29:46.980ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("9110312d-69d9-4c39-9061-7ff9ebe6c4b6.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("9c579180-e22b-444c-917f-494b9bb48667.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("a8cacfa7-cf12-4457-9c61-1c5c83af7cc9.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("a8cacfa7-cf12-4457-9c61-1c5c83af7cc9.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::c)) }], valid_until: Instant { tv_sec: 918, tv_nsec: 748224356 } }) unit = producer-server
1742025-12-18T18:29:46.980ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
1752025-12-18T18:29:47.017ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
1762025-12-18T18:29:50.589ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1772025-12-18T18:29:50.597ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f47f:b4ff:fe09:b5ff]
1782025-12-18T18:29:50.602ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1792025-12-18T18:29:50.974ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 11314526305943420077 n_samples = 6 unit = oximeter
1802025-12-18T18:29:51.154ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1812025-12-18T18:29:51.175ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f47f:b4ff:fe09:b5ff]
1822025-12-18T18:29:51.252ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1832025-12-18T18:29:52.071ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 7620035178121244181 n_samples = 6 unit = oximeter
1842025-12-18T18:29:52.710ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1852025-12-18T18:29:52.717ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f47f:b4ff:fe09:b5ff]
1862025-12-18T18:29:52.721ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1872025-12-18T18:29:53.828ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1882025-12-18T18:29:53.834ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f47f:b4ff:fe09:b5ff]
1892025-12-18T18:29:53.836ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1902025-12-18T18:29:54.440ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1912025-12-18T18:29:54.443ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f47f:b4ff:fe09:b5ff]
1922025-12-18T18:29:54.446ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1932025-12-18T18:29:55.504ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1942025-12-18T18:29:55.510ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f47f:b4ff:fe09:b5ff]
1952025-12-18T18:29:55.513ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1962025-12-18T18:29:56.892ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1972025-12-18T18:29:56.898ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f47f:b4ff:fe09:b5ff]
1982025-12-18T18:29:56.901ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1992025-12-18T18:29:58.131ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2002025-12-18T18:29:58.136ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f47f:b4ff:fe09:b5ff]
2012025-12-18T18:29:58.139ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2022025-12-18T18:29:59.715ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2032025-12-18T18:29:59.721ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f47f:b4ff:fe09:b5ff]
2042025-12-18T18:29:59.725ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]