Max level shown:
1 [ Feb 3 20:42:22 Enabled. ]
2 [ Feb 3 20:42:22 Rereading configuration. ]
3 [ Feb 3 20:42:23 Rereading configuration. ]
4 [ Feb 3 20:42:34 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dendrite/bin/tfportd --sync-only &"). ]
5 [ Feb 3 20:42:34 Method "start" exited with status 0. ]
6 No non-localhost IPv6 addresses found in SMF properties
72026-02-03T20:42:34.938ZINFOtfportd: connecting to dpd host = [::1] port = 12224
82026-02-03T20:42:34.992ZINFOtfportd: connected to dpd running softnpu-9f6b8f71
92026-02-03T20:42:34.992ZINFOtfportd: running in sync-only mode
102026-02-03T20:42:34.992ZINFOtfportd: no non-localhost IPv6 listen address available, waiting for SMF update unit = oximeter
112026-02-03T20:42:34.994ZINFOtfportd: refreshing SMF config prior to waiting on signals unit = signal_handler
12 No non-localhost IPv6 addresses found in SMF properties
132026-02-03T20:42:34.996ZINFOtfportd: refreshed config: Config { log_file: None, log_format: Json, listen_addresses: [ [::1]:12231, ], pkt_source: None, dpd_host: "[::1]", dpd_port: 12224, vlan_link: None, vlan_data: None, techport0_prefix: None, techport1_prefix: None, rack_id: Some( 77cd2200-b5e0-4a97-a3fe-dbfb0c9a06e4, ), sled_id: Some( ff5ac0bc-4c27-47fa-8b72-f5ca0ba7e273, ), sled_model: Some( "i86pc", ), sled_revision: Some( 0, ), sled_serial: Some( "sock", ), }
142026-02-03T20:42:34.996ZINFOtfportd: no non-localhost IPv6 listen address available, waiting for SMF update unit = oximeter
152026-02-03T20:42:35.001ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::141a:feff:fe69:8355->16:1a:fe:69:83:55 interface = tfportrear0_0
162026-02-03T20:42:35.003ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
172026-02-03T20:42:35.009ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
182026-02-03T20:42:35.015ZWARNtfportd: tfportqsfp0_0 has no addrs
19 [ Feb 3 20:42:35 Rereading configuration. ]
20 [ Feb 3 20:42:35 Executing refresh method (:kill). ]
21 [ Feb 3 20:42:35 Stopping because all processes in service exited. ]
22 [ Feb 3 20:42:35 Executing stop method (:kill). ]
23 [ Feb 3 20:42:35 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dendrite/bin/tfportd --sync-only &"). ]
24 [ Feb 3 20:42:35 Method "start" exited with status 0. ]
252026-02-03T20:42:35.586ZINFOtfportd: connecting to dpd host = [::1] port = 12224
262026-02-03T20:42:35.644ZINFOtfportd: connected to dpd running softnpu-9f6b8f71
272026-02-03T20:42:35.645ZINFOtfportd: running in sync-only mode
282026-02-03T20:42:35.645ZINFOtfportd: found suitable IPv6 address for oximeter producer server address = fd00:1122:3344:101::2 unit = oximeter
292026-02-03T20:42:35.646ZINFOtfportd: refreshing SMF config prior to waiting on signals unit = signal_handler
302026-02-03T20:42:35.647ZDEBGtfportd: extracted oximeter configuration data config = OximeterConfig { listen_address: fd00:1122:3344:101::2, sled_identifiers: SledIdentifiers { rack_id: 77cd2200-b5e0-4a97-a3fe-dbfb0c9a06e4, sled_id: ff5ac0bc-4c27-47fa-8b72-f5ca0ba7e273, model: "i86pc", revision: 0, serial: "sock" }, switch_identifiers: SwitchIdentifiers { asic_backend: "softnpu", fab: None, lot: None, model: "FAKE_SIM_SIDECAR", revision: 0, serial: "SimSidecar0", sidecar_id: 2fd51764-16b3-47bd-84e8-d06d6efe2926, slot: 0, wafer: None, wafer_loc: None } } unit = oximeter
312026-02-03T20:42:35.647ZDEBGtfportd: created producer ID producer_id = a742f5d8-ef74-4ad0-ac64-fe5c69c3cdb1 unit = oximeter
322026-02-03T20:42:35.649ZINFOtfportd: refreshed config: Config { log_file: None, log_format: Json, listen_addresses: [ [fd00:1122:3344:101::2]:12231, [::1]:12231, ], pkt_source: None, dpd_host: "[::1]", dpd_port: 12224, vlan_link: None, vlan_data: None, techport0_prefix: None, techport1_prefix: None, rack_id: Some( 77cd2200-b5e0-4a97-a3fe-dbfb0c9a06e4, ), sled_id: Some( ff5ac0bc-4c27-47fa-8b72-f5ca0ba7e273, ), sled_model: Some( "i86pc", ), sled_revision: Some( 0, ), sled_serial: Some( "sock", ), }
332026-02-03T20:42:35.655ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
342026-02-03T20:42:35.657ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::141a:feff:fe69:8355->16:1a:fe:69:83:55 interface = tfportrear0_0
352026-02-03T20:42:35.659ZDEBGtfportd: registered DTrace probes unit = producer-server
362026-02-03T20:42:35.660ZDEBGtfportd (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::2]:62932 method = GET path = /{producer_id} unit = producer-server versions = all
372026-02-03T20:42:35.660ZINFOtfportd (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:328 local_addr = [fd00:1122:3344:101::2]:62932 unit = producer-server
382026-02-03T20:42:35.660ZDEBGtfportd (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::2]:62932 unit = producer-server
392026-02-03T20:42:35.660ZDEBGtfportd: Requested any available port, Dropshot server has been bound to [fd00:1122:3344:101::2]:62932 unit = producer-server
402026-02-03T20:42:35.660ZDEBGtfportd: Nexus IP not provided, will use DNS to resolve it unit = producer-server
412026-02-03T20:42:35.660ZINFOtfportd (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/internal-dns/resolver/src/resolver.rs:144 unit = producer-server
422026-02-03T20:42:35.661ZDEBGtfportd: starting producer registration task unit = producer-server
432026-02-03T20:42:35.661ZINFOtfportd: starting oximeter metric producer server address = [fd00:1122:3344:101::2]:62932 file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:279 interval = 30s producer_id = a742f5d8-ef74-4ad0-ac64-fe5c69c3cdb1 unit = producer-server
442026-02-03T20:42:35.661ZINFOtfportd: created oximeter producer server unit = oximeter
452026-02-03T20:42:35.661ZDEBGtfportd (producer-registration-task): registering as oximeter producer with Nexus registration_count = 0 unit = producer-server
462026-02-03T20:42:35.662ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
472026-02-03T20:42:35.662ZDEBGtfportd (kstat-sampler): adding new target unit = oximeter
482026-02-03T20:42:35.662ZDEBGtfportd (kstat-sampler-worker): storing new creation time for tracked target creation_time = 2026-02-03T20:42:18.684974507Z path = KstatPath { module: "link", instance: 0, name: "tfportrear0_0" } unit = oximeter
492026-02-03T20:42:35.662ZDEBGtfportd (kstat-sampler-worker): inserted empty per-target sample queue id = 4108837128318815351 unit = oximeter
502026-02-03T20:42:35.662ZDEBGtfportd: added new link to kstat sampler link_kind = switch-port-control link_name = tfportrear0_0 unit = metrics-task-tracker
512026-02-03T20:42:35.666ZWARNtfportd: tfportqsfp0_0 has no addrs
522026-02-03T20:42:36.466ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
532026-02-03T20:42:36.471ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
542026-02-03T20:42:36.474ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
552026-02-03T20:42:36.474ZDEBGtfportd (kstat-sampler): adding new target unit = oximeter
562026-02-03T20:42:36.475ZDEBGtfportd (kstat-sampler-worker): storing new creation time for tracked target creation_time = 2026-02-03T20:42:18.684844853Z path = KstatPath { module: "link", instance: 0, name: "tfportqsfp0_0" } unit = oximeter
572026-02-03T20:42:36.475ZDEBGtfportd (kstat-sampler-worker): inserted empty per-target sample queue id = 12928093636995693251 unit = oximeter
582026-02-03T20:42:36.475ZDEBGtfportd: added new link to kstat sampler link_kind = switch-port-control link_name = tfportqsfp0_0 unit = metrics-task-tracker
592026-02-03T20:42:36.889ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::f0:a6ff:fe21:3722->02:f0:a6:21:37:22 interface = tfportrear0_0
602026-02-03T20:42:37.049ZINFOtfportd: added new ARP entry entry = 10.151.2.174->8e:92:5c:4f:ff:70 interface = tfportqsfp0_0
612026-02-03T20:42:37.694ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
622026-02-03T20:42:37.700ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
632026-02-03T20:42:37.703ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
642026-02-03T20:42:38.735ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
652026-02-03T20:42:38.739ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
662026-02-03T20:42:38.742ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
672026-02-03T20:42:40.121ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
682026-02-03T20:42:40.125ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
692026-02-03T20:42:40.130ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
702026-02-03T20:42:40.664ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("2c2526eb-3138-4d5e-a54f-594b31a68d71.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("9600e37d-6ff3-41a7-b803-a93f80d7c137.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("983ae1af-6bef-4a3d-b6bb-20b318f718ce.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("983ae1af-6bef-4a3d-b6bb-20b318f718ce.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 669, tv_nsec: 498170342 } }) unit = producer-server
712026-02-03T20:42:40.664ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
722026-02-03T20:42:40.698ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
732026-02-03T20:42:40.710ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
742026-02-03T20:42:40.715ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
752026-02-03T20:42:40.718ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
762026-02-03T20:42:41.400ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
772026-02-03T20:42:41.404ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
782026-02-03T20:42:41.408ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
792026-02-03T20:42:42.128ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
802026-02-03T20:42:42.133ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
812026-02-03T20:42:42.135ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
822026-02-03T20:42:43.187ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
832026-02-03T20:42:43.192ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
842026-02-03T20:42:43.195ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
852026-02-03T20:42:44.569ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
862026-02-03T20:42:44.573ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
872026-02-03T20:42:44.576ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
882026-02-03T20:42:45.242ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
892026-02-03T20:42:45.247ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
902026-02-03T20:42:45.249ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
912026-02-03T20:42:45.668ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 4108837128318815351 n_samples = 6 unit = oximeter
922026-02-03T20:42:45.970ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
932026-02-03T20:42:45.975ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
942026-02-03T20:42:45.977ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
952026-02-03T20:42:46.477ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 12928093636995693251 n_samples = 6 unit = oximeter
962026-02-03T20:42:46.975ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
972026-02-03T20:42:46.980ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
982026-02-03T20:42:46.983ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
992026-02-03T20:42:47.680ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1002026-02-03T20:42:47.684ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
1012026-02-03T20:42:47.687ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1022026-02-03T20:42:48.290ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1032026-02-03T20:42:48.295ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
1042026-02-03T20:42:48.298ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1052026-02-03T20:42:48.942ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1062026-02-03T20:42:48.946ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
1072026-02-03T20:42:48.949ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1082026-02-03T20:42:49.894ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1092026-02-03T20:42:49.899ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
1102026-02-03T20:42:49.902ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1112026-02-03T20:42:50.830ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1122026-02-03T20:42:50.834ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
1132026-02-03T20:42:50.836ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1142026-02-03T20:42:52.220ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1152026-02-03T20:42:52.225ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
1162026-02-03T20:42:52.228ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1172026-02-03T20:42:53.697ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1182026-02-03T20:42:53.702ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
1192026-02-03T20:42:53.705ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1202026-02-03T20:42:54.455ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1212026-02-03T20:42:54.463ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
1222026-02-03T20:42:54.467ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1232026-02-03T20:42:55.677ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 4108837128318815351 n_samples = 6 unit = oximeter
1242026-02-03T20:42:55.707ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
1252026-02-03T20:42:55.709ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 0 delay = 20.041011859s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
1262026-02-03T20:42:55.725ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1272026-02-03T20:42:55.729ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
1282026-02-03T20:42:55.732ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1292026-02-03T20:42:55.880ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("2c2526eb-3138-4d5e-a54f-594b31a68d71.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("9600e37d-6ff3-41a7-b803-a93f80d7c137.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("983ae1af-6bef-4a3d-b6bb-20b318f718ce.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("983ae1af-6bef-4a3d-b6bb-20b318f718ce.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 684, tv_nsec: 707882594 } }) unit = producer-server
1302026-02-03T20:42:55.881ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
1312026-02-03T20:42:55.914ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
1322026-02-03T20:42:56.487ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 12928093636995693251 n_samples = 6 unit = oximeter
1332026-02-03T20:42:56.674ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1342026-02-03T20:42:56.681ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
1352026-02-03T20:42:56.685ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1362026-02-03T20:42:57.285ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1372026-02-03T20:42:57.290ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
1382026-02-03T20:42:57.293ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1392026-02-03T20:42:58.302ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1402026-02-03T20:42:58.306ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
1412026-02-03T20:42:58.309ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1422026-02-03T20:42:59.513ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1432026-02-03T20:42:59.518ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
1442026-02-03T20:42:59.521ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1452026-02-03T20:43:01.026ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1462026-02-03T20:43:01.031ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
1472026-02-03T20:43:01.034ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1482026-02-03T20:43:01.831ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1492026-02-03T20:43:01.835ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
1502026-02-03T20:43:01.838ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1512026-02-03T20:43:02.924ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1522026-02-03T20:43:02.928ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
1532026-02-03T20:43:02.931ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1542026-02-03T20:43:03.442ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1552026-02-03T20:43:03.447ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
1562026-02-03T20:43:03.450ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1572026-02-03T20:43:04.166ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1582026-02-03T20:43:04.170ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
1592026-02-03T20:43:04.173ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1602026-02-03T20:43:04.780ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1612026-02-03T20:43:04.785ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
1622026-02-03T20:43:04.788ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1632026-02-03T20:43:05.627ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1642026-02-03T20:43:05.632ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
1652026-02-03T20:43:05.634ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1662026-02-03T20:43:05.677ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 4108837128318815351 n_samples = 6 unit = oximeter
1672026-02-03T20:43:06.489ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 12928093636995693251 n_samples = 6 unit = oximeter
1682026-02-03T20:43:07.030ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1692026-02-03T20:43:07.035ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
1702026-02-03T20:43:07.038ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1712026-02-03T20:43:07.640ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1722026-02-03T20:43:07.644ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
1732026-02-03T20:43:07.648ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1742026-02-03T20:43:08.272ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1752026-02-03T20:43:08.277ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
1762026-02-03T20:43:08.280ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1772026-02-03T20:43:09.297ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1782026-02-03T20:43:09.303ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
1792026-02-03T20:43:09.305ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1802026-02-03T20:43:10.108ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1812026-02-03T20:43:10.114ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
1822026-02-03T20:43:10.117ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1832026-02-03T20:43:10.914ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
1842026-02-03T20:43:10.916ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 1 delay = 35.248881615s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
1852026-02-03T20:43:11.253ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1862026-02-03T20:43:11.258ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
1872026-02-03T20:43:11.261ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1882026-02-03T20:43:11.301ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("2c2526eb-3138-4d5e-a54f-594b31a68d71.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("9600e37d-6ff3-41a7-b803-a93f80d7c137.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("983ae1af-6bef-4a3d-b6bb-20b318f718ce.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("983ae1af-6bef-4a3d-b6bb-20b318f718ce.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 700, tv_nsec: 129250581 } }) unit = producer-server
1892026-02-03T20:43:11.301ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
1902026-02-03T20:43:11.338ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
1912026-02-03T20:43:12.286ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1922026-02-03T20:43:12.292ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
1932026-02-03T20:43:12.295ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1942026-02-03T20:43:21.505ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1952026-02-03T20:43:21.512ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
1962026-02-03T20:43:21.566ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 4108837128318815351 n_samples = 6 unit = oximeter
1972026-02-03T20:43:21.567ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 12928093636995693251 n_samples = 6 unit = oximeter
1982026-02-03T20:43:21.586ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1992026-02-03T20:43:22.605ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2002026-02-03T20:43:22.609ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
2012026-02-03T20:43:22.614ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2022026-02-03T20:43:23.413ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2032026-02-03T20:43:23.420ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
2042026-02-03T20:43:23.424ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2052026-02-03T20:43:23.960ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2062026-02-03T20:43:23.968ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
2072026-02-03T20:43:23.980ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2082026-02-03T20:43:24.885ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2092026-02-03T20:43:24.892ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
2102026-02-03T20:43:24.896ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2112026-02-03T20:43:26.104ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2122026-02-03T20:43:26.111ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
2132026-02-03T20:43:26.116ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2142026-02-03T20:43:26.709ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
2152026-02-03T20:43:26.782ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 2 delay = 51.114748748s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
2162026-02-03T20:43:26.798ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2172026-02-03T20:43:26.812ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
2182026-02-03T20:43:26.820ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2192026-02-03T20:43:27.390ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("2c2526eb-3138-4d5e-a54f-594b31a68d71.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("9600e37d-6ff3-41a7-b803-a93f80d7c137.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("983ae1af-6bef-4a3d-b6bb-20b318f718ce.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("983ae1af-6bef-4a3d-b6bb-20b318f718ce.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 716, tv_nsec: 214879689 } }) unit = producer-server
2202026-02-03T20:43:27.392ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
2212026-02-03T20:43:27.480ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
2222026-02-03T20:43:27.494ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2232026-02-03T20:43:27.503ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
2242026-02-03T20:43:27.508ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2252026-02-03T20:43:28.796ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2262026-02-03T20:43:28.800ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
2272026-02-03T20:43:28.803ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2282026-02-03T20:43:29.628ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2292026-02-03T20:43:29.632ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
2302026-02-03T20:43:29.635ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2312026-02-03T20:43:30.220ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2322026-02-03T20:43:30.224ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
2332026-02-03T20:43:30.226ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2342026-02-03T20:43:30.862ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2352026-02-03T20:43:30.867ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
2362026-02-03T20:43:30.870ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2372026-02-03T20:43:31.538ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2382026-02-03T20:43:31.542ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
2392026-02-03T20:43:31.546ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2402026-02-03T20:43:31.569ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 4108837128318815351 n_samples = 6 unit = oximeter
2412026-02-03T20:43:31.569ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 12928093636995693251 n_samples = 6 unit = oximeter
2422026-02-03T20:43:33.039ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2432026-02-03T20:43:33.044ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
2442026-02-03T20:43:33.047ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2452026-02-03T20:43:34.035ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2462026-02-03T20:43:34.040ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
2472026-02-03T20:43:34.043ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2482026-02-03T20:43:34.740ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2492026-02-03T20:43:34.745ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
2502026-02-03T20:43:34.748ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2512026-02-03T20:43:35.717ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2522026-02-03T20:43:35.722ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
2532026-02-03T20:43:35.725ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2542026-02-03T20:43:36.832ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2552026-02-03T20:43:36.836ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
2562026-02-03T20:43:36.840ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2572026-02-03T20:43:38.327ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2582026-02-03T20:43:38.332ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
2592026-02-03T20:43:38.334ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2602026-02-03T20:43:39.099ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2612026-02-03T20:43:39.105ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
2622026-02-03T20:43:39.108ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2632026-02-03T20:43:40.197ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2642026-02-03T20:43:40.202ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
2652026-02-03T20:43:40.205ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2662026-02-03T20:43:41.279ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2672026-02-03T20:43:41.286ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
2682026-02-03T20:43:41.290ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2692026-02-03T20:43:41.570ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 4108837128318815351 n_samples = 6 unit = oximeter
2702026-02-03T20:43:41.571ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 12928093636995693251 n_samples = 6 unit = oximeter
2712026-02-03T20:43:42.115ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2722026-02-03T20:43:42.121ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
2732026-02-03T20:43:42.124ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2742026-02-03T20:43:42.482ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
2752026-02-03T20:43:42.483ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 3 delay = 66.816182954s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
2762026-02-03T20:43:43.489ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2772026-02-03T20:43:43.495ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
2782026-02-03T20:43:43.498ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2792026-02-03T20:43:44.307ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2802026-02-03T20:43:44.313ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
2812026-02-03T20:43:44.317ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2822026-02-03T20:43:45.131ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("2c2526eb-3138-4d5e-a54f-594b31a68d71.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("9600e37d-6ff3-41a7-b803-a93f80d7c137.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("983ae1af-6bef-4a3d-b6bb-20b318f718ce.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("983ae1af-6bef-4a3d-b6bb-20b318f718ce.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 733, tv_nsec: 960072937 } }) unit = producer-server
2832026-02-03T20:43:45.132ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
2842026-02-03T20:43:45.164ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
2852026-02-03T20:43:45.776ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2862026-02-03T20:43:45.781ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
2872026-02-03T20:43:45.785ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2882026-02-03T20:43:46.693ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2892026-02-03T20:43:46.702ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
2902026-02-03T20:43:46.707ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2912026-02-03T20:43:47.341ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2922026-02-03T20:43:47.348ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
2932026-02-03T20:43:47.354ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2942026-02-03T20:43:48.209ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2952026-02-03T20:43:48.224ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
2962026-02-03T20:43:48.236ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2972026-02-03T20:43:48.931ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2982026-02-03T20:43:48.938ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
2992026-02-03T20:43:48.943ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3002026-02-03T20:43:49.652ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3012026-02-03T20:43:49.657ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
3022026-02-03T20:43:49.660ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3032026-02-03T20:43:51.096ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3042026-02-03T20:43:51.103ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
3052026-02-03T20:43:51.112ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3062026-02-03T20:43:51.575ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 4108837128318815351 n_samples = 6 unit = oximeter
3072026-02-03T20:43:51.577ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 12928093636995693251 n_samples = 6 unit = oximeter
3082026-02-03T20:43:52.021ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3092026-02-03T20:43:52.096ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
3102026-02-03T20:43:52.410ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3112026-02-03T20:43:53.269ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3122026-02-03T20:43:53.276ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
3132026-02-03T20:43:53.280ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3142026-02-03T20:43:54.117ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3152026-02-03T20:43:54.126ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
3162026-02-03T20:43:54.129ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3172026-02-03T20:43:55.197ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3182026-02-03T20:43:55.205ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
3192026-02-03T20:43:55.209ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3202026-02-03T20:43:56.411ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3212026-02-03T20:43:56.415ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
3222026-02-03T20:43:56.418ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3232026-02-03T20:43:57.627ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3242026-02-03T20:43:57.635ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
3252026-02-03T20:43:57.660ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3262026-02-03T20:43:58.911ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3272026-02-03T20:43:58.916ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
3282026-02-03T20:43:58.919ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3292026-02-03T20:44:00.164ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
3302026-02-03T20:44:00.165ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 4 delay = 84.499042222s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
3312026-02-03T20:44:00.186ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3322026-02-03T20:44:00.191ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
3332026-02-03T20:44:00.194ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3342026-02-03T20:44:01.253ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3352026-02-03T20:44:01.258ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
3362026-02-03T20:44:01.261ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3372026-02-03T20:44:01.578ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 4108837128318815351 n_samples = 6 unit = oximeter
3382026-02-03T20:44:01.579ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 12928093636995693251 n_samples = 6 unit = oximeter
3392026-02-03T20:44:02.396ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3402026-02-03T20:44:02.403ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
3412026-02-03T20:44:02.407ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3422026-02-03T20:44:03.189ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3432026-02-03T20:44:03.195ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
3442026-02-03T20:44:03.200ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3452026-02-03T20:44:03.752ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3462026-02-03T20:44:03.758ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
3472026-02-03T20:44:03.760ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3482026-02-03T20:44:03.850ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("2c2526eb-3138-4d5e-a54f-594b31a68d71.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("9600e37d-6ff3-41a7-b803-a93f80d7c137.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("983ae1af-6bef-4a3d-b6bb-20b318f718ce.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("983ae1af-6bef-4a3d-b6bb-20b318f718ce.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 752, tv_nsec: 678786643 } }) unit = producer-server
3492026-02-03T20:44:03.875ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
3502026-02-03T20:44:03.907ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
3512026-02-03T20:44:04.376ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3522026-02-03T20:44:04.382ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
3532026-02-03T20:44:04.385ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3542026-02-03T20:44:05.016ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3552026-02-03T20:44:05.024ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
3562026-02-03T20:44:05.027ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3572026-02-03T20:44:05.748ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3582026-02-03T20:44:05.755ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
3592026-02-03T20:44:05.758ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3602026-02-03T20:44:06.659ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3612026-02-03T20:44:06.665ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
3622026-02-03T20:44:06.668ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3632026-02-03T20:44:07.659ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3642026-02-03T20:44:07.666ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
3652026-02-03T20:44:07.669ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3662026-02-03T20:44:08.876ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3672026-02-03T20:44:08.882ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
3682026-02-03T20:44:08.885ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3692026-02-03T20:44:09.512ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3702026-02-03T20:44:09.520ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
3712026-02-03T20:44:09.524ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3722026-02-03T20:44:10.728ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3732026-02-03T20:44:10.739ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
3742026-02-03T20:44:10.743ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3752026-02-03T20:44:11.453ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3762026-02-03T20:44:11.461ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
3772026-02-03T20:44:11.465ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3782026-02-03T20:44:11.582ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 4108837128318815351 n_samples = 6 unit = oximeter
3792026-02-03T20:44:11.584ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 12928093636995693251 n_samples = 6 unit = oximeter
3802026-02-03T20:44:12.817ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3812026-02-03T20:44:12.822ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
3822026-02-03T20:44:12.824ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3832026-02-03T20:44:14.198ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3842026-02-03T20:44:14.204ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
3852026-02-03T20:44:14.207ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3862026-02-03T20:44:15.581ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3872026-02-03T20:44:15.586ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
3882026-02-03T20:44:15.589ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3892026-02-03T20:44:16.206ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3902026-02-03T20:44:16.210ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
3912026-02-03T20:44:16.213ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3922026-02-03T20:44:17.683ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3932026-02-03T20:44:17.687ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
3942026-02-03T20:44:17.690ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3952026-02-03T20:44:18.901ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3962026-02-03T20:44:18.907ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
3972026-02-03T20:44:18.908ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
3982026-02-03T20:44:18.909ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 5 delay = 103.243246228s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
3992026-02-03T20:44:18.911ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4002026-02-03T20:44:20.362ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4012026-02-03T20:44:20.368ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
4022026-02-03T20:44:20.371ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4032026-02-03T20:44:21.585ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 4108837128318815351 n_samples = 6 unit = oximeter
4042026-02-03T20:44:21.586ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 12928093636995693251 n_samples = 6 unit = oximeter
4052026-02-03T20:44:21.661ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4062026-02-03T20:44:21.667ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
4072026-02-03T20:44:21.671ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4082026-02-03T20:44:22.483ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4092026-02-03T20:44:22.490ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
4102026-02-03T20:44:22.493ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4112026-02-03T20:44:23.296ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4122026-02-03T20:44:23.302ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
4132026-02-03T20:44:23.305ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4142026-02-03T20:44:24.244ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4152026-02-03T20:44:24.250ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
4162026-02-03T20:44:24.253ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4172026-02-03T20:44:25.717ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4182026-02-03T20:44:25.724ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
4192026-02-03T20:44:25.727ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4202026-02-03T20:44:25.779ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("2c2526eb-3138-4d5e-a54f-594b31a68d71.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("9600e37d-6ff3-41a7-b803-a93f80d7c137.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("983ae1af-6bef-4a3d-b6bb-20b318f718ce.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("983ae1af-6bef-4a3d-b6bb-20b318f718ce.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 774, tv_nsec: 608116516 } }) unit = producer-server
4212026-02-03T20:44:25.779ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
4222026-02-03T20:44:25.813ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
4232026-02-03T20:44:26.921ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4242026-02-03T20:44:26.926ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
4252026-02-03T20:44:26.929ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4262026-02-03T20:44:27.720ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4272026-02-03T20:44:27.725ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
4282026-02-03T20:44:27.728ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4292026-02-03T20:44:28.428ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4302026-02-03T20:44:28.433ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
4312026-02-03T20:44:28.436ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4322026-02-03T20:44:28.719ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [fd00:1122:3344:101::b]:12221, Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) }) unit = producer-server
4332026-02-03T20:44:28.720ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 6 delay = 113.053379013s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
4342026-02-03T20:44:28.957ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4352026-02-03T20:44:28.963ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
4362026-02-03T20:44:28.966ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4372026-02-03T20:44:29.892ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4382026-02-03T20:44:29.897ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
4392026-02-03T20:44:29.901ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4402026-02-03T20:44:30.523ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4412026-02-03T20:44:30.530ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
4422026-02-03T20:44:30.533ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4432026-02-03T20:44:31.254ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4442026-02-03T20:44:31.259ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
4452026-02-03T20:44:31.262ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4462026-02-03T20:44:31.588ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 4108837128318815351 n_samples = 6 unit = oximeter
4472026-02-03T20:44:31.588ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 12928093636995693251 n_samples = 6 unit = oximeter
4482026-02-03T20:44:32.517ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4492026-02-03T20:44:32.524ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
4502026-02-03T20:44:32.528ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4512026-02-03T20:44:33.827ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4522026-02-03T20:44:33.833ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
4532026-02-03T20:44:33.837ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4542026-02-03T20:44:34.869ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4552026-02-03T20:44:34.874ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
4562026-02-03T20:44:34.876ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4572026-02-03T20:44:36.368ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4582026-02-03T20:44:36.374ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
4592026-02-03T20:44:36.377ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4602026-02-03T20:44:37.169ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4612026-02-03T20:44:37.175ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
4622026-02-03T20:44:37.178ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4632026-02-03T20:44:38.129ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("2c2526eb-3138-4d5e-a54f-594b31a68d71.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("9600e37d-6ff3-41a7-b803-a93f80d7c137.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("983ae1af-6bef-4a3d-b6bb-20b318f718ce.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("983ae1af-6bef-4a3d-b6bb-20b318f718ce.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 786, tv_nsec: 958579261 } }) unit = producer-server
4642026-02-03T20:44:38.130ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
4652026-02-03T20:44:38.162ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
4662026-02-03T20:44:38.475ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4672026-02-03T20:44:38.481ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
4682026-02-03T20:44:38.484ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4692026-02-03T20:44:39.640ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4702026-02-03T20:44:39.645ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
4712026-02-03T20:44:39.648ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4722026-02-03T20:44:40.850ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4732026-02-03T20:44:40.857ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
4742026-02-03T20:44:40.860ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4752026-02-03T20:44:41.190ZDEBGtfportd (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "079853d0-0973-4da1-8088-58a0801b1e10", "content-length": "41", "date": "Tue, 03 Feb 2026 20:44:41 GMT"} }) unit = producer-server
4762026-02-03T20:44:41.191ZDEBGtfportd (producer-registration-task): successfully registered with Nexus, pausing until time to renew lease lease_duration = 600s unit = producer-server wait_period = 150s
4772026-02-03T20:44:41.415ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4782026-02-03T20:44:41.421ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
4792026-02-03T20:44:41.424ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4802026-02-03T20:44:41.591ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 4108837128318815351 n_samples = 6 unit = oximeter
4812026-02-03T20:44:41.591ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 12928093636995693251 n_samples = 6 unit = oximeter
4822026-02-03T20:44:42.037ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4832026-02-03T20:44:42.043ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
4842026-02-03T20:44:42.047ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4852026-02-03T20:44:43.193ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4862026-02-03T20:44:43.199ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
4872026-02-03T20:44:43.201ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4882026-02-03T20:44:43.785ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4892026-02-03T20:44:43.790ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
4902026-02-03T20:44:43.793ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4912026-02-03T20:44:44.448ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4922026-02-03T20:44:44.455ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
4932026-02-03T20:44:44.458ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4942026-02-03T20:44:45.880ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4952026-02-03T20:44:45.885ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
4962026-02-03T20:44:45.889ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4972026-02-03T20:44:47.366ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4982026-02-03T20:44:47.371ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
4992026-02-03T20:44:47.374ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5002026-02-03T20:44:48.113ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5012026-02-03T20:44:48.119ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
5022026-02-03T20:44:48.122ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5032026-02-03T20:44:48.826ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5042026-02-03T20:44:48.833ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
5052026-02-03T20:44:48.836ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5062026-02-03T20:44:49.654ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5072026-02-03T20:44:49.660ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
5082026-02-03T20:44:49.664ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5092026-02-03T20:44:50.305ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5102026-02-03T20:44:50.310ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
5112026-02-03T20:44:50.314ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5122026-02-03T20:44:50.899ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5132026-02-03T20:44:50.906ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
5142026-02-03T20:44:50.909ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5152026-02-03T20:44:51.593ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 4108837128318815351 n_samples = 6 unit = oximeter
5162026-02-03T20:44:51.593ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 12928093636995693251 n_samples = 6 unit = oximeter
5172026-02-03T20:44:51.882ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5182026-02-03T20:44:51.888ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
5192026-02-03T20:44:51.891ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5202026-02-03T20:44:52.576ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5212026-02-03T20:44:52.582ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
5222026-02-03T20:44:52.585ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5232026-02-03T20:44:53.743ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5242026-02-03T20:44:53.749ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
5252026-02-03T20:44:53.752ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5262026-02-03T20:44:55.181ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5272026-02-03T20:44:55.187ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
5282026-02-03T20:44:55.191ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5292026-02-03T20:44:56.247ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5302026-02-03T20:44:56.253ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
5312026-02-03T20:44:56.257ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5322026-02-03T20:44:57.253ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5332026-02-03T20:44:57.261ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
5342026-02-03T20:44:57.265ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5352026-02-03T20:44:58.652ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5362026-02-03T20:44:58.659ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
5372026-02-03T20:44:58.662ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5382026-02-03T20:44:59.437ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5392026-02-03T20:44:59.443ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
5402026-02-03T20:44:59.447ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5412026-02-03T20:45:00.500ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5422026-02-03T20:45:00.507ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::141a:feff:fe69:8355]
5432026-02-03T20:45:00.511ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]