Max level shown:
1 [ Nov 3 20:11:28 Enabled. ]
2 [ Nov 3 20:11:28 Rereading configuration. ]
3 [ Nov 3 20:11:28 Rereading configuration. ]
4 [ Nov 3 20:11:39 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dendrite/bin/tfportd --sync-only &"). ]
5 [ Nov 3 20:11:39 Method "start" exited with status 0. ]
6 No non-localhost IPv6 addresses found in SMF properties
72025-11-03T20:11:39.996ZINFOtfportd: connecting to dpd host = [::1] port = 12224
82025-11-03T20:11:40.038ZINFOtfportd: connected to dpd running softnpu-606c0be8
92025-11-03T20:11:40.038ZINFOtfportd: running in sync-only mode
102025-11-03T20:11:40.040ZINFOtfportd: no non-localhost IPv6 listen address available, waiting for SMF update unit = oximeter
112025-11-03T20:11:40.041ZINFOtfportd: refreshing SMF config prior to waiting on signals unit = signal_handler
12 No non-localhost IPv6 addresses found in SMF properties
132025-11-03T20:11:40.043ZINFOtfportd: refreshed config: Config { log_file: None, log_format: Json, listen_addresses: [ [::1]:12231, ], pkt_source: None, dpd_host: "[::1]", dpd_port: 12224, vlan_link: None, vlan_data: None, techport0_prefix: None, techport1_prefix: None, rack_id: Some( 2e7cb43f-6a9f-4825-9f7d-4210e99c0af8, ), sled_id: Some( 7487fd1b-d31e-4b83-95a3-904f662d4c3d, ), sled_model: Some( "i86pc", ), sled_revision: Some( 0, ), sled_serial: Some( "buskin", ), }
142025-11-03T20:11:40.043ZINFOtfportd: no non-localhost IPv6 listen address available, waiting for SMF update unit = oximeter
152025-11-03T20:11:40.047ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::cb:f4ff:fe10:f619->02:cb:f4:10:f6:19 interface = tfportrear0_0
162025-11-03T20:11:40.050ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
172025-11-03T20:11:40.055ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
182025-11-03T20:11:40.060ZWARNtfportd: tfportqsfp0_0 has no addrs
192025-11-03T20:11:40.572ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::f46a:19ff:fe4e:72c0->f6:6a:19:4e:72:c0 interface = tfportrear0_0
20 [ Nov 3 20:11:40 Rereading configuration. ]
21 [ Nov 3 20:11:40 Executing refresh method (:kill). ]
22 [ Nov 3 20:11:40 Stopping because all processes in service exited. ]
23 [ Nov 3 20:11:40 Executing stop method (:kill). ]
24 [ Nov 3 20:11:40 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dendrite/bin/tfportd --sync-only &"). ]
25 [ Nov 3 20:11:40 Method "start" exited with status 0. ]
262025-11-03T20:11:40.626ZINFOtfportd: connecting to dpd host = [::1] port = 12224
272025-11-03T20:11:40.665ZINFOtfportd: connected to dpd running softnpu-606c0be8
282025-11-03T20:11:40.666ZINFOtfportd: running in sync-only mode
292025-11-03T20:11:40.666ZINFOtfportd: found suitable IPv6 address for oximeter producer server address = fd00:1122:3344:101::2 unit = oximeter
302025-11-03T20:11:40.668ZINFOtfportd: refreshing SMF config prior to waiting on signals unit = signal_handler
312025-11-03T20:11:40.668ZDEBGtfportd: extracted oximeter configuration data config = OximeterConfig { listen_address: fd00:1122:3344:101::2, sled_identifiers: SledIdentifiers { rack_id: 2e7cb43f-6a9f-4825-9f7d-4210e99c0af8, sled_id: 7487fd1b-d31e-4b83-95a3-904f662d4c3d, model: "i86pc", revision: 0, serial: "buskin" }, switch_identifiers: SwitchIdentifiers { asic_backend: "softnpu", fab: None, lot: None, model: "FAKE_SIM_SIDECAR", revision: 0, serial: "SimSidecar0", sidecar_id: c9204187-6fcc-4345-b2bc-86d672f7823f, slot: 0, wafer: None, wafer_loc: None } } unit = oximeter
322025-11-03T20:11:40.668ZDEBGtfportd: created producer ID producer_id = 93db08a3-d64d-40e3-b862-5489fd46c4fa unit = oximeter
332025-11-03T20:11:40.669ZINFOtfportd: refreshed config: Config { log_file: None, log_format: Json, listen_addresses: [ [fd00:1122:3344:101::2]:12231, [::1]:12231, ], pkt_source: None, dpd_host: "[::1]", dpd_port: 12224, vlan_link: None, vlan_data: None, techport0_prefix: None, techport1_prefix: None, rack_id: Some( 2e7cb43f-6a9f-4825-9f7d-4210e99c0af8, ), sled_id: Some( 7487fd1b-d31e-4b83-95a3-904f662d4c3d, ), sled_model: Some( "i86pc", ), sled_revision: Some( 0, ), sled_serial: Some( "buskin", ), }
342025-11-03T20:11:40.678ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
352025-11-03T20:11:40.679ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::cb:f4ff:fe10:f619->02:cb:f4:10:f6:19 interface = tfportrear0_0
362025-11-03T20:11:40.679ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::f46a:19ff:fe4e:72c0->f6:6a:19:4e:72:c0 interface = tfportrear0_0
372025-11-03T20:11:40.680ZDEBGtfportd: registered DTrace probes unit = producer-server
382025-11-03T20:11:40.681ZDEBGtfportd (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::2]:36417 method = GET path = /{producer_id} unit = producer-server versions = all
392025-11-03T20:11:40.681ZINFOtfportd (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.4/src/server.rs:328 local_addr = [fd00:1122:3344:101::2]:36417 unit = producer-server
402025-11-03T20:11:40.682ZDEBGtfportd (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::2]:36417 unit = producer-server
412025-11-03T20:11:40.682ZDEBGtfportd: Requested any available port, Dropshot server has been bound to [fd00:1122:3344:101::2]:36417 unit = producer-server
422025-11-03T20:11:40.682ZDEBGtfportd: Nexus IP not provided, will use DNS to resolve it unit = producer-server
432025-11-03T20:11:40.682ZINFOtfportd (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/e76962a/internal-dns/resolver/src/resolver.rs:144 unit = producer-server
442025-11-03T20:11:40.682ZDEBGtfportd: starting producer registration task unit = producer-server
452025-11-03T20:11:40.682ZINFOtfportd: starting oximeter metric producer server address = [fd00:1122:3344:101::2]:36417 file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/e76962a/oximeter/producer/src/lib.rs:279 interval = 30s producer_id = 93db08a3-d64d-40e3-b862-5489fd46c4fa unit = producer-server
462025-11-03T20:11:40.682ZINFOtfportd: created oximeter producer server unit = oximeter
472025-11-03T20:11:40.682ZDEBGtfportd (producer-registration-task): registering as oximeter producer with Nexus registration_count = 0 unit = producer-server
482025-11-03T20:11:40.683ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
492025-11-03T20:11:40.683ZDEBGtfportd (kstat-sampler): adding new target unit = oximeter
502025-11-03T20:11:40.684ZDEBGtfportd (kstat-sampler-worker): storing new creation time for tracked target creation_time = 2025-11-03T20:11:23.956482530Z path = KstatPath { module: "link", instance: 0, name: "tfportrear0_0" } unit = oximeter
512025-11-03T20:11:40.684ZDEBGtfportd (kstat-sampler-worker): inserted empty per-target sample queue id = 5465750367348438633 unit = oximeter
522025-11-03T20:11:40.684ZDEBGtfportd: added new link to kstat sampler link_kind = switch-port-control link_name = tfportrear0_0 unit = metrics-task-tracker
532025-11-03T20:11:40.686ZWARNtfportd: tfportqsfp0_0 has no addrs
542025-11-03T20:11:41.270ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
552025-11-03T20:11:41.275ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
562025-11-03T20:11:41.278ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
572025-11-03T20:11:41.278ZDEBGtfportd (kstat-sampler): adding new target unit = oximeter
582025-11-03T20:11:41.279ZDEBGtfportd (kstat-sampler-worker): storing new creation time for tracked target creation_time = 2025-11-03T20:11:23.956340938Z path = KstatPath { module: "link", instance: 0, name: "tfportqsfp0_0" } unit = oximeter
592025-11-03T20:11:41.279ZDEBGtfportd (kstat-sampler-worker): inserted empty per-target sample queue id = 6091068650982407494 unit = oximeter
602025-11-03T20:11:41.279ZDEBGtfportd: added new link to kstat sampler link_kind = switch-port-control link_name = tfportqsfp0_0 unit = metrics-task-tracker
612025-11-03T20:11:41.705ZINFOtfportd: added new ARP entry entry = 10.151.1.174->06:b5:ed:79:3f:51 interface = tfportqsfp0_0
622025-11-03T20:11:42.030ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
632025-11-03T20:11:42.035ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
642025-11-03T20:11:42.037ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
652025-11-03T20:11:43.283ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
662025-11-03T20:11:43.287ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
672025-11-03T20:11:43.290ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
682025-11-03T20:11:44.329ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
692025-11-03T20:11:44.334ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
702025-11-03T20:11:44.338ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
712025-11-03T20:11:45.685ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("61a3a83d-2089-4d5b-8e38-81afcbe4aa99.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("a5bc9bb8-d511-4cb1-bc16-1d8f8168f1e3.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("a6d4fa5d-6959-4a9a-80d9-b40718089028.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("a6d4fa5d-6959-4a9a-80d9-b40718089028.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::c)) }], valid_until: Instant { tv_sec: 818, tv_nsec: 799814094 } }) unit = producer-server
722025-11-03T20:11:45.686ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
732025-11-03T20:11:45.718ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
742025-11-03T20:11:45.783ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
752025-11-03T20:11:45.790ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
762025-11-03T20:11:45.793ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
772025-11-03T20:11:47.063ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
782025-11-03T20:11:47.069ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
792025-11-03T20:11:47.071ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
802025-11-03T20:11:48.056ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
812025-11-03T20:11:48.061ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
822025-11-03T20:11:48.063ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
832025-11-03T20:11:49.228ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
842025-11-03T20:11:49.232ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
852025-11-03T20:11:49.235ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
862025-11-03T20:11:49.995ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
872025-11-03T20:11:49.999ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
882025-11-03T20:11:50.002ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
892025-11-03T20:11:50.688ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5465750367348438633 n_samples = 6 unit = oximeter
902025-11-03T20:11:50.904ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
912025-11-03T20:11:50.910ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
922025-11-03T20:11:50.912ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
932025-11-03T20:11:51.281ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 6091068650982407494 n_samples = 6 unit = oximeter
942025-11-03T20:11:51.716ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
952025-11-03T20:11:51.720ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
962025-11-03T20:11:51.723ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
972025-11-03T20:11:52.769ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
982025-11-03T20:11:52.773ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
992025-11-03T20:11:52.777ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1002025-11-03T20:11:54.169ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1012025-11-03T20:11:54.174ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
1022025-11-03T20:11:54.176ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1032025-11-03T20:11:55.134ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1042025-11-03T20:11:55.140ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
1052025-11-03T20:11:55.143ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1062025-11-03T20:11:55.761ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1072025-11-03T20:11:55.766ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
1082025-11-03T20:11:55.769ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1092025-11-03T20:11:56.718ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1102025-11-03T20:11:56.723ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
1112025-11-03T20:11:56.725ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1122025-11-03T20:11:58.428ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1132025-11-03T20:11:58.433ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
1142025-11-03T20:11:58.436ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1152025-11-03T20:11:59.163ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1162025-11-03T20:11:59.170ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
1172025-11-03T20:11:59.174ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1182025-11-03T20:12:00.441ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1192025-11-03T20:12:00.447ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
1202025-11-03T20:12:00.450ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1212025-11-03T20:12:01.173ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5465750367348438633 n_samples = 6 unit = oximeter
1222025-11-03T20:12:01.201ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
1232025-11-03T20:12:01.202ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 0 delay = 20.038108976s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/e76962a/oximeter/producer/src/lib.rs:371 unit = producer-server
1242025-11-03T20:12:01.449ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("61a3a83d-2089-4d5b-8e38-81afcbe4aa99.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("a5bc9bb8-d511-4cb1-bc16-1d8f8168f1e3.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("a6d4fa5d-6959-4a9a-80d9-b40718089028.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("a6d4fa5d-6959-4a9a-80d9-b40718089028.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::c)) }], valid_until: Instant { tv_sec: 834, tv_nsec: 82454395 } }) unit = producer-server
1252025-11-03T20:12:01.450ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
1262025-11-03T20:12:01.479ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
1272025-11-03T20:12:01.552ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1282025-11-03T20:12:01.558ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
1292025-11-03T20:12:01.561ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1302025-11-03T20:12:01.764ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 6091068650982407494 n_samples = 6 unit = oximeter
1312025-11-03T20:12:02.895ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1322025-11-03T20:12:02.914ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
1332025-11-03T20:12:02.924ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1342025-11-03T20:12:04.014ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1352025-11-03T20:12:04.020ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
1362025-11-03T20:12:04.024ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1372025-11-03T20:12:04.731ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1382025-11-03T20:12:04.738ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
1392025-11-03T20:12:04.742ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1402025-11-03T20:12:06.133ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1412025-11-03T20:12:06.138ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
1422025-11-03T20:12:06.140ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1432025-11-03T20:12:06.835ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1442025-11-03T20:12:06.842ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
1452025-11-03T20:12:06.851ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1462025-11-03T20:12:07.546ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1472025-11-03T20:12:07.552ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
1482025-11-03T20:12:07.555ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1492025-11-03T20:12:08.963ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1502025-11-03T20:12:08.968ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
1512025-11-03T20:12:08.971ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1522025-11-03T20:12:09.669ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1532025-11-03T20:12:09.675ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
1542025-11-03T20:12:09.677ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1552025-11-03T20:12:10.328ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1562025-11-03T20:12:10.334ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
1572025-11-03T20:12:10.338ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1582025-11-03T20:12:11.177ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5465750367348438633 n_samples = 6 unit = oximeter
1592025-11-03T20:12:11.427ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1602025-11-03T20:12:11.432ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
1612025-11-03T20:12:11.435ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1622025-11-03T20:12:11.769ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 6091068650982407494 n_samples = 6 unit = oximeter
1632025-11-03T20:12:12.978ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1642025-11-03T20:12:12.987ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
1652025-11-03T20:12:12.992ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1662025-11-03T20:12:14.445ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1672025-11-03T20:12:14.452ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
1682025-11-03T20:12:14.456ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1692025-11-03T20:12:14.998ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1702025-11-03T20:12:15.005ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
1712025-11-03T20:12:15.009ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1722025-11-03T20:12:16.028ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1732025-11-03T20:12:16.034ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
1742025-11-03T20:12:16.037ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1752025-11-03T20:12:16.482ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
1762025-11-03T20:12:16.483ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 1 delay = 35.318774526s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/e76962a/oximeter/producer/src/lib.rs:371 unit = producer-server
1772025-11-03T20:12:16.795ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("61a3a83d-2089-4d5b-8e38-81afcbe4aa99.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("a5bc9bb8-d511-4cb1-bc16-1d8f8168f1e3.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("a6d4fa5d-6959-4a9a-80d9-b40718089028.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("a6d4fa5d-6959-4a9a-80d9-b40718089028.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::c)) }], valid_until: Instant { tv_sec: 849, tv_nsec: 426654204 } }) unit = producer-server
1782025-11-03T20:12:16.795ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
1792025-11-03T20:12:16.827ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
1802025-11-03T20:12:17.310ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1812025-11-03T20:12:17.315ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
1822025-11-03T20:12:17.318ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1832025-11-03T20:12:18.580ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1842025-11-03T20:12:18.587ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
1852025-11-03T20:12:18.589ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1862025-11-03T20:12:19.239ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1872025-11-03T20:12:19.244ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
1882025-11-03T20:12:19.246ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1892025-11-03T20:12:19.954ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1902025-11-03T20:12:19.960ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
1912025-11-03T20:12:19.963ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1922025-11-03T20:12:20.921ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1932025-11-03T20:12:20.926ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
1942025-11-03T20:12:20.929ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1952025-11-03T20:12:21.179ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5465750367348438633 n_samples = 6 unit = oximeter
1962025-11-03T20:12:21.771ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 6091068650982407494 n_samples = 6 unit = oximeter
1972025-11-03T20:12:21.822ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1982025-11-03T20:12:21.827ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
1992025-11-03T20:12:21.830ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2002025-11-03T20:12:22.626ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2012025-11-03T20:12:22.631ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
2022025-11-03T20:12:22.634ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2032025-11-03T20:12:23.818ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2042025-11-03T20:12:23.823ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
2052025-11-03T20:12:23.826ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2062025-11-03T20:12:24.658ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2072025-11-03T20:12:24.664ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
2082025-11-03T20:12:24.667ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2092025-11-03T20:12:25.798ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2102025-11-03T20:12:25.803ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
2112025-11-03T20:12:25.806ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2122025-11-03T20:12:26.485ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2132025-11-03T20:12:26.490ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
2142025-11-03T20:12:26.492ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2152025-11-03T20:12:27.446ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2162025-11-03T20:12:27.452ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
2172025-11-03T20:12:27.456ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2182025-11-03T20:12:28.097ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2192025-11-03T20:12:28.102ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
2202025-11-03T20:12:28.105ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2212025-11-03T20:12:28.826ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2222025-11-03T20:12:28.831ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
2232025-11-03T20:12:28.835ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2242025-11-03T20:12:29.735ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2252025-11-03T20:12:29.739ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
2262025-11-03T20:12:29.742ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2272025-11-03T20:12:30.951ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2282025-11-03T20:12:30.956ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
2292025-11-03T20:12:30.959ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2302025-11-03T20:12:31.182ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5465750367348438633 n_samples = 6 unit = oximeter
2312025-11-03T20:12:31.741ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2322025-11-03T20:12:31.745ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
2332025-11-03T20:12:31.748ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2342025-11-03T20:12:31.775ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 6091068650982407494 n_samples = 6 unit = oximeter
2352025-11-03T20:12:31.829ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
2362025-11-03T20:12:31.830ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 2 delay = 50.664484866s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/e76962a/oximeter/producer/src/lib.rs:371 unit = producer-server
2372025-11-03T20:12:32.950ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2382025-11-03T20:12:32.956ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
2392025-11-03T20:12:32.959ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2402025-11-03T20:12:32.995ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("61a3a83d-2089-4d5b-8e38-81afcbe4aa99.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("a5bc9bb8-d511-4cb1-bc16-1d8f8168f1e3.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("a6d4fa5d-6959-4a9a-80d9-b40718089028.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("a6d4fa5d-6959-4a9a-80d9-b40718089028.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::c)) }], valid_until: Instant { tv_sec: 865, tv_nsec: 626866187 } }) unit = producer-server
2412025-11-03T20:12:32.996ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
2422025-11-03T20:12:33.027ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
2432025-11-03T20:12:33.734ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2442025-11-03T20:12:33.740ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
2452025-11-03T20:12:33.743ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2462025-11-03T20:12:34.421ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2472025-11-03T20:12:34.427ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
2482025-11-03T20:12:34.430ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2492025-11-03T20:12:35.038ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2502025-11-03T20:12:35.043ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
2512025-11-03T20:12:35.046ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2522025-11-03T20:12:36.477ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2532025-11-03T20:12:36.482ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
2542025-11-03T20:12:36.485ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2552025-11-03T20:12:37.286ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2562025-11-03T20:12:37.292ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
2572025-11-03T20:12:37.295ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2582025-11-03T20:12:38.726ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2592025-11-03T20:12:38.732ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
2602025-11-03T20:12:38.735ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2612025-11-03T20:12:40.129ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2622025-11-03T20:12:40.134ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
2632025-11-03T20:12:40.137ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2642025-11-03T20:12:41.184ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5465750367348438633 n_samples = 6 unit = oximeter
2652025-11-03T20:12:41.612ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2662025-11-03T20:12:41.617ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
2672025-11-03T20:12:41.621ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2682025-11-03T20:12:41.777ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 6091068650982407494 n_samples = 6 unit = oximeter
2692025-11-03T20:12:42.442ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2702025-11-03T20:12:42.447ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
2712025-11-03T20:12:42.450ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2722025-11-03T20:12:43.191ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2732025-11-03T20:12:43.197ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
2742025-11-03T20:12:43.201ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2752025-11-03T20:12:44.264ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2762025-11-03T20:12:44.269ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
2772025-11-03T20:12:44.272ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2782025-11-03T20:12:45.279ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2792025-11-03T20:12:45.284ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
2802025-11-03T20:12:45.287ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2812025-11-03T20:12:46.474ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2822025-11-03T20:12:46.479ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
2832025-11-03T20:12:46.482ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2842025-11-03T20:12:47.070ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2852025-11-03T20:12:47.076ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
2862025-11-03T20:12:47.079ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2872025-11-03T20:12:47.886ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2882025-11-03T20:12:47.891ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
2892025-11-03T20:12:47.894ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2902025-11-03T20:12:48.029ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
2912025-11-03T20:12:48.030ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 3 delay = 66.864363702s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/e76962a/oximeter/producer/src/lib.rs:371 unit = producer-server
2922025-11-03T20:12:48.462ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2932025-11-03T20:12:48.468ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
2942025-11-03T20:12:48.471ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2952025-11-03T20:12:49.370ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("61a3a83d-2089-4d5b-8e38-81afcbe4aa99.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("a5bc9bb8-d511-4cb1-bc16-1d8f8168f1e3.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("a6d4fa5d-6959-4a9a-80d9-b40718089028.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("a6d4fa5d-6959-4a9a-80d9-b40718089028.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::c)) }], valid_until: Instant { tv_sec: 882, tv_nsec: 1129692 } }) unit = producer-server
2962025-11-03T20:12:49.370ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
2972025-11-03T20:12:49.403ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
2982025-11-03T20:12:49.843ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2992025-11-03T20:12:49.849ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
3002025-11-03T20:12:49.851ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3012025-11-03T20:12:50.504ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3022025-11-03T20:12:50.510ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
3032025-11-03T20:12:50.513ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3042025-11-03T20:12:51.186ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5465750367348438633 n_samples = 6 unit = oximeter
3052025-11-03T20:12:51.435ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3062025-11-03T20:12:51.440ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
3072025-11-03T20:12:51.443ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3082025-11-03T20:12:51.779ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 6091068650982407494 n_samples = 6 unit = oximeter
3092025-11-03T20:12:52.137ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3102025-11-03T20:12:52.142ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
3112025-11-03T20:12:52.145ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3122025-11-03T20:12:52.800ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3132025-11-03T20:12:52.806ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
3142025-11-03T20:12:52.809ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3152025-11-03T20:12:54.194ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3162025-11-03T20:12:54.199ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
3172025-11-03T20:12:54.203ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3182025-11-03T20:12:55.117ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3192025-11-03T20:12:55.122ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
3202025-11-03T20:12:55.125ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3212025-11-03T20:12:55.837ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3222025-11-03T20:12:55.842ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
3232025-11-03T20:12:55.846ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3242025-11-03T20:12:57.178ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3252025-11-03T20:12:57.183ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
3262025-11-03T20:12:57.185ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3272025-11-03T20:12:58.141ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3282025-11-03T20:12:58.147ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
3292025-11-03T20:12:58.150ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3302025-11-03T20:12:58.713ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3312025-11-03T20:12:58.719ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
3322025-11-03T20:12:58.722ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3332025-11-03T20:12:59.355ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3342025-11-03T20:12:59.359ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
3352025-11-03T20:12:59.362ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3362025-11-03T20:13:00.623ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3372025-11-03T20:13:00.629ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
3382025-11-03T20:13:00.632ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3392025-11-03T20:13:01.190ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5465750367348438633 n_samples = 6 unit = oximeter
3402025-11-03T20:13:01.229ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3412025-11-03T20:13:01.234ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
3422025-11-03T20:13:01.237ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3432025-11-03T20:13:01.782ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 6091068650982407494 n_samples = 6 unit = oximeter
3442025-11-03T20:13:02.013ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3452025-11-03T20:13:02.019ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
3462025-11-03T20:13:02.021ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3472025-11-03T20:13:02.658ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3482025-11-03T20:13:02.663ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
3492025-11-03T20:13:02.666ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3502025-11-03T20:13:04.058ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3512025-11-03T20:13:04.063ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
3522025-11-03T20:13:04.067ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3532025-11-03T20:13:04.403ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
3542025-11-03T20:13:04.404ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 4 delay = 83.238518555s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/e76962a/oximeter/producer/src/lib.rs:371 unit = producer-server
3552025-11-03T20:13:04.770ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3562025-11-03T20:13:04.775ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
3572025-11-03T20:13:04.779ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3582025-11-03T20:13:06.145ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3592025-11-03T20:13:06.151ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
3602025-11-03T20:13:06.155ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3612025-11-03T20:13:06.721ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3622025-11-03T20:13:06.726ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
3632025-11-03T20:13:06.729ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3642025-11-03T20:13:08.217ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3652025-11-03T20:13:08.223ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
3662025-11-03T20:13:08.225ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3672025-11-03T20:13:09.002ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("61a3a83d-2089-4d5b-8e38-81afcbe4aa99.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("a5bc9bb8-d511-4cb1-bc16-1d8f8168f1e3.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("a6d4fa5d-6959-4a9a-80d9-b40718089028.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("a6d4fa5d-6959-4a9a-80d9-b40718089028.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::c)) }], valid_until: Instant { tv_sec: 901, tv_nsec: 633139210 } }) unit = producer-server
3682025-11-03T20:13:09.003ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
3692025-11-03T20:13:09.033ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
3702025-11-03T20:13:09.412ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3712025-11-03T20:13:09.419ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
3722025-11-03T20:13:09.423ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3732025-11-03T20:13:10.291ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3742025-11-03T20:13:10.353ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
3752025-11-03T20:13:10.360ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3762025-11-03T20:13:11.222ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5465750367348438633 n_samples = 6 unit = oximeter
3772025-11-03T20:13:11.783ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 6091068650982407494 n_samples = 6 unit = oximeter
3782025-11-03T20:13:11.877ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3792025-11-03T20:13:11.891ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
3802025-11-03T20:13:11.895ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3812025-11-03T20:13:12.691ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3822025-11-03T20:13:12.697ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
3832025-11-03T20:13:12.702ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3842025-11-03T20:13:18.389ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3852025-11-03T20:13:18.485ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
3862025-11-03T20:13:18.520ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3872025-11-03T20:13:19.461ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3882025-11-03T20:13:19.477ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
3892025-11-03T20:13:19.481ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3902025-11-03T20:13:20.928ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3912025-11-03T20:13:20.955ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
3922025-11-03T20:13:21.139ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3932025-11-03T20:13:21.288ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5465750367348438633 n_samples = 6 unit = oximeter
3942025-11-03T20:13:21.789ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 6091068650982407494 n_samples = 6 unit = oximeter
3952025-11-03T20:13:22.041ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3962025-11-03T20:13:22.049ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
3972025-11-03T20:13:22.055ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3982025-11-03T20:13:22.827ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3992025-11-03T20:13:22.834ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
4002025-11-03T20:13:22.838ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4012025-11-03T20:13:24.050ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
4022025-11-03T20:13:24.062ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 5 delay = 102.895411984s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/e76962a/oximeter/producer/src/lib.rs:371 unit = producer-server
4032025-11-03T20:13:24.187ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4042025-11-03T20:13:24.195ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
4052025-11-03T20:13:24.199ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4062025-11-03T20:13:25.229ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4072025-11-03T20:13:25.236ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
4082025-11-03T20:13:25.240ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4092025-11-03T20:13:25.953ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4102025-11-03T20:13:25.962ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
4112025-11-03T20:13:25.967ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4122025-11-03T20:13:27.296ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4132025-11-03T20:13:27.303ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
4142025-11-03T20:13:27.308ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4152025-11-03T20:13:28.462ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4162025-11-03T20:13:28.469ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
4172025-11-03T20:13:28.473ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4182025-11-03T20:13:29.008ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4192025-11-03T20:13:29.016ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
4202025-11-03T20:13:29.021ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4212025-11-03T20:13:30.300ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4222025-11-03T20:13:30.309ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
4232025-11-03T20:13:30.313ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4242025-11-03T20:13:31.304ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5465750367348438633 n_samples = 6 unit = oximeter
4252025-11-03T20:13:31.792ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 6091068650982407494 n_samples = 6 unit = oximeter
4262025-11-03T20:13:31.806ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4272025-11-03T20:13:31.815ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
4282025-11-03T20:13:31.820ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4292025-11-03T20:13:33.166ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4302025-11-03T20:13:33.178ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
4312025-11-03T20:13:33.184ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4322025-11-03T20:13:34.187ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4332025-11-03T20:13:34.196ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
4342025-11-03T20:13:34.201ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4352025-11-03T20:13:35.230ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4362025-11-03T20:13:35.239ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
4372025-11-03T20:13:35.244ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4382025-11-03T20:13:35.818ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("61a3a83d-2089-4d5b-8e38-81afcbe4aa99.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("a5bc9bb8-d511-4cb1-bc16-1d8f8168f1e3.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("a6d4fa5d-6959-4a9a-80d9-b40718089028.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("a6d4fa5d-6959-4a9a-80d9-b40718089028.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::c)) }], valid_until: Instant { tv_sec: 928, tv_nsec: 447752173 } }) unit = producer-server
4392025-11-03T20:13:35.832ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
4402025-11-03T20:13:35.945ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
4412025-11-03T20:13:36.578ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4422025-11-03T20:13:36.584ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
4432025-11-03T20:13:36.587ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4442025-11-03T20:13:37.669ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4452025-11-03T20:13:37.674ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
4462025-11-03T20:13:37.677ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4472025-11-03T20:13:38.216ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [fd00:1122:3344:101::b]:12221, Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) }) unit = producer-server
4482025-11-03T20:13:38.218ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 6 delay = 117.051692169s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/e76962a/oximeter/producer/src/lib.rs:371 unit = producer-server
4492025-11-03T20:13:38.489ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4502025-11-03T20:13:38.493ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
4512025-11-03T20:13:38.497ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4522025-11-03T20:13:39.725ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4532025-11-03T20:13:39.731ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
4542025-11-03T20:13:39.734ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4552025-11-03T20:13:40.266ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4562025-11-03T20:13:40.272ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
4572025-11-03T20:13:40.276ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4582025-11-03T20:13:41.091ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4592025-11-03T20:13:41.096ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
4602025-11-03T20:13:41.100ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4612025-11-03T20:13:41.307ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5465750367348438633 n_samples = 6 unit = oximeter
4622025-11-03T20:13:41.795ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 6091068650982407494 n_samples = 6 unit = oximeter
4632025-11-03T20:13:41.870ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4642025-11-03T20:13:41.875ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
4652025-11-03T20:13:41.878ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4662025-11-03T20:13:42.858ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4672025-11-03T20:13:42.864ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
4682025-11-03T20:13:42.867ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4692025-11-03T20:13:44.352ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4702025-11-03T20:13:44.363ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
4712025-11-03T20:13:44.366ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4722025-11-03T20:13:45.559ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4732025-11-03T20:13:45.566ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
4742025-11-03T20:13:45.569ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4752025-11-03T20:13:46.264ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4762025-11-03T20:13:46.269ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
4772025-11-03T20:13:46.273ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4782025-11-03T20:13:47.067ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4792025-11-03T20:13:47.073ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
4802025-11-03T20:13:47.076ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4812025-11-03T20:13:48.403ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4822025-11-03T20:13:48.409ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
4832025-11-03T20:13:48.412ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4842025-11-03T20:13:49.713ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4852025-11-03T20:13:49.719ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
4862025-11-03T20:13:49.722ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4872025-11-03T20:13:51.079ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4882025-11-03T20:13:51.085ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
4892025-11-03T20:13:51.088ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4902025-11-03T20:13:51.311ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5465750367348438633 n_samples = 6 unit = oximeter
4912025-11-03T20:13:51.797ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 6091068650982407494 n_samples = 6 unit = oximeter
4922025-11-03T20:13:52.215ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4932025-11-03T20:13:52.221ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
4942025-11-03T20:13:52.224ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4952025-11-03T20:13:52.813ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4962025-11-03T20:13:52.819ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
4972025-11-03T20:13:52.822ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4982025-11-03T20:13:53.763ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4992025-11-03T20:13:53.769ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
5002025-11-03T20:13:53.772ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5012025-11-03T20:13:54.438ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5022025-11-03T20:13:54.445ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
5032025-11-03T20:13:54.449ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5042025-11-03T20:13:55.945ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5052025-11-03T20:13:55.951ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
5062025-11-03T20:13:55.955ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5072025-11-03T20:13:56.410ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("61a3a83d-2089-4d5b-8e38-81afcbe4aa99.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("a5bc9bb8-d511-4cb1-bc16-1d8f8168f1e3.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("a6d4fa5d-6959-4a9a-80d9-b40718089028.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("a6d4fa5d-6959-4a9a-80d9-b40718089028.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::c)) }], valid_until: Instant { tv_sec: 949, tv_nsec: 40339715 } }) unit = producer-server
5082025-11-03T20:13:56.410ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
5092025-11-03T20:13:56.488ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
5102025-11-03T20:13:56.620ZDEBGtfportd (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "bb665949-ee5f-4776-acad-95ae7e0c7560", "content-length": "41", "date": "Mon, 03 Nov 2025 20:13:56 GMT"} }) unit = producer-server
5112025-11-03T20:13:56.625ZDEBGtfportd (producer-registration-task): successfully registered with Nexus, pausing until time to renew lease lease_duration = 600s unit = producer-server wait_period = 150s
5122025-11-03T20:13:56.900ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5132025-11-03T20:13:56.907ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
5142025-11-03T20:13:56.912ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5152025-11-03T20:13:58.197ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5162025-11-03T20:13:58.203ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
5172025-11-03T20:13:58.206ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5182025-11-03T20:13:59.271ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5192025-11-03T20:13:59.277ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
5202025-11-03T20:13:59.280ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5212025-11-03T20:13:59.901ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5222025-11-03T20:13:59.907ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
5232025-11-03T20:13:59.910ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5242025-11-03T20:14:00.491ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5252025-11-03T20:14:00.497ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
5262025-11-03T20:14:00.500ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5272025-11-03T20:14:01.315ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5465750367348438633 n_samples = 6 unit = oximeter
5282025-11-03T20:14:01.547ZINFOtfportd (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.4/src/server.rs:1025 local_addr = [fd00:1122:3344:101::2]:36417 remote_addr = [fd00:1122:3344:101::d]:36030 unit = producer-server
5292025-11-03T20:14:01.572ZINFOtfportd (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.4/src/server.rs:867 latency_us = 24329 local_addr = [fd00:1122:3344:101::2]:36417 method = GET remote_addr = [fd00:1122:3344:101::d]:36030 req_id = adeed164-1048-4743-9cf1-3ba1fc04a81b response_code = 200 unit = producer-server uri = /93db08a3-d64d-40e3-b862-5489fd46c4fa
5302025-11-03T20:14:01.623ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5312025-11-03T20:14:01.628ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
5322025-11-03T20:14:01.632ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5332025-11-03T20:14:01.801ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 6091068650982407494 n_samples = 6 unit = oximeter
5342025-11-03T20:14:02.332ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5352025-11-03T20:14:02.339ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
5362025-11-03T20:14:02.342ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5372025-11-03T20:14:03.190ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5382025-11-03T20:14:03.196ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
5392025-11-03T20:14:03.199ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5402025-11-03T20:14:03.843ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5412025-11-03T20:14:03.850ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
5422025-11-03T20:14:03.854ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5432025-11-03T20:14:04.441ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5442025-11-03T20:14:04.446ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
5452025-11-03T20:14:04.450ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5462025-11-03T20:14:05.204ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5472025-11-03T20:14:05.211ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
5482025-11-03T20:14:05.215ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5492025-11-03T20:14:05.993ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5502025-11-03T20:14:05.999ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
5512025-11-03T20:14:06.003ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5522025-11-03T20:14:07.412ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5532025-11-03T20:14:07.419ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
5542025-11-03T20:14:07.422ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5552025-11-03T20:14:08.361ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5562025-11-03T20:14:08.367ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
5572025-11-03T20:14:08.370ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5582025-11-03T20:14:09.449ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5592025-11-03T20:14:09.455ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
5602025-11-03T20:14:09.459ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5612025-11-03T20:14:10.958ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5622025-11-03T20:14:10.963ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
5632025-11-03T20:14:10.966ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5642025-11-03T20:14:11.315ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5465750367348438633 n_samples = 6 unit = oximeter
5652025-11-03T20:14:11.801ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 6091068650982407494 n_samples = 6 unit = oximeter
5662025-11-03T20:14:12.188ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5672025-11-03T20:14:12.194ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
5682025-11-03T20:14:12.198ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5692025-11-03T20:14:13.157ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5702025-11-03T20:14:13.163ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
5712025-11-03T20:14:13.166ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5722025-11-03T20:14:14.162ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5732025-11-03T20:14:14.168ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
5742025-11-03T20:14:14.172ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5752025-11-03T20:14:15.476ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5762025-11-03T20:14:15.482ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
5772025-11-03T20:14:15.486ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5782025-11-03T20:14:16.507ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5792025-11-03T20:14:16.513ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
5802025-11-03T20:14:16.516ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5812025-11-03T20:14:17.795ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5822025-11-03T20:14:17.801ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
5832025-11-03T20:14:17.804ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5842025-11-03T20:14:18.458ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5852025-11-03T20:14:18.464ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
5862025-11-03T20:14:18.467ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5872025-11-03T20:14:19.374ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5882025-11-03T20:14:19.380ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
5892025-11-03T20:14:19.383ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5902025-11-03T20:14:20.137ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5912025-11-03T20:14:20.143ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
5922025-11-03T20:14:20.146ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5932025-11-03T20:14:20.840ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5942025-11-03T20:14:20.846ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
5952025-11-03T20:14:20.849ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5962025-11-03T20:14:21.319ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5465750367348438633 n_samples = 6 unit = oximeter
5972025-11-03T20:14:21.743ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5982025-11-03T20:14:21.748ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
5992025-11-03T20:14:21.752ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6002025-11-03T20:14:21.802ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 6091068650982407494 n_samples = 6 unit = oximeter
6012025-11-03T20:14:23.023ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6022025-11-03T20:14:23.029ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
6032025-11-03T20:14:23.033ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6042025-11-03T20:14:23.877ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6052025-11-03T20:14:23.884ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
6062025-11-03T20:14:23.888ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6072025-11-03T20:14:24.655ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6082025-11-03T20:14:24.661ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
6092025-11-03T20:14:24.665ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6102025-11-03T20:14:25.708ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6112025-11-03T20:14:25.714ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
6122025-11-03T20:14:25.718ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6132025-11-03T20:14:26.557ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6142025-11-03T20:14:26.564ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
6152025-11-03T20:14:26.567ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6162025-11-03T20:14:27.315ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6172025-11-03T20:14:27.322ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
6182025-11-03T20:14:27.325ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6192025-11-03T20:14:28.639ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6202025-11-03T20:14:28.645ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
6212025-11-03T20:14:28.648ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6222025-11-03T20:14:29.283ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6232025-11-03T20:14:29.289ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
6242025-11-03T20:14:29.292ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6252025-11-03T20:14:30.171ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6262025-11-03T20:14:30.176ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
6272025-11-03T20:14:30.179ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6282025-11-03T20:14:31.321ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5465750367348438633 n_samples = 6 unit = oximeter
6292025-11-03T20:14:31.499ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6302025-11-03T20:14:31.505ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
6312025-11-03T20:14:31.508ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6322025-11-03T20:14:31.805ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 6091068650982407494 n_samples = 6 unit = oximeter
6332025-11-03T20:14:32.194ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6342025-11-03T20:14:32.199ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
6352025-11-03T20:14:32.203ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6362025-11-03T20:14:33.610ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6372025-11-03T20:14:33.616ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
6382025-11-03T20:14:33.619ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6392025-11-03T20:14:35.112ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6402025-11-03T20:14:35.117ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
6412025-11-03T20:14:35.121ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6422025-11-03T20:14:35.809ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6432025-11-03T20:14:35.815ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
6442025-11-03T20:14:35.818ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6452025-11-03T20:14:36.690ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6462025-11-03T20:14:36.696ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
6472025-11-03T20:14:36.700ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6482025-11-03T20:14:37.623ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6492025-11-03T20:14:37.628ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
6502025-11-03T20:14:37.631ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6512025-11-03T20:14:38.694ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6522025-11-03T20:14:38.700ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
6532025-11-03T20:14:38.703ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6542025-11-03T20:14:39.767ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6552025-11-03T20:14:39.773ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
6562025-11-03T20:14:39.776ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6572025-11-03T20:14:41.118ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6582025-11-03T20:14:41.123ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
6592025-11-03T20:14:41.126ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6602025-11-03T20:14:41.324ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5465750367348438633 n_samples = 6 unit = oximeter
6612025-11-03T20:14:41.806ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 6091068650982407494 n_samples = 6 unit = oximeter
6622025-11-03T20:14:42.030ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6632025-11-03T20:14:42.035ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
6642025-11-03T20:14:42.038ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6652025-11-03T20:14:43.214ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6662025-11-03T20:14:43.220ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
6672025-11-03T20:14:43.223ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6682025-11-03T20:14:43.959ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6692025-11-03T20:14:43.965ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
6702025-11-03T20:14:43.968ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6712025-11-03T20:14:44.950ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6722025-11-03T20:14:44.955ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
6732025-11-03T20:14:44.957ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6742025-11-03T20:14:46.370ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6752025-11-03T20:14:46.379ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
6762025-11-03T20:14:46.382ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6772025-11-03T20:14:47.430ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6782025-11-03T20:14:47.436ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
6792025-11-03T20:14:47.439ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6802025-11-03T20:14:48.150ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6812025-11-03T20:14:48.156ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
6822025-11-03T20:14:48.159ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6832025-11-03T20:14:49.072ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6842025-11-03T20:14:49.077ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
6852025-11-03T20:14:49.081ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6862025-11-03T20:14:49.748ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6872025-11-03T20:14:49.754ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
6882025-11-03T20:14:49.757ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6892025-11-03T20:14:50.880ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6902025-11-03T20:14:50.885ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
6912025-11-03T20:14:50.889ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6922025-11-03T20:14:51.326ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5465750367348438633 n_samples = 6 unit = oximeter
6932025-11-03T20:14:51.580ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6942025-11-03T20:14:51.586ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
6952025-11-03T20:14:51.590ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
6962025-11-03T20:14:51.808ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 6091068650982407494 n_samples = 6 unit = oximeter
6972025-11-03T20:14:52.534ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6982025-11-03T20:14:52.540ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
6992025-11-03T20:14:52.544ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
7002025-11-03T20:14:53.274ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
7012025-11-03T20:14:53.279ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
7022025-11-03T20:14:53.283ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
7032025-11-03T20:14:54.667ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
7042025-11-03T20:14:54.673ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
7052025-11-03T20:14:54.676ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
7062025-11-03T20:14:55.970ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
7072025-11-03T20:14:55.976ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
7082025-11-03T20:14:55.980ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
7092025-11-03T20:14:56.619ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
7102025-11-03T20:14:56.628ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
7112025-11-03T20:14:56.633ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
7122025-11-03T20:14:57.502ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
7132025-11-03T20:14:57.508ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
7142025-11-03T20:14:57.511ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
7152025-11-03T20:14:58.569ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
7162025-11-03T20:14:58.575ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
7172025-11-03T20:14:58.579ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
7182025-11-03T20:14:59.117ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
7192025-11-03T20:14:59.123ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
7202025-11-03T20:14:59.126ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
7212025-11-03T20:15:00.504ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
7222025-11-03T20:15:00.510ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
7232025-11-03T20:15:00.514ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
7242025-11-03T20:15:01.329ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5465750367348438633 n_samples = 6 unit = oximeter
7252025-11-03T20:15:01.812ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 6091068650982407494 n_samples = 6 unit = oximeter
7262025-11-03T20:15:01.998ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
7272025-11-03T20:15:02.006ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::cb:f4ff:fe10:f619]
7282025-11-03T20:15:02.011ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]