Max level shown:
1 [ Jul 16 18:56:29 Enabled. ]
2 [ Jul 16 18:56:29 Rereading configuration. ]
3 [ Jul 16 18:56:30 Rereading configuration. ]
4 [ Jul 16 18:56:41 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dendrite/bin/tfportd --sync-only &"). ]
5 [ Jul 16 18:56:41 Method "start" exited with status 0. ]
6 No non-localhost IPv6 addresses found in SMF properties
72026-07-16T18:56:41.502ZINFOtfportd: connecting to dpd host = [::1] port = 12224
82026-07-16T18:56:41.503ZINFOtfportd: connected to dpd running softnpu-cc0c307c-dirty
92026-07-16T18:56:41.504ZINFOtfportd: running in sync-only mode
102026-07-16T18:56:41.505ZINFOtfportd: no non-localhost IPv6 listen address available, waiting for SMF update unit = oximeter
112026-07-16T18:56:41.506ZINFOtfportd: refreshing SMF config prior to waiting on signals unit = signal_handler
12 No non-localhost IPv6 addresses found in SMF properties
132026-07-16T18:56:41.508ZINFOtfportd: refreshed config: Config { log_file: None, log_format: Json, listen_addresses: [ [::1]:12231, ], pkt_source: None, dpd_host: "[::1]", dpd_port: 12224, vlan_link: None, vlan_data: None, techport0_prefix: None, techport1_prefix: None, rack_id: Some( 6438145b-74f5-424d-9021-17cd60ba7e2a, ), sled_id: Some( d2375452-8479-45af-989d-5a1e4dc1f691, ), sled_model: Some( "i86pc", ), sled_revision: Some( 0, ), sled_serial: Some( "sock", ), }
142026-07-16T18:56:41.508ZINFOtfportd: no non-localhost IPv6 listen address available, waiting for SMF update unit = oximeter
152026-07-16T18:56:41.512ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::9851:45ff:fe18:6e7->9a:51:45:18:06:e7 interface = tfportrear0_0
162026-07-16T18:56:41.513ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
172026-07-16T18:56:41.519ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
182026-07-16T18:56:41.524ZWARNtfportd: tfportqsfp0_0 has no addrs
19 [ Jul 16 18:56:42 Rereading configuration. ]
20 [ Jul 16 18:56:42 Executing refresh method (:kill). ]
21 [ Jul 16 18:56:42 Stopping because all processes in service exited. ]
22 [ Jul 16 18:56:42 Executing stop method (:kill). ]
23 [ Jul 16 18:56:42 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dendrite/bin/tfportd --sync-only &"). ]
24 [ Jul 16 18:56:42 Method "start" exited with status 0. ]
252026-07-16T18:56:42.150ZINFOtfportd: connecting to dpd host = [::1] port = 12224
262026-07-16T18:56:42.151ZINFOtfportd: connected to dpd running softnpu-cc0c307c-dirty
272026-07-16T18:56:42.151ZINFOtfportd: running in sync-only mode
282026-07-16T18:56:42.152ZINFOtfportd: found suitable IPv6 address for oximeter producer server address = fd00:1122:3344:101::2 unit = oximeter
292026-07-16T18:56:42.153ZINFOtfportd: refreshing SMF config prior to waiting on signals unit = signal_handler
302026-07-16T18:56:42.154ZDEBGtfportd: extracted oximeter configuration data config = OximeterConfig { listen_address: fd00:1122:3344:101::2, sled_identifiers: SledIdentifiers { rack_id: 6438145b-74f5-424d-9021-17cd60ba7e2a, sled_id: d2375452-8479-45af-989d-5a1e4dc1f691, model: "i86pc", revision: 0, serial: "sock" }, switch_identifiers: SwitchIdentifiers { asic_backend: "softnpu", fab: None, fuse: Some(FuseData { chip_rev: ChipRevision { device_id: 272, rev: "B1", rev_num: 2 }, disabled: DisabledFeatures { bsync: false, mau: [0, 0, 0, 0], pgen: false, pipes: 0, ports: 0, resub: false, speeds: 0, tm_mem: 0 }, frequency: FrequencySettings { bps: 3, bps_ext: 0, cpu_speed_dis: 0, disabled: false, pcie_dis: 0, pps: 3, pps_ext: 0 }, manufacturing: ManufacturingData { core_repair: false, die_rotation: false, pmro_and_skew: 0, silent_spin: 0, soft_pipe_dis: 0, tile_repair: false, voltage_scaling: 0, wf_core_repair: false }, part: PartInfo { part_num: 4660, pkg_id: 1, version: 2 } }), lot: None, lotnum: None, model: "FAKE_SIM_SIDECAR", revision: 0, serial: "SimSidecar0", sidecar_id: 290af3b5-f163-405d-970f-111a632b8249, slot: 0, wafer: None, wafer_loc: None } } unit = oximeter
312026-07-16T18:56:42.154ZDEBGtfportd: created producer ID producer_id = 9f05b3bc-01ef-47bf-9fb3-5cc94e500af2 unit = oximeter
322026-07-16T18:56:42.155ZINFOtfportd: refreshed config: Config { log_file: None, log_format: Json, listen_addresses: [ [fd00:1122:3344:101::2]:12231, [::1]:12231, ], pkt_source: None, dpd_host: "[::1]", dpd_port: 12224, vlan_link: None, vlan_data: None, techport0_prefix: None, techport1_prefix: None, rack_id: Some( 6438145b-74f5-424d-9021-17cd60ba7e2a, ), sled_id: Some( d2375452-8479-45af-989d-5a1e4dc1f691, ), sled_model: Some( "i86pc", ), sled_revision: Some( 0, ), sled_serial: Some( "sock", ), }
332026-07-16T18:56:42.166ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::847d:6cff:fe06:83ab->86:7d:6c:06:83:ab interface = tfportrear0_0
342026-07-16T18:56:42.166ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::9851:45ff:fe18:6e7->9a:51:45:18:06:e7 interface = tfportrear0_0
352026-07-16T18:56:42.168ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
362026-07-16T18:56:42.169ZDEBGtfportd: registered DTrace probes unit = producer-server
372026-07-16T18:56:42.171ZDEBGtfportd (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::2]:62133 method = GET path = /{producer_id} unit = producer-server versions = all
382026-07-16T18:56:42.171ZINFOtfportd (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:328 local_addr = [fd00:1122:3344:101::2]:62133 unit = producer-server
392026-07-16T18:56:42.171ZDEBGtfportd (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::2]:62133 unit = producer-server
402026-07-16T18:56:42.171ZDEBGtfportd: Requested any available port, Dropshot server has been bound to [fd00:1122:3344:101::2]:62133 unit = producer-server
412026-07-16T18:56:42.171ZDEBGtfportd: Nexus IP not provided, will use DNS to resolve it unit = producer-server
422026-07-16T18:56:42.171ZINFOtfportd (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/internal-dns/resolver/src/resolver.rs:144 unit = producer-server
432026-07-16T18:56:42.171ZDEBGtfportd: starting producer registration task unit = producer-server
442026-07-16T18:56:42.171ZINFOtfportd: starting oximeter metric producer server address = [fd00:1122:3344:101::2]:62133 file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:279 interval = 30s producer_id = 9f05b3bc-01ef-47bf-9fb3-5cc94e500af2 unit = producer-server
452026-07-16T18:56:42.171ZINFOtfportd: created oximeter producer server unit = oximeter
462026-07-16T18:56:42.171ZDEBGtfportd (producer-registration-task): registering as oximeter producer with Nexus registration_count = 0 unit = producer-server
472026-07-16T18:56:42.174ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("2049727f-cf1b-4d13-b592-d357e366a5e1.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("e9a338f1-192a-43d3-89dc-9093651641f2.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("f31eccc9-c7b6-4f2e-a74c-cba2a1576254.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("f31eccc9-c7b6-4f2e-a74c-cba2a1576254.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 679, tv_nsec: 227927825 } }) unit = producer-server
482026-07-16T18:56:42.174ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
492026-07-16T18:56:42.174ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
502026-07-16T18:56:42.175ZDEBGtfportd (kstat-sampler): adding new target unit = oximeter
512026-07-16T18:56:42.177ZDEBGtfportd (kstat-sampler-worker): storing new creation time for tracked target creation_time = 2026-07-16T18:56:25.336197754Z path = KstatPath { module: "link", instance: 0, name: "tfportrear0_0" } unit = oximeter
522026-07-16T18:56:42.177ZDEBGtfportd (kstat-sampler-worker): inserted empty per-target sample queue id = 12222984305323455783 unit = oximeter
532026-07-16T18:56:42.177ZDEBGtfportd: added new link to kstat sampler link_kind = switch-port-control link_name = tfportrear0_0 unit = metrics-task-tracker
542026-07-16T18:56:42.178ZWARNtfportd: tfportqsfp0_0 has no addrs
552026-07-16T18:56:42.193ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
562026-07-16T18:56:43.089ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
572026-07-16T18:56:43.094ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
582026-07-16T18:56:43.097ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
592026-07-16T18:56:43.097ZDEBGtfportd (kstat-sampler): adding new target unit = oximeter
602026-07-16T18:56:43.098ZDEBGtfportd (kstat-sampler-worker): storing new creation time for tracked target creation_time = 2026-07-16T18:56:25.336039121Z path = KstatPath { module: "link", instance: 0, name: "tfportqsfp0_0" } unit = oximeter
612026-07-16T18:56:43.098ZDEBGtfportd (kstat-sampler-worker): inserted empty per-target sample queue id = 15602268034793116427 unit = oximeter
622026-07-16T18:56:43.098ZDEBGtfportd: added new link to kstat sampler link_kind = switch-port-control link_name = tfportqsfp0_0 unit = metrics-task-tracker
632026-07-16T18:56:43.513ZINFOtfportd: added new ARP entry entry = 10.151.2.174->b2:b6:e8:12:e9:59 interface = tfportqsfp0_0
642026-07-16T18:56:43.613ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
652026-07-16T18:56:43.619ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
662026-07-16T18:56:43.623ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
672026-07-16T18:56:44.794ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
682026-07-16T18:56:44.799ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
692026-07-16T18:56:44.803ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
702026-07-16T18:56:45.645ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
712026-07-16T18:56:45.650ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
722026-07-16T18:56:45.653ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
732026-07-16T18:56:46.218ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
742026-07-16T18:56:46.223ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
752026-07-16T18:56:46.225ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
762026-07-16T18:56:47.190ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
772026-07-16T18:56:47.194ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
782026-07-16T18:56:47.197ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
792026-07-16T18:56:48.661ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
802026-07-16T18:56:48.665ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
812026-07-16T18:56:48.668ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
822026-07-16T18:56:50.163ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
832026-07-16T18:56:50.167ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
842026-07-16T18:56:50.170ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
852026-07-16T18:56:51.091ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
862026-07-16T18:56:51.095ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
872026-07-16T18:56:51.098ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
882026-07-16T18:56:51.898ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
892026-07-16T18:56:51.902ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
902026-07-16T18:56:51.905ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
912026-07-16T18:56:52.181ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 12222984305323455783 n_samples = 6 unit = oximeter
922026-07-16T18:56:52.987ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
932026-07-16T18:56:52.991ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
942026-07-16T18:56:52.994ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
952026-07-16T18:56:53.100ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 15602268034793116427 n_samples = 6 unit = oximeter
962026-07-16T18:56:54.385ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
972026-07-16T18:56:54.389ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
982026-07-16T18:56:54.393ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
992026-07-16T18:56:55.529ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1002026-07-16T18:56:55.534ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
1012026-07-16T18:56:55.537ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1022026-07-16T18:56:56.510ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1032026-07-16T18:56:56.515ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
1042026-07-16T18:56:56.518ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1052026-07-16T18:56:57.460ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1062026-07-16T18:56:57.464ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
1072026-07-16T18:56:57.468ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1082026-07-16T18:56:57.850ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
1092026-07-16T18:56:57.851ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 0 delay = 15.023571917s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
1102026-07-16T18:56:58.027ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("2049727f-cf1b-4d13-b592-d357e366a5e1.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("e9a338f1-192a-43d3-89dc-9093651641f2.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("f31eccc9-c7b6-4f2e-a74c-cba2a1576254.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("f31eccc9-c7b6-4f2e-a74c-cba2a1576254.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 694, tv_nsec: 425593756 } }) unit = producer-server
1112026-07-16T18:56:58.028ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
1122026-07-16T18:56:58.035ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
1132026-07-16T18:56:58.106ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1142026-07-16T18:56:58.112ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
1152026-07-16T18:56:58.115ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1162026-07-16T18:56:59.038ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1172026-07-16T18:56:59.043ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
1182026-07-16T18:56:59.046ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1192026-07-16T18:56:59.558ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1202026-07-16T18:56:59.564ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
1212026-07-16T18:56:59.566ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1222026-07-16T18:57:01.071ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1232026-07-16T18:57:01.075ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
1242026-07-16T18:57:01.078ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1252026-07-16T18:57:01.825ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1262026-07-16T18:57:01.831ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
1272026-07-16T18:57:01.834ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1282026-07-16T18:57:02.825ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 12222984305323455783 n_samples = 6 unit = oximeter
1292026-07-16T18:57:02.971ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1302026-07-16T18:57:02.976ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
1312026-07-16T18:57:02.979ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1322026-07-16T18:57:03.742ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 15602268034793116427 n_samples = 6 unit = oximeter
1332026-07-16T18:57:04.390ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1342026-07-16T18:57:04.396ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
1352026-07-16T18:57:04.399ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1362026-07-16T18:57:05.850ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1372026-07-16T18:57:05.855ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
1382026-07-16T18:57:05.858ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1392026-07-16T18:57:07.141ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1402026-07-16T18:57:07.146ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
1412026-07-16T18:57:07.150ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1422026-07-16T18:57:08.229ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1432026-07-16T18:57:08.233ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
1442026-07-16T18:57:08.237ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1452026-07-16T18:57:09.711ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1462026-07-16T18:57:09.716ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
1472026-07-16T18:57:09.720ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1482026-07-16T18:57:10.888ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1492026-07-16T18:57:10.893ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
1502026-07-16T18:57:10.896ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1512026-07-16T18:57:12.241ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1522026-07-16T18:57:12.246ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
1532026-07-16T18:57:12.249ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1542026-07-16T18:57:12.797ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1552026-07-16T18:57:12.801ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 12222984305323455783 n_samples = 6 unit = oximeter
1562026-07-16T18:57:12.802ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
1572026-07-16T18:57:12.805ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1582026-07-16T18:57:12.996ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
1592026-07-16T18:57:12.997ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 1 delay = 30.210504308s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
1602026-07-16T18:57:13.282ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("2049727f-cf1b-4d13-b592-d357e366a5e1.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("e9a338f1-192a-43d3-89dc-9093651641f2.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("f31eccc9-c7b6-4f2e-a74c-cba2a1576254.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("f31eccc9-c7b6-4f2e-a74c-cba2a1576254.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 709, tv_nsec: 722056293 } }) unit = producer-server
1612026-07-16T18:57:13.283ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
1622026-07-16T18:57:13.290ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
1632026-07-16T18:57:13.534ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1642026-07-16T18:57:13.539ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
1652026-07-16T18:57:13.542ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1662026-07-16T18:57:13.716ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 15602268034793116427 n_samples = 6 unit = oximeter
1672026-07-16T18:57:14.970ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1682026-07-16T18:57:14.974ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
1692026-07-16T18:57:14.977ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1702026-07-16T18:57:15.586ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1712026-07-16T18:57:15.590ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
1722026-07-16T18:57:15.594ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1732026-07-16T18:57:17.073ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1742026-07-16T18:57:17.077ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
1752026-07-16T18:57:17.081ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1762026-07-16T18:57:17.762ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1772026-07-16T18:57:17.768ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
1782026-07-16T18:57:17.771ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1792026-07-16T18:57:18.280ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1802026-07-16T18:57:18.285ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
1812026-07-16T18:57:18.288ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1822026-07-16T18:57:19.675ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1832026-07-16T18:57:19.681ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
1842026-07-16T18:57:19.684ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1852026-07-16T18:57:20.199ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1862026-07-16T18:57:20.204ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
1872026-07-16T18:57:20.207ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1882026-07-16T18:57:21.308ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1892026-07-16T18:57:21.312ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
1902026-07-16T18:57:21.315ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1912026-07-16T18:57:22.575ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1922026-07-16T18:57:22.580ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
1932026-07-16T18:57:22.583ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1942026-07-16T18:57:22.774ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 12222984305323455783 n_samples = 6 unit = oximeter
1952026-07-16T18:57:23.183ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1962026-07-16T18:57:23.188ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
1972026-07-16T18:57:23.191ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1982026-07-16T18:57:23.691ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 15602268034793116427 n_samples = 6 unit = oximeter
1992026-07-16T18:57:23.944ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2002026-07-16T18:57:23.948ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
2012026-07-16T18:57:23.951ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2022026-07-16T18:57:24.555ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2032026-07-16T18:57:24.560ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
2042026-07-16T18:57:24.563ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2052026-07-16T18:57:25.351ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2062026-07-16T18:57:25.355ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
2072026-07-16T18:57:25.358ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2082026-07-16T18:57:25.909ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2092026-07-16T18:57:25.914ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
2102026-07-16T18:57:25.917ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2112026-07-16T18:57:27.347ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2122026-07-16T18:57:27.359ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
2132026-07-16T18:57:27.362ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2142026-07-16T18:57:28.250ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
2152026-07-16T18:57:28.252ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 2 delay = 45.50672651s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
2162026-07-16T18:57:28.767ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2172026-07-16T18:57:28.772ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
2182026-07-16T18:57:28.774ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2192026-07-16T18:57:29.417ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("2049727f-cf1b-4d13-b592-d357e366a5e1.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("e9a338f1-192a-43d3-89dc-9093651641f2.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("f31eccc9-c7b6-4f2e-a74c-cba2a1576254.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("f31eccc9-c7b6-4f2e-a74c-cba2a1576254.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 725, tv_nsec: 901142901 } }) unit = producer-server
2202026-07-16T18:57:29.418ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
2212026-07-16T18:57:29.425ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
2222026-07-16T18:57:30.082ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2232026-07-16T18:57:30.086ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
2242026-07-16T18:57:30.090ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2252026-07-16T18:57:30.937ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2262026-07-16T18:57:30.942ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
2272026-07-16T18:57:30.945ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2282026-07-16T18:57:32.363ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2292026-07-16T18:57:32.367ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
2302026-07-16T18:57:32.371ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2312026-07-16T18:57:32.750ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 12222984305323455783 n_samples = 6 unit = oximeter
2322026-07-16T18:57:33.158ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2332026-07-16T18:57:33.163ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
2342026-07-16T18:57:33.166ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2352026-07-16T18:57:33.665ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 15602268034793116427 n_samples = 6 unit = oximeter
2362026-07-16T18:57:33.732ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2372026-07-16T18:57:33.737ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
2382026-07-16T18:57:33.741ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2392026-07-16T18:57:34.979ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2402026-07-16T18:57:34.983ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
2412026-07-16T18:57:34.986ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2422026-07-16T18:57:35.794ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2432026-07-16T18:57:35.799ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
2442026-07-16T18:57:35.802ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2452026-07-16T18:57:36.639ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2462026-07-16T18:57:36.644ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
2472026-07-16T18:57:36.647ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2482026-07-16T18:57:37.682ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2492026-07-16T18:57:37.687ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
2502026-07-16T18:57:37.691ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2512026-07-16T18:57:38.789ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2522026-07-16T18:57:38.794ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
2532026-07-16T18:57:38.797ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2542026-07-16T18:57:39.548ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2552026-07-16T18:57:39.553ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
2562026-07-16T18:57:39.556ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2572026-07-16T18:57:40.674ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2582026-07-16T18:57:40.678ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
2592026-07-16T18:57:40.682ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2602026-07-16T18:57:41.537ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2612026-07-16T18:57:41.542ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
2622026-07-16T18:57:41.545ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2632026-07-16T18:57:42.346ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2642026-07-16T18:57:42.350ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
2652026-07-16T18:57:42.354ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2662026-07-16T18:57:42.724ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 12222984305323455783 n_samples = 6 unit = oximeter
2672026-07-16T18:57:43.054ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2682026-07-16T18:57:43.058ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
2692026-07-16T18:57:43.061ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2702026-07-16T18:57:43.640ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 15602268034793116427 n_samples = 6 unit = oximeter
2712026-07-16T18:57:44.180ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2722026-07-16T18:57:44.184ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
2732026-07-16T18:57:44.187ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2742026-07-16T18:57:44.386ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
2752026-07-16T18:57:44.387ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 3 delay = 61.685961091s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
2762026-07-16T18:57:45.121ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2772026-07-16T18:57:45.126ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
2782026-07-16T18:57:45.130ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2792026-07-16T18:57:45.769ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2802026-07-16T18:57:45.775ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
2812026-07-16T18:57:45.779ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2822026-07-16T18:57:46.638ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("2049727f-cf1b-4d13-b592-d357e366a5e1.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("e9a338f1-192a-43d3-89dc-9093651641f2.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("f31eccc9-c7b6-4f2e-a74c-cba2a1576254.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("f31eccc9-c7b6-4f2e-a74c-cba2a1576254.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 743, tv_nsec: 169001674 } }) unit = producer-server
2832026-07-16T18:57:46.639ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
2842026-07-16T18:57:46.646ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
2852026-07-16T18:57:46.889ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2862026-07-16T18:57:46.893ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
2872026-07-16T18:57:46.896ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2882026-07-16T18:57:47.451ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2892026-07-16T18:57:47.455ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
2902026-07-16T18:57:47.458ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2912026-07-16T18:57:48.415ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2922026-07-16T18:57:48.419ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
2932026-07-16T18:57:48.423ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2942026-07-16T18:57:49.592ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2952026-07-16T18:57:49.598ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
2962026-07-16T18:57:49.602ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2972026-07-16T18:57:50.591ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2982026-07-16T18:57:50.596ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
2992026-07-16T18:57:50.599ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3002026-07-16T18:57:51.809ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3012026-07-16T18:57:51.817ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
3022026-07-16T18:57:51.820ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3032026-07-16T18:57:52.699ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 12222984305323455783 n_samples = 6 unit = oximeter
3042026-07-16T18:57:53.258ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3052026-07-16T18:57:53.263ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
3062026-07-16T18:57:53.266ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3072026-07-16T18:57:53.616ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 15602268034793116427 n_samples = 6 unit = oximeter
3082026-07-16T18:57:53.872ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3092026-07-16T18:57:53.876ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
3102026-07-16T18:57:53.879ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3112026-07-16T18:57:55.299ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3122026-07-16T18:57:55.304ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
3132026-07-16T18:57:55.307ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3142026-07-16T18:57:56.609ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3152026-07-16T18:57:56.614ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
3162026-07-16T18:57:56.617ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3172026-07-16T18:57:57.796ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3182026-07-16T18:57:57.800ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
3192026-07-16T18:57:57.804ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3202026-07-16T18:57:58.936ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3212026-07-16T18:57:58.941ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
3222026-07-16T18:57:58.943ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3232026-07-16T18:58:00.226ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3242026-07-16T18:58:00.231ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
3252026-07-16T18:58:00.235ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3262026-07-16T18:58:01.423ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3272026-07-16T18:58:01.428ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
3282026-07-16T18:58:01.431ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3292026-07-16T18:58:01.607ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
3302026-07-16T18:58:01.608ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 4 delay = 78.953754151s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
3312026-07-16T18:58:02.674ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 12222984305323455783 n_samples = 6 unit = oximeter
3322026-07-16T18:58:02.692ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3332026-07-16T18:58:02.697ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
3342026-07-16T18:58:02.700ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3352026-07-16T18:58:03.591ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 15602268034793116427 n_samples = 6 unit = oximeter
3362026-07-16T18:58:03.659ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3372026-07-16T18:58:03.664ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
3382026-07-16T18:58:03.667ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3392026-07-16T18:58:05.017ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3402026-07-16T18:58:05.022ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
3412026-07-16T18:58:05.025ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3422026-07-16T18:58:06.331ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3432026-07-16T18:58:06.337ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
3442026-07-16T18:58:06.340ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3452026-07-16T18:58:06.465ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("2049727f-cf1b-4d13-b592-d357e366a5e1.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("e9a338f1-192a-43d3-89dc-9093651641f2.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("f31eccc9-c7b6-4f2e-a74c-cba2a1576254.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("f31eccc9-c7b6-4f2e-a74c-cba2a1576254.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 763, tv_nsec: 49370365 } }) unit = producer-server
3462026-07-16T18:58:06.466ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
3472026-07-16T18:58:06.472ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
3482026-07-16T18:58:07.723ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3492026-07-16T18:58:07.727ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
3502026-07-16T18:58:07.731ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3512026-07-16T18:58:09.097ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3522026-07-16T18:58:09.102ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
3532026-07-16T18:58:09.105ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3542026-07-16T18:58:10.473ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3552026-07-16T18:58:10.479ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
3562026-07-16T18:58:10.482ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3572026-07-16T18:58:11.845ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3582026-07-16T18:58:11.849ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
3592026-07-16T18:58:11.853ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3602026-07-16T18:58:12.400ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3612026-07-16T18:58:12.405ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
3622026-07-16T18:58:12.408ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3632026-07-16T18:58:12.648ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 12222984305323455783 n_samples = 6 unit = oximeter
3642026-07-16T18:58:13.566ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 15602268034793116427 n_samples = 6 unit = oximeter
3652026-07-16T18:58:13.619ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3662026-07-16T18:58:13.624ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
3672026-07-16T18:58:13.627ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3682026-07-16T18:58:14.869ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3692026-07-16T18:58:14.874ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
3702026-07-16T18:58:14.877ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3712026-07-16T18:58:15.741ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3722026-07-16T18:58:15.746ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
3732026-07-16T18:58:15.749ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3742026-07-16T18:58:16.729ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3752026-07-16T18:58:16.734ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
3762026-07-16T18:58:16.737ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3772026-07-16T18:58:18.176ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3782026-07-16T18:58:18.182ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
3792026-07-16T18:58:18.185ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3802026-07-16T18:58:18.978ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3812026-07-16T18:58:18.982ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
3822026-07-16T18:58:18.985ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3832026-07-16T18:58:19.607ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3842026-07-16T18:58:19.611ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
3852026-07-16T18:58:19.614ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3862026-07-16T18:58:20.817ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3872026-07-16T18:58:20.822ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
3882026-07-16T18:58:20.825ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3892026-07-16T18:58:21.432ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
3902026-07-16T18:58:21.434ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 5 delay = 98.833567651s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
3912026-07-16T18:58:21.794ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3922026-07-16T18:58:21.798ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
3932026-07-16T18:58:21.802ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3942026-07-16T18:58:22.447ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3952026-07-16T18:58:22.451ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
3962026-07-16T18:58:22.454ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3972026-07-16T18:58:22.624ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 12222984305323455783 n_samples = 6 unit = oximeter
3982026-07-16T18:58:23.335ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3992026-07-16T18:58:23.341ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
4002026-07-16T18:58:23.344ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4012026-07-16T18:58:23.541ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 15602268034793116427 n_samples = 6 unit = oximeter
4022026-07-16T18:58:24.227ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4032026-07-16T18:58:24.232ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
4042026-07-16T18:58:24.235ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4052026-07-16T18:58:24.953ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4062026-07-16T18:58:24.957ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
4072026-07-16T18:58:24.960ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4082026-07-16T18:58:25.564ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4092026-07-16T18:58:25.569ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
4102026-07-16T18:58:25.572ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4112026-07-16T18:58:26.503ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4122026-07-16T18:58:26.508ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
4132026-07-16T18:58:26.510ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4142026-07-16T18:58:27.111ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4152026-07-16T18:58:27.117ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
4162026-07-16T18:58:27.119ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4172026-07-16T18:58:28.520ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4182026-07-16T18:58:28.525ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
4192026-07-16T18:58:28.528ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4202026-07-16T18:58:29.793ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4212026-07-16T18:58:29.797ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
4222026-07-16T18:58:29.800ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4232026-07-16T18:58:30.855ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4242026-07-16T18:58:30.860ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
4252026-07-16T18:58:30.863ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4262026-07-16T18:58:31.650ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("2049727f-cf1b-4d13-b592-d357e366a5e1.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("e9a338f1-192a-43d3-89dc-9093651641f2.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("f31eccc9-c7b6-4f2e-a74c-cba2a1576254.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("f31eccc9-c7b6-4f2e-a74c-cba2a1576254.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 788, tv_nsec: 302793801 } }) unit = producer-server
4272026-07-16T18:58:31.650ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
4282026-07-16T18:58:31.658ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
4292026-07-16T18:58:32.119ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4302026-07-16T18:58:32.123ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
4312026-07-16T18:58:32.126ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4322026-07-16T18:58:32.598ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 12222984305323455783 n_samples = 6 unit = oximeter
4332026-07-16T18:58:32.818ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4342026-07-16T18:58:32.823ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
4352026-07-16T18:58:32.826ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4362026-07-16T18:58:33.516ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 15602268034793116427 n_samples = 6 unit = oximeter
4372026-07-16T18:58:34.184ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4382026-07-16T18:58:34.190ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
4392026-07-16T18:58:34.193ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4402026-07-16T18:58:35.081ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4412026-07-16T18:58:35.086ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
4422026-07-16T18:58:35.089ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4432026-07-16T18:58:35.769ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4442026-07-16T18:58:35.773ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
4452026-07-16T18:58:35.777ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4462026-07-16T18:58:36.717ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4472026-07-16T18:58:36.722ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
4482026-07-16T18:58:36.725ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4492026-07-16T18:58:37.331ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4502026-07-16T18:58:37.336ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
4512026-07-16T18:58:37.340ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4522026-07-16T18:58:38.255ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4532026-07-16T18:58:38.260ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
4542026-07-16T18:58:38.263ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4552026-07-16T18:58:38.839ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4562026-07-16T18:58:38.844ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
4572026-07-16T18:58:38.846ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4582026-07-16T18:58:40.259ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4592026-07-16T18:58:40.264ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
4602026-07-16T18:58:40.267ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4612026-07-16T18:58:41.289ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4622026-07-16T18:58:41.293ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
4632026-07-16T18:58:41.296ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4642026-07-16T18:58:42.572ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 12222984305323455783 n_samples = 6 unit = oximeter
4652026-07-16T18:58:42.746ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4662026-07-16T18:58:42.752ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
4672026-07-16T18:58:42.756ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4682026-07-16T18:58:43.491ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 15602268034793116427 n_samples = 6 unit = oximeter
4692026-07-16T18:58:43.957ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4702026-07-16T18:58:43.961ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
4712026-07-16T18:58:43.964ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4722026-07-16T18:58:44.809ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4732026-07-16T18:58:44.814ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
4742026-07-16T18:58:44.817ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4752026-07-16T18:58:45.577ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4762026-07-16T18:58:45.581ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
4772026-07-16T18:58:45.584ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4782026-07-16T18:58:46.619ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
4792026-07-16T18:58:46.620ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 6 delay = 124.087620402s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
4802026-07-16T18:58:46.640ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4812026-07-16T18:58:46.645ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
4822026-07-16T18:58:46.648ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4832026-07-16T18:58:48.091ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4842026-07-16T18:58:48.096ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
4852026-07-16T18:58:48.099ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4862026-07-16T18:58:49.396ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4872026-07-16T18:58:49.401ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
4882026-07-16T18:58:49.404ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4892026-07-16T18:58:50.465ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4902026-07-16T18:58:50.471ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
4912026-07-16T18:58:50.475ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4922026-07-16T18:58:51.590ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4932026-07-16T18:58:51.595ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
4942026-07-16T18:58:51.599ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4952026-07-16T18:58:52.200ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4962026-07-16T18:58:52.206ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
4972026-07-16T18:58:52.208ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4982026-07-16T18:58:52.548ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 12222984305323455783 n_samples = 6 unit = oximeter
4992026-07-16T18:58:53.466ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 15602268034793116427 n_samples = 6 unit = oximeter
5002026-07-16T18:58:53.496ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5012026-07-16T18:58:53.504ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
5022026-07-16T18:58:53.515ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5032026-07-16T18:58:54.751ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5042026-07-16T18:58:54.759ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
5052026-07-16T18:58:54.763ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5062026-07-16T18:58:55.155ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("2049727f-cf1b-4d13-b592-d357e366a5e1.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("e9a338f1-192a-43d3-89dc-9093651641f2.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("f31eccc9-c7b6-4f2e-a74c-cba2a1576254.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("f31eccc9-c7b6-4f2e-a74c-cba2a1576254.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 811, tv_nsec: 867956919 } }) unit = producer-server
5072026-07-16T18:58:55.157ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
5082026-07-16T18:58:55.177ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
5092026-07-16T18:58:56.224ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5102026-07-16T18:58:56.236ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
5112026-07-16T18:58:56.243ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5122026-07-16T18:58:57.133ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5132026-07-16T18:58:57.137ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
5142026-07-16T18:58:57.141ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5152026-07-16T18:58:57.768ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5162026-07-16T18:58:57.773ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
5172026-07-16T18:58:57.776ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5182026-07-16T18:58:59.092ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5192026-07-16T18:58:59.098ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
5202026-07-16T18:58:59.101ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5212026-07-16T18:59:00.260ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5222026-07-16T18:59:00.265ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
5232026-07-16T18:59:00.268ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5242026-07-16T18:59:01.747ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5252026-07-16T18:59:01.752ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
5262026-07-16T18:59:01.755ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5272026-07-16T18:59:02.548ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 12222984305323455783 n_samples = 6 unit = oximeter
5282026-07-16T18:59:02.574ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5292026-07-16T18:59:02.580ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
5302026-07-16T18:59:02.584ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5312026-07-16T18:59:03.467ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 15602268034793116427 n_samples = 6 unit = oximeter
5322026-07-16T18:59:03.894ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5332026-07-16T18:59:03.900ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
5342026-07-16T18:59:03.904ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5352026-07-16T18:59:04.550ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5362026-07-16T18:59:04.557ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
5372026-07-16T18:59:04.560ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5382026-07-16T18:59:05.926ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5392026-07-16T18:59:05.931ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
5402026-07-16T18:59:05.934ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5412026-07-16T18:59:06.911ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5422026-07-16T18:59:06.916ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
5432026-07-16T18:59:06.919ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5442026-07-16T18:59:08.069ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5452026-07-16T18:59:08.074ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
5462026-07-16T18:59:08.076ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5472026-07-16T18:59:09.544ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5482026-07-16T18:59:09.549ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
5492026-07-16T18:59:09.552ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5502026-07-16T18:59:10.178ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
5512026-07-16T18:59:10.180ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 7 delay = 147.666161799s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
5522026-07-16T18:59:10.874ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5532026-07-16T18:59:10.879ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
5542026-07-16T18:59:10.882ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5552026-07-16T18:59:11.870ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5562026-07-16T18:59:11.874ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
5572026-07-16T18:59:11.877ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5582026-07-16T18:59:12.551ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 12222984305323455783 n_samples = 6 unit = oximeter
5592026-07-16T18:59:12.995ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5602026-07-16T18:59:13.001ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
5612026-07-16T18:59:13.004ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5622026-07-16T18:59:13.470ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 15602268034793116427 n_samples = 6 unit = oximeter
5632026-07-16T18:59:13.861ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5642026-07-16T18:59:13.867ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
5652026-07-16T18:59:13.871ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5662026-07-16T18:59:14.597ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5672026-07-16T18:59:14.603ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
5682026-07-16T18:59:14.607ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5692026-07-16T18:59:16.155ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5702026-07-16T18:59:16.170ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
5712026-07-16T18:59:16.176ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5722026-07-16T18:59:17.583ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5732026-07-16T18:59:17.591ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
5742026-07-16T18:59:17.596ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5752026-07-16T18:59:18.309ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5762026-07-16T18:59:18.312ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
5772026-07-16T18:59:18.316ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5782026-07-16T18:59:19.168ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5792026-07-16T18:59:19.174ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
5802026-07-16T18:59:19.178ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5812026-07-16T18:59:20.054ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5822026-07-16T18:59:20.059ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
5832026-07-16T18:59:20.063ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5842026-07-16T18:59:21.457ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5852026-07-16T18:59:21.462ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
5862026-07-16T18:59:21.465ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5872026-07-16T18:59:22.335ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5882026-07-16T18:59:22.341ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
5892026-07-16T18:59:22.345ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5902026-07-16T18:59:22.554ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 12222984305323455783 n_samples = 6 unit = oximeter
5912026-07-16T18:59:23.191ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5922026-07-16T18:59:23.197ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
5932026-07-16T18:59:23.201ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5942026-07-16T18:59:23.471ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 15602268034793116427 n_samples = 6 unit = oximeter
5952026-07-16T18:59:23.850ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5962026-07-16T18:59:23.855ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
5972026-07-16T18:59:23.859ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5982026-07-16T18:59:24.613ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5992026-07-16T18:59:24.620ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
6002026-07-16T18:59:24.624ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
6012026-07-16T18:59:25.456ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6022026-07-16T18:59:25.463ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
6032026-07-16T18:59:25.466ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
6042026-07-16T18:59:26.360ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6052026-07-16T18:59:26.366ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
6062026-07-16T18:59:26.370ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
6072026-07-16T18:59:27.294ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6082026-07-16T18:59:27.303ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
6092026-07-16T18:59:27.309ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
6102026-07-16T18:59:28.801ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6112026-07-16T18:59:28.818ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
6122026-07-16T18:59:28.830ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
6132026-07-16T18:59:35.028ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 12222984305323455783 n_samples = 6 unit = oximeter
6142026-07-16T18:59:35.051ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 15602268034793116427 n_samples = 6 unit = oximeter
6152026-07-16T18:59:35.213ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6162026-07-16T18:59:35.344ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
6172026-07-16T18:59:35.417ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
6182026-07-16T18:59:36.753ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6192026-07-16T18:59:36.760ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
6202026-07-16T18:59:36.765ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
6212026-07-16T18:59:37.318ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6222026-07-16T18:59:37.327ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
6232026-07-16T18:59:37.332ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
6242026-07-16T18:59:39.054ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6252026-07-16T18:59:39.077ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
6262026-07-16T18:59:39.082ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
6272026-07-16T18:59:40.629ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6282026-07-16T18:59:40.690ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
6292026-07-16T18:59:40.704ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
6302026-07-16T18:59:41.620ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6312026-07-16T18:59:41.628ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
6322026-07-16T18:59:41.633ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
6332026-07-16T18:59:42.330ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6342026-07-16T18:59:42.337ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
6352026-07-16T18:59:42.341ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
6362026-07-16T18:59:42.793ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("2049727f-cf1b-4d13-b592-d357e366a5e1.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("e9a338f1-192a-43d3-89dc-9093651641f2.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("f31eccc9-c7b6-4f2e-a74c-cba2a1576254.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("f31eccc9-c7b6-4f2e-a74c-cba2a1576254.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 859, tv_nsec: 503552204 } }) unit = producer-server
6372026-07-16T18:59:42.802ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
6382026-07-16T18:59:42.840ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
6392026-07-16T18:59:43.466ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6402026-07-16T18:59:43.473ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
6412026-07-16T18:59:43.477ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
6422026-07-16T18:59:44.201ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6432026-07-16T18:59:44.209ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
6442026-07-16T18:59:44.213ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
6452026-07-16T18:59:44.378ZINFOtfportd: removed stale NDP entry :fe80::847d:6cff:fe06:83ab->86:7d:6c:06:83:ab
6462026-07-16T18:59:45.053ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 12222984305323455783 n_samples = 6 unit = oximeter
6472026-07-16T18:59:45.054ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 15602268034793116427 n_samples = 6 unit = oximeter
6482026-07-16T18:59:45.055ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6492026-07-16T18:59:45.063ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
6502026-07-16T18:59:45.067ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
6512026-07-16T18:59:45.615ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::847d:6cff:fe06:83ab->86:7d:6c:06:83:ab interface = tfportrear0_0
6522026-07-16T18:59:46.581ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6532026-07-16T18:59:46.590ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
6542026-07-16T18:59:46.596ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
6552026-07-16T18:59:47.176ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6562026-07-16T18:59:47.192ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
6572026-07-16T18:59:47.196ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
6582026-07-16T18:59:48.535ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6592026-07-16T18:59:48.552ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
6602026-07-16T18:59:48.560ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
6612026-07-16T18:59:49.150ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6622026-07-16T18:59:49.159ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
6632026-07-16T18:59:49.164ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
6642026-07-16T18:59:49.939ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6652026-07-16T18:59:49.947ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
6662026-07-16T18:59:49.952ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
6672026-07-16T18:59:50.779ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6682026-07-16T18:59:50.787ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
6692026-07-16T18:59:50.791ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
6702026-07-16T18:59:51.996ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6712026-07-16T18:59:52.004ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
6722026-07-16T18:59:52.010ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
6732026-07-16T18:59:52.864ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6742026-07-16T18:59:52.872ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
6752026-07-16T18:59:52.876ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
6762026-07-16T18:59:53.454ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6772026-07-16T18:59:53.461ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
6782026-07-16T18:59:53.466ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
6792026-07-16T18:59:54.456ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6802026-07-16T18:59:54.464ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
6812026-07-16T18:59:54.470ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
6822026-07-16T18:59:55.056ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 12222984305323455783 n_samples = 6 unit = oximeter
6832026-07-16T18:59:55.057ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 15602268034793116427 n_samples = 6 unit = oximeter
6842026-07-16T18:59:55.694ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6852026-07-16T18:59:55.704ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
6862026-07-16T18:59:55.710ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
6872026-07-16T18:59:56.657ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6882026-07-16T18:59:56.671ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
6892026-07-16T18:59:56.677ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
6902026-07-16T18:59:57.845ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
6912026-07-16T18:59:57.849ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 8 delay = 195.335774485s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
6922026-07-16T18:59:58.173ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6932026-07-16T18:59:58.183ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
6942026-07-16T18:59:58.188ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
6952026-07-16T18:59:58.868ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6962026-07-16T18:59:58.885ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
6972026-07-16T18:59:58.889ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
6982026-07-16T18:59:59.960ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
6992026-07-16T18:59:59.967ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
7002026-07-16T18:59:59.970ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
7012026-07-16T19:00:00.632ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
7022026-07-16T19:00:00.639ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
7032026-07-16T19:00:00.643ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
7042026-07-16T19:00:01.941ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
7052026-07-16T19:00:01.949ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::9851:45ff:fe18:6e7]
7062026-07-16T19:00:01.954ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]