Max level shown:
1 [ May 27 20:57:35 Enabled. ]
2 [ May 27 20:57:35 Rereading configuration. ]
3 [ May 27 20:57:36 Rereading configuration. ]
4 [ May 27 20:57:47 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dendrite/bin/tfportd --sync-only &"). ]
5 [ May 27 20:57:47 Method "start" exited with status 0. ]
6 No non-localhost IPv6 addresses found in SMF properties
72026-05-27T20:57:47.722ZINFOtfportd: connecting to dpd host = [::1] port = 12224
82026-05-27T20:57:47.724ZINFOtfportd: connected to dpd running softnpu-50ed5312
92026-05-27T20:57:47.725ZINFOtfportd: running in sync-only mode
102026-05-27T20:57:47.725ZINFOtfportd: no non-localhost IPv6 listen address available, waiting for SMF update unit = oximeter
112026-05-27T20:57:47.727ZINFOtfportd: refreshing SMF config prior to waiting on signals unit = signal_handler
12 No non-localhost IPv6 addresses found in SMF properties
132026-05-27T20:57:47.728ZINFOtfportd: refreshed config: Config { log_file: None, log_format: Json, listen_addresses: [ [::1]:12231, ], pkt_source: None, dpd_host: "[::1]", dpd_port: 12224, vlan_link: None, vlan_data: None, techport0_prefix: None, techport1_prefix: None, rack_id: Some( 1c09455f-73f3-4a3b-8d94-e9b27695a2ba, ), sled_id: Some( ccc7c00d-c7d2-469d-94c4-08d24f726a2e, ), sled_model: Some( "i86pc", ), sled_revision: Some( 0, ), sled_serial: Some( "sock", ), }
142026-05-27T20:57:47.728ZINFOtfportd: no non-localhost IPv6 listen address available, waiting for SMF update unit = oximeter
152026-05-27T20:57:47.734ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::3c4f:8ff:fe11:2346->3e:4f:08:11:23:46 interface = tfportrear0_0
162026-05-27T20:57:47.735ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
172026-05-27T20:57:47.741ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
182026-05-27T20:57:47.747ZWARNtfportd: tfportqsfp0_0 has no addrs
19 [ May 27 20:57:48 Rereading configuration. ]
20 [ May 27 20:57:48 Executing refresh method (:kill). ]
21 [ May 27 20:57:48 Stopping because all processes in service exited. ]
22 [ May 27 20:57:48 Executing stop method (:kill). ]
23 [ May 27 20:57:48 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dendrite/bin/tfportd --sync-only &"). ]
24 [ May 27 20:57:48 Method "start" exited with status 0. ]
252026-05-27T20:57:48.428ZINFOtfportd: connecting to dpd host = [::1] port = 12224
262026-05-27T20:57:48.429ZINFOtfportd: connected to dpd running softnpu-50ed5312
272026-05-27T20:57:48.430ZINFOtfportd: running in sync-only mode
282026-05-27T20:57:48.430ZINFOtfportd: found suitable IPv6 address for oximeter producer server address = fd00:1122:3344:101::2 unit = oximeter
292026-05-27T20:57:48.432ZINFOtfportd: refreshing SMF config prior to waiting on signals unit = signal_handler
302026-05-27T20:57:48.432ZDEBGtfportd: extracted oximeter configuration data config = OximeterConfig { listen_address: fd00:1122:3344:101::2, sled_identifiers: SledIdentifiers { rack_id: 1c09455f-73f3-4a3b-8d94-e9b27695a2ba, sled_id: ccc7c00d-c7d2-469d-94c4-08d24f726a2e, model: "i86pc", revision: 0, serial: "sock" }, switch_identifiers: SwitchIdentifiers { asic_backend: "softnpu", fab: None, fuse: Some(FuseData { chip_rev: ChipRevision { device_id: 272, rev: "B1", rev_num: 2 }, disabled: DisabledFeatures { bsync: false, mau: [0, 0, 0, 0], pgen: false, pipes: 0, ports: 0, resub: false, speeds: 0, tm_mem: 0 }, frequency: FrequencySettings { bps: 3, bps_ext: 0, cpu_speed_dis: 0, disabled: false, pcie_dis: 0, pps: 3, pps_ext: 0 }, manufacturing: ManufacturingData { core_repair: false, die_rotation: false, pmro_and_skew: 0, silent_spin: 0, soft_pipe_dis: 0, tile_repair: false, voltage_scaling: 0, wf_core_repair: false }, part: PartInfo { part_num: 4660, pkg_id: 1, version: 2 } }), lot: None, lotnum: None, model: "FAKE_SIM_SIDECAR", revision: 0, serial: "SimSidecar0", sidecar_id: 537f6ae0-2d92-4ffc-b21e-bcba041f2614, slot: 0, wafer: None, wafer_loc: None } } unit = oximeter
312026-05-27T20:57:48.432ZDEBGtfportd: created producer ID producer_id = 83b1efb2-99b3-435a-ab4e-5dda3df8ee80 unit = oximeter
322026-05-27T20:57:48.433ZINFOtfportd: refreshed config: Config { log_file: None, log_format: Json, listen_addresses: [ [fd00:1122:3344:101::2]:12231, [::1]:12231, ], pkt_source: None, dpd_host: "[::1]", dpd_port: 12224, vlan_link: None, vlan_data: None, techport0_prefix: None, techport1_prefix: None, rack_id: Some( 1c09455f-73f3-4a3b-8d94-e9b27695a2ba, ), sled_id: Some( ccc7c00d-c7d2-469d-94c4-08d24f726a2e, ), sled_model: Some( "i86pc", ), sled_revision: Some( 0, ), sled_serial: Some( "sock", ), }
332026-05-27T20:57:48.441ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
342026-05-27T20:57:48.442ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::10cb:66ff:fe8b:39fc->12:cb:66:8b:39:fc interface = tfportrear0_0
352026-05-27T20:57:48.442ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::3c4f:8ff:fe11:2346->3e:4f:08:11:23:46 interface = tfportrear0_0
362026-05-27T20:57:48.444ZDEBGtfportd: registered DTrace probes unit = producer-server
372026-05-27T20:57:48.445ZDEBGtfportd (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::2]:63112 method = GET path = /{producer_id} unit = producer-server versions = all
382026-05-27T20:57:48.445ZINFOtfportd (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:328 local_addr = [fd00:1122:3344:101::2]:63112 unit = producer-server
392026-05-27T20:57:48.446ZDEBGtfportd (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::2]:63112 unit = producer-server
402026-05-27T20:57:48.446ZDEBGtfportd: Requested any available port, Dropshot server has been bound to [fd00:1122:3344:101::2]:63112 unit = producer-server
412026-05-27T20:57:48.446ZDEBGtfportd: Nexus IP not provided, will use DNS to resolve it unit = producer-server
422026-05-27T20:57:48.446ZINFOtfportd (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/internal-dns/resolver/src/resolver.rs:144 unit = producer-server
432026-05-27T20:57:48.446ZDEBGtfportd: starting producer registration task unit = producer-server
442026-05-27T20:57:48.446ZINFOtfportd: starting oximeter metric producer server address = [fd00:1122:3344:101::2]:63112 file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:279 interval = 30s producer_id = 83b1efb2-99b3-435a-ab4e-5dda3df8ee80 unit = producer-server
452026-05-27T20:57:48.446ZINFOtfportd: created oximeter producer server unit = oximeter
462026-05-27T20:57:48.446ZDEBGtfportd (producer-registration-task): registering as oximeter producer with Nexus registration_count = 0 unit = producer-server
472026-05-27T20:57:48.447ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
482026-05-27T20:57:48.447ZDEBGtfportd (kstat-sampler): adding new target unit = oximeter
492026-05-27T20:57:48.448ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("44cb9ec0-dc86-4fc8-b845-9f7a3f3236cb.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("816dd9ca-b0e8-4c88-8f90-0565f3cfdf4c.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("9896502c-ee75-44fe-a03d-86a8ef5b60e5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("9896502c-ee75-44fe-a03d-86a8ef5b60e5.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 1902, tv_nsec: 401000275 } }) unit = producer-server
502026-05-27T20:57:48.449ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::a]:12221 unit = producer-server
512026-05-27T20:57:48.449ZDEBGtfportd (kstat-sampler-worker): storing new creation time for tracked target creation_time = 2026-05-27T20:57:31.525186062Z path = KstatPath { module: "link", instance: 0, name: "tfportrear0_0" } unit = oximeter
522026-05-27T20:57:48.449ZDEBGtfportd (kstat-sampler-worker): inserted empty per-target sample queue id = 16557448763549970901 unit = oximeter
532026-05-27T20:57:48.449ZDEBGtfportd: added new link to kstat sampler link_kind = switch-port-control link_name = tfportrear0_0 unit = metrics-task-tracker
542026-05-27T20:57:48.450ZWARNtfportd: tfportqsfp0_0 has no addrs
552026-05-27T20:57:48.466ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
562026-05-27T20:57:49.174ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
572026-05-27T20:57:49.179ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
582026-05-27T20:57:49.183ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
592026-05-27T20:57:49.183ZDEBGtfportd (kstat-sampler): adding new target unit = oximeter
602026-05-27T20:57:49.184ZDEBGtfportd (kstat-sampler-worker): storing new creation time for tracked target creation_time = 2026-05-27T20:57:31.525051578Z path = KstatPath { module: "link", instance: 0, name: "tfportqsfp0_0" } unit = oximeter
612026-05-27T20:57:49.184ZDEBGtfportd (kstat-sampler-worker): inserted empty per-target sample queue id = 10188888426859422521 unit = oximeter
622026-05-27T20:57:49.184ZDEBGtfportd: added new link to kstat sampler link_kind = switch-port-control link_name = tfportqsfp0_0 unit = metrics-task-tracker
632026-05-27T20:57:49.505ZINFOtfportd: added new ARP entry entry = 10.151.2.174->8a:54:9f:58:3f:30 interface = tfportqsfp0_0
642026-05-27T20:57:50.131ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
652026-05-27T20:57:50.135ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
662026-05-27T20:57:50.138ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
672026-05-27T20:57:51.403ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
682026-05-27T20:57:51.406ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
692026-05-27T20:57:51.409ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
702026-05-27T20:57:52.150ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
712026-05-27T20:57:52.155ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
722026-05-27T20:57:52.158ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
732026-05-27T20:57:53.369ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
742026-05-27T20:57:53.373ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
752026-05-27T20:57:53.377ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
762026-05-27T20:57:54.504ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
772026-05-27T20:57:54.509ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
782026-05-27T20:57:54.513ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
792026-05-27T20:57:55.666ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
802026-05-27T20:57:55.671ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
812026-05-27T20:57:55.675ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
822026-05-27T20:57:56.466ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
832026-05-27T20:57:56.471ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
842026-05-27T20:57:56.474ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
852026-05-27T20:57:57.056ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
862026-05-27T20:57:57.061ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
872026-05-27T20:57:57.064ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
882026-05-27T20:57:58.453ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 16557448763549970901 n_samples = 6 unit = oximeter
892026-05-27T20:57:58.469ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
902026-05-27T20:57:58.474ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
912026-05-27T20:57:58.477ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
922026-05-27T20:57:59.186ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10188888426859422521 n_samples = 6 unit = oximeter
932026-05-27T20:57:59.977ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
942026-05-27T20:57:59.982ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
952026-05-27T20:57:59.985ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
962026-05-27T20:58:01.344ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
972026-05-27T20:58:01.348ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
982026-05-27T20:58:01.352ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
992026-05-27T20:58:02.135ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1002026-05-27T20:58:02.141ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
1012026-05-27T20:58:02.144ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1022026-05-27T20:58:03.091ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1032026-05-27T20:58:03.096ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
1042026-05-27T20:58:03.100ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1052026-05-27T20:58:03.370ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", source: TimedOut }) unit = producer-server
1062026-05-27T20:58:03.371ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 0 delay = 15.022707016s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
1072026-05-27T20:58:03.648ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("44cb9ec0-dc86-4fc8-b845-9f7a3f3236cb.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("816dd9ca-b0e8-4c88-8f90-0565f3cfdf4c.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("9896502c-ee75-44fe-a03d-86a8ef5b60e5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("9896502c-ee75-44fe-a03d-86a8ef5b60e5.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 1917, tv_nsec: 699293393 } }) unit = producer-server
1082026-05-27T20:58:03.649ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::a]:12221 unit = producer-server
1092026-05-27T20:58:03.655ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
1102026-05-27T20:58:04.425ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1112026-05-27T20:58:04.429ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
1122026-05-27T20:58:04.433ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1132026-05-27T20:58:05.261ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1142026-05-27T20:58:05.265ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
1152026-05-27T20:58:05.268ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1162026-05-27T20:58:06.658ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1172026-05-27T20:58:06.663ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
1182026-05-27T20:58:06.666ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1192026-05-27T20:58:07.371ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1202026-05-27T20:58:07.376ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
1212026-05-27T20:58:07.379ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1222026-05-27T20:58:08.104ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1232026-05-27T20:58:08.108ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
1242026-05-27T20:58:08.111ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1252026-05-27T20:58:08.652ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 16557448763549970901 n_samples = 6 unit = oximeter
1262026-05-27T20:58:08.664ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1272026-05-27T20:58:08.669ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
1282026-05-27T20:58:08.672ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1292026-05-27T20:58:09.193ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1302026-05-27T20:58:09.197ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
1312026-05-27T20:58:09.201ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1322026-05-27T20:58:09.384ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10188888426859422521 n_samples = 6 unit = oximeter
1332026-05-27T20:58:10.445ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1342026-05-27T20:58:10.450ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
1352026-05-27T20:58:10.453ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1362026-05-27T20:58:10.974ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1372026-05-27T20:58:10.979ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
1382026-05-27T20:58:10.982ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1392026-05-27T20:58:12.207ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1402026-05-27T20:58:12.212ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
1412026-05-27T20:58:12.215ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1422026-05-27T20:58:13.366ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1432026-05-27T20:58:13.371ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
1442026-05-27T20:58:13.374ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1452026-05-27T20:58:14.414ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1462026-05-27T20:58:14.419ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
1472026-05-27T20:58:14.422ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1482026-05-27T20:58:14.989ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1492026-05-27T20:58:14.994ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
1502026-05-27T20:58:14.997ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1512026-05-27T20:58:15.748ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1522026-05-27T20:58:15.753ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
1532026-05-27T20:58:15.756ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1542026-05-27T20:58:16.587ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1552026-05-27T20:58:16.590ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
1562026-05-27T20:58:16.594ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1572026-05-27T20:58:17.416ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1582026-05-27T20:58:17.421ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
1592026-05-27T20:58:17.424ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1602026-05-27T20:58:18.043ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1612026-05-27T20:58:18.048ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
1622026-05-27T20:58:18.051ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1632026-05-27T20:58:18.627ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 16557448763549970901 n_samples = 6 unit = oximeter
1642026-05-27T20:58:18.923ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", source: TimedOut }) unit = producer-server
1652026-05-27T20:58:18.924ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 1 delay = 30.308365373s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
1662026-05-27T20:58:19.359ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10188888426859422521 n_samples = 6 unit = oximeter
1672026-05-27T20:58:19.472ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("44cb9ec0-dc86-4fc8-b845-9f7a3f3236cb.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("816dd9ca-b0e8-4c88-8f90-0565f3cfdf4c.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("9896502c-ee75-44fe-a03d-86a8ef5b60e5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("9896502c-ee75-44fe-a03d-86a8ef5b60e5.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 1933, tv_nsec: 257411118 } }) unit = producer-server
1682026-05-27T20:58:19.473ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::a]:12221 unit = producer-server
1692026-05-27T20:58:19.481ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
1702026-05-27T20:58:19.481ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1712026-05-27T20:58:19.486ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
1722026-05-27T20:58:19.489ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1732026-05-27T20:58:20.129ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1742026-05-27T20:58:20.134ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
1752026-05-27T20:58:20.137ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1762026-05-27T20:58:21.337ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1772026-05-27T20:58:21.341ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
1782026-05-27T20:58:21.345ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1792026-05-27T20:58:22.099ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1802026-05-27T20:58:22.110ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
1812026-05-27T20:58:22.113ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1822026-05-27T20:58:23.225ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1832026-05-27T20:58:23.230ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
1842026-05-27T20:58:23.233ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1852026-05-27T20:58:24.181ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1862026-05-27T20:58:24.185ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
1872026-05-27T20:58:24.188ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1882026-05-27T20:58:24.824ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1892026-05-27T20:58:24.829ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
1902026-05-27T20:58:24.832ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1912026-05-27T20:58:26.025ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1922026-05-27T20:58:26.030ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
1932026-05-27T20:58:26.033ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1942026-05-27T20:58:26.795ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1952026-05-27T20:58:26.800ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
1962026-05-27T20:58:26.803ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1972026-05-27T20:58:27.682ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1982026-05-27T20:58:27.687ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
1992026-05-27T20:58:27.691ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2002026-05-27T20:58:28.426ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2012026-05-27T20:58:28.431ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
2022026-05-27T20:58:28.433ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2032026-05-27T20:58:28.602ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 16557448763549970901 n_samples = 6 unit = oximeter
2042026-05-27T20:58:29.333ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10188888426859422521 n_samples = 6 unit = oximeter
2052026-05-27T20:58:29.345ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2062026-05-27T20:58:29.349ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
2072026-05-27T20:58:29.353ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2082026-05-27T20:58:30.341ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2092026-05-27T20:58:30.346ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
2102026-05-27T20:58:30.349ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2112026-05-27T20:58:31.649ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2122026-05-27T20:58:31.654ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
2132026-05-27T20:58:31.657ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2142026-05-27T20:58:32.650ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2152026-05-27T20:58:32.655ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
2162026-05-27T20:58:32.658ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2172026-05-27T20:58:33.418ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2182026-05-27T20:58:33.422ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
2192026-05-27T20:58:33.426ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2202026-05-27T20:58:34.440ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", source: TimedOut }) unit = producer-server
2212026-05-27T20:58:34.441ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 2 delay = 45.867651457s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
2222026-05-27T20:58:34.520ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2232026-05-27T20:58:34.524ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
2242026-05-27T20:58:34.526ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2252026-05-27T20:58:35.159ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("44cb9ec0-dc86-4fc8-b845-9f7a3f3236cb.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("816dd9ca-b0e8-4c88-8f90-0565f3cfdf4c.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("9896502c-ee75-44fe-a03d-86a8ef5b60e5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("9896502c-ee75-44fe-a03d-86a8ef5b60e5.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 1948, tv_nsec: 987382653 } }) unit = producer-server
2262026-05-27T20:58:35.160ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::a]:12221 unit = producer-server
2272026-05-27T20:58:35.166ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
2282026-05-27T20:58:35.166ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2292026-05-27T20:58:35.172ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
2302026-05-27T20:58:35.180ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2312026-05-27T20:58:36.359ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2322026-05-27T20:58:36.363ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
2332026-05-27T20:58:36.367ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2342026-05-27T20:58:37.342ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2352026-05-27T20:58:37.346ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
2362026-05-27T20:58:37.349ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2372026-05-27T20:58:38.576ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 16557448763549970901 n_samples = 6 unit = oximeter
2382026-05-27T20:58:38.588ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2392026-05-27T20:58:38.593ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
2402026-05-27T20:58:38.596ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2412026-05-27T20:58:39.308ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10188888426859422521 n_samples = 6 unit = oximeter
2422026-05-27T20:58:39.815ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2432026-05-27T20:58:39.819ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
2442026-05-27T20:58:39.822ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2452026-05-27T20:58:40.843ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2462026-05-27T20:58:40.847ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
2472026-05-27T20:58:40.850ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2482026-05-27T20:58:41.832ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2492026-05-27T20:58:41.836ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
2502026-05-27T20:58:41.839ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2512026-05-27T20:58:43.041ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2522026-05-27T20:58:43.046ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
2532026-05-27T20:58:43.049ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2542026-05-27T20:58:44.176ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2552026-05-27T20:58:44.180ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
2562026-05-27T20:58:44.183ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2572026-05-27T20:58:45.257ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2582026-05-27T20:58:45.261ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
2592026-05-27T20:58:45.265ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2602026-05-27T20:58:46.410ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2612026-05-27T20:58:46.414ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
2622026-05-27T20:58:46.418ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2632026-05-27T20:58:47.137ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2642026-05-27T20:58:47.142ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
2652026-05-27T20:58:47.145ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2662026-05-27T20:58:48.261ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2672026-05-27T20:58:48.266ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
2682026-05-27T20:58:48.269ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2692026-05-27T20:58:48.551ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 16557448763549970901 n_samples = 6 unit = oximeter
2702026-05-27T20:58:49.283ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10188888426859422521 n_samples = 6 unit = oximeter
2712026-05-27T20:58:49.466ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2722026-05-27T20:58:49.470ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
2732026-05-27T20:58:49.474ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2742026-05-27T20:58:50.126ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", source: TimedOut }) unit = producer-server
2752026-05-27T20:58:50.128ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 3 delay = 61.597237959s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
2762026-05-27T20:58:50.805ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2772026-05-27T20:58:50.810ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
2782026-05-27T20:58:50.813ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2792026-05-27T20:58:51.381ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("44cb9ec0-dc86-4fc8-b845-9f7a3f3236cb.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("816dd9ca-b0e8-4c88-8f90-0565f3cfdf4c.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("9896502c-ee75-44fe-a03d-86a8ef5b60e5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("9896502c-ee75-44fe-a03d-86a8ef5b60e5.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 1965, tv_nsec: 253497092 } }) unit = producer-server
2802026-05-27T20:58:51.381ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::a]:12221 unit = producer-server
2812026-05-27T20:58:51.388ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
2822026-05-27T20:58:51.600ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2832026-05-27T20:58:51.604ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
2842026-05-27T20:58:51.607ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2852026-05-27T20:58:52.255ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2862026-05-27T20:58:52.260ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
2872026-05-27T20:58:52.263ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2882026-05-27T20:58:53.748ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2892026-05-27T20:58:53.753ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
2902026-05-27T20:58:53.756ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2912026-05-27T20:58:55.132ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2922026-05-27T20:58:55.136ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
2932026-05-27T20:58:55.139ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2942026-05-27T20:58:56.122ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2952026-05-27T20:58:56.127ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
2962026-05-27T20:58:56.130ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2972026-05-27T20:58:57.239ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2982026-05-27T20:58:57.243ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
2992026-05-27T20:58:57.246ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3002026-05-27T20:58:58.287ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3012026-05-27T20:58:58.292ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
3022026-05-27T20:58:58.294ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3032026-05-27T20:58:58.526ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 16557448763549970901 n_samples = 6 unit = oximeter
3042026-05-27T20:58:59.258ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10188888426859422521 n_samples = 6 unit = oximeter
3052026-05-27T20:58:59.716ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3062026-05-27T20:58:59.721ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
3072026-05-27T20:58:59.724ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3082026-05-27T20:59:00.817ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3092026-05-27T20:59:00.821ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
3102026-05-27T20:59:00.824ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3112026-05-27T20:59:02.211ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3122026-05-27T20:59:02.217ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
3132026-05-27T20:59:02.220ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3142026-05-27T20:59:03.526ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3152026-05-27T20:59:03.531ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
3162026-05-27T20:59:03.533ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3172026-05-27T20:59:04.242ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3182026-05-27T20:59:04.246ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
3192026-05-27T20:59:04.249ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3202026-05-27T20:59:05.310ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3212026-05-27T20:59:05.314ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
3222026-05-27T20:59:05.317ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3232026-05-27T20:59:06.348ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", source: TimedOut }) unit = producer-server
3242026-05-27T20:59:06.350ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 4 delay = 77.863366628s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
3252026-05-27T20:59:06.469ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3262026-05-27T20:59:06.475ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
3272026-05-27T20:59:06.478ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3282026-05-27T20:59:07.372ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3292026-05-27T20:59:07.376ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
3302026-05-27T20:59:07.380ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3312026-05-27T20:59:08.452ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3322026-05-27T20:59:08.457ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
3332026-05-27T20:59:08.461ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3342026-05-27T20:59:08.500ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 16557448763549970901 n_samples = 6 unit = oximeter
3352026-05-27T20:59:09.232ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10188888426859422521 n_samples = 6 unit = oximeter
3362026-05-27T20:59:09.552ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("44cb9ec0-dc86-4fc8-b845-9f7a3f3236cb.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("816dd9ca-b0e8-4c88-8f90-0565f3cfdf4c.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("9896502c-ee75-44fe-a03d-86a8ef5b60e5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("9896502c-ee75-44fe-a03d-86a8ef5b60e5.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 1983, tv_nsec: 474488303 } }) unit = producer-server
3372026-05-27T20:59:09.553ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::a]:12221 unit = producer-server
3382026-05-27T20:59:09.561ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
3392026-05-27T20:59:09.787ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3402026-05-27T20:59:09.792ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
3412026-05-27T20:59:09.795ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3422026-05-27T20:59:10.657ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3432026-05-27T20:59:10.662ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
3442026-05-27T20:59:10.665ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3452026-05-27T20:59:11.520ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3462026-05-27T20:59:11.524ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
3472026-05-27T20:59:11.528ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3482026-05-27T20:59:12.522ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3492026-05-27T20:59:12.527ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
3502026-05-27T20:59:12.530ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3512026-05-27T20:59:13.479ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3522026-05-27T20:59:13.485ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
3532026-05-27T20:59:13.487ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3542026-05-27T20:59:14.179ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3552026-05-27T20:59:14.184ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
3562026-05-27T20:59:14.186ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3572026-05-27T20:59:15.081ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3582026-05-27T20:59:15.085ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
3592026-05-27T20:59:15.088ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3602026-05-27T20:59:16.014ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3612026-05-27T20:59:16.019ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
3622026-05-27T20:59:16.022ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3632026-05-27T20:59:16.716ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3642026-05-27T20:59:16.721ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
3652026-05-27T20:59:16.724ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3662026-05-27T20:59:17.686ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3672026-05-27T20:59:17.692ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
3682026-05-27T20:59:17.695ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3692026-05-27T20:59:18.475ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 16557448763549970901 n_samples = 6 unit = oximeter
3702026-05-27T20:59:19.000ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3712026-05-27T20:59:19.004ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
3722026-05-27T20:59:19.007ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3732026-05-27T20:59:19.206ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10188888426859422521 n_samples = 6 unit = oximeter
3742026-05-27T20:59:20.317ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3752026-05-27T20:59:20.322ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
3762026-05-27T20:59:20.326ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3772026-05-27T20:59:21.044ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3782026-05-27T20:59:21.048ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
3792026-05-27T20:59:21.051ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3802026-05-27T20:59:21.808ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3812026-05-27T20:59:21.813ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
3822026-05-27T20:59:21.816ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3832026-05-27T20:59:22.822ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3842026-05-27T20:59:22.827ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
3852026-05-27T20:59:22.831ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3862026-05-27T20:59:24.098ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3872026-05-27T20:59:24.103ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
3882026-05-27T20:59:24.107ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3892026-05-27T20:59:24.520ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", source: TimedOut }) unit = producer-server
3902026-05-27T20:59:24.522ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 5 delay = 96.085072593s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
3912026-05-27T20:59:25.497ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3922026-05-27T20:59:25.502ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
3932026-05-27T20:59:25.505ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3942026-05-27T20:59:26.272ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3952026-05-27T20:59:26.276ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
3962026-05-27T20:59:26.280ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3972026-05-27T20:59:27.731ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3982026-05-27T20:59:27.735ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
3992026-05-27T20:59:27.738ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4002026-05-27T20:59:28.450ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 16557448763549970901 n_samples = 6 unit = oximeter
4012026-05-27T20:59:28.589ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4022026-05-27T20:59:28.592ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
4032026-05-27T20:59:28.595ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4042026-05-27T20:59:29.184ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10188888426859422521 n_samples = 6 unit = oximeter
4052026-05-27T20:59:29.557ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4062026-05-27T20:59:29.561ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
4072026-05-27T20:59:29.565ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4082026-05-27T20:59:29.745ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("44cb9ec0-dc86-4fc8-b845-9f7a3f3236cb.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("816dd9ca-b0e8-4c88-8f90-0565f3cfdf4c.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("9896502c-ee75-44fe-a03d-86a8ef5b60e5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("9896502c-ee75-44fe-a03d-86a8ef5b60e5.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 2003, tv_nsec: 723013644 } }) unit = producer-server
4092026-05-27T20:59:29.746ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::a]:12221 unit = producer-server
4102026-05-27T20:59:29.753ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
4112026-05-27T20:59:31.060ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4122026-05-27T20:59:31.064ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
4132026-05-27T20:59:31.068ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4142026-05-27T20:59:32.073ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4152026-05-27T20:59:32.076ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
4162026-05-27T20:59:32.080ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4172026-05-27T20:59:32.714ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4182026-05-27T20:59:32.719ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
4192026-05-27T20:59:32.722ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4202026-05-27T20:59:33.372ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4212026-05-27T20:59:33.376ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
4222026-05-27T20:59:33.379ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4232026-05-27T20:59:34.354ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4242026-05-27T20:59:34.358ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
4252026-05-27T20:59:34.361ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4262026-05-27T20:59:35.367ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4272026-05-27T20:59:35.371ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
4282026-05-27T20:59:35.375ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4292026-05-27T20:59:35.897ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4302026-05-27T20:59:35.902ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
4312026-05-27T20:59:35.905ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4322026-05-27T20:59:37.320ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4332026-05-27T20:59:37.325ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
4342026-05-27T20:59:37.328ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4352026-05-27T20:59:38.187ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4362026-05-27T20:59:38.192ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
4372026-05-27T20:59:38.195ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4382026-05-27T20:59:38.424ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 16557448763549970901 n_samples = 6 unit = oximeter
4392026-05-27T20:59:38.798ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4402026-05-27T20:59:38.803ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
4412026-05-27T20:59:38.806ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4422026-05-27T20:59:39.158ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10188888426859422521 n_samples = 6 unit = oximeter
4432026-05-27T20:59:39.886ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4442026-05-27T20:59:39.892ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
4452026-05-27T20:59:39.895ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4462026-05-27T20:59:41.258ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4472026-05-27T20:59:41.263ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
4482026-05-27T20:59:41.266ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4492026-05-27T20:59:42.052ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4502026-05-27T20:59:42.057ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
4512026-05-27T20:59:42.060ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4522026-05-27T20:59:42.719ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4532026-05-27T20:59:42.724ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
4542026-05-27T20:59:42.728ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4552026-05-27T20:59:43.435ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4562026-05-27T20:59:43.440ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
4572026-05-27T20:59:43.443ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4582026-05-27T20:59:43.981ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4592026-05-27T20:59:43.985ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
4602026-05-27T20:59:43.988ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4612026-05-27T20:59:44.713ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", source: TimedOut }) unit = producer-server
4622026-05-27T20:59:44.714ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 6 delay = 116.332908102s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
4632026-05-27T20:59:44.774ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4642026-05-27T20:59:44.779ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
4652026-05-27T20:59:44.783ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4662026-05-27T20:59:45.969ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4672026-05-27T20:59:45.974ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
4682026-05-27T20:59:45.977ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4692026-05-27T20:59:46.896ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4702026-05-27T20:59:46.901ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
4712026-05-27T20:59:46.905ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4722026-05-27T20:59:47.455ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4732026-05-27T20:59:47.459ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
4742026-05-27T20:59:47.462ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4752026-05-27T20:59:48.399ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 16557448763549970901 n_samples = 6 unit = oximeter
4762026-05-27T20:59:48.712ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4772026-05-27T20:59:48.717ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
4782026-05-27T20:59:48.720ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4792026-05-27T20:59:49.133ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10188888426859422521 n_samples = 6 unit = oximeter
4802026-05-27T20:59:49.582ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4812026-05-27T20:59:49.587ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
4822026-05-27T20:59:49.590ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4832026-05-27T20:59:51.035ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4842026-05-27T20:59:51.041ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
4852026-05-27T20:59:51.044ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4862026-05-27T20:59:52.018ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4872026-05-27T20:59:52.023ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
4882026-05-27T20:59:52.026ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4892026-05-27T20:59:52.858ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4902026-05-27T20:59:52.862ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
4912026-05-27T20:59:52.866ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4922026-05-27T20:59:54.125ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4932026-05-27T20:59:54.130ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
4942026-05-27T20:59:54.134ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4952026-05-27T20:59:54.663ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4962026-05-27T20:59:54.667ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
4972026-05-27T20:59:54.671ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4982026-05-27T20:59:55.515ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4992026-05-27T20:59:55.519ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
5002026-05-27T20:59:55.522ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5012026-05-27T20:59:56.035ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5022026-05-27T20:59:56.039ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
5032026-05-27T20:59:56.042ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5042026-05-27T20:59:56.617ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5052026-05-27T20:59:56.621ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
5062026-05-27T20:59:56.625ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5072026-05-27T20:59:57.718ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5082026-05-27T20:59:57.722ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
5092026-05-27T20:59:57.726ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5102026-05-27T20:59:58.374ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 16557448763549970901 n_samples = 6 unit = oximeter
5112026-05-27T20:59:58.414ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5122026-05-27T20:59:58.419ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
5132026-05-27T20:59:58.423ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5142026-05-27T20:59:58.965ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5152026-05-27T20:59:58.970ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
5162026-05-27T20:59:58.974ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5172026-05-27T20:59:59.108ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10188888426859422521 n_samples = 6 unit = oximeter
5182026-05-27T20:59:59.147ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("44cb9ec0-dc86-4fc8-b845-9f7a3f3236cb.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("816dd9ca-b0e8-4c88-8f90-0565f3cfdf4c.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("9896502c-ee75-44fe-a03d-86a8ef5b60e5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("9896502c-ee75-44fe-a03d-86a8ef5b60e5.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 2033, tv_nsec: 205120018 } }) unit = producer-server
5192026-05-27T20:59:59.148ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::a]:12221 unit = producer-server
5202026-05-27T20:59:59.156ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
5212026-05-27T20:59:59.558ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5222026-05-27T20:59:59.563ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
5232026-05-27T20:59:59.567ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5242026-05-27T21:00:00.706ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5252026-05-27T21:00:00.710ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::3c4f:8ff:fe11:2346]
5262026-05-27T21:00:00.713ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]