Max level shown:
1 [ May 20 20:39:12 Enabled. ]
2 [ May 20 20:39:12 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ May 20 20:39:12 Method "start" exited with status 0. ]
4 [ May 20 20:39:12 Rereading configuration. ]
5 [ May 20 20:39:12 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72024-05-20T20:39:12.850ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:163
82024-05-20T20:39:12.850ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92024-05-20T20:39:12.902ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102024-05-20T20:39:12.902ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112024-05-20T20:39:13.015ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122024-05-20T20:39:13.025ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132024-05-20T20:39:13.032ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142024-05-20T20:39:13.634ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:87 prefix = Ipv6Prefix { addr: fdb0:18c0:4d0d:a02a::, len: 64 }
152024-05-20T20:39:13.770ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:119
162024-05-20T20:39:13.770ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:131
172024-05-20T20:39:13.770ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:141
182024-05-20T20:39:13.770ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:162 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192024-05-20T20:39:13.770ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:506
202024-05-20T20:39:13.771ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:625
212024-05-20T20:39:13.773ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "sock", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:535
222024-05-20T20:39:13.773ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:674
232024-05-20T20:39:13.773ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:176
242024-05-20T20:39:13.773ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:733
252024-05-20T20:39:13.773ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/m2_0.vdev
262024-05-20T20:39:13.774ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:262 underlay_network_info = None
272024-05-20T20:39:13.774ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024 }), tx: ... } file = sled-storage/src/manager.rs:381
282024-05-20T20:39:13.774ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292024-05-20T20:39:13.774ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:121 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302024-05-20T20:39:13.784ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:304
312024-05-20T20:39:13.784ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:315 id = 86226832-0042-47df-b114-06085792be9d (zpool)
322024-05-20T20:39:13.882ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: 86226832-0042-47df-b114-06085792be9d (zpool), kind: Internal }
332024-05-20T20:39:14.086ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:381
342024-05-20T20:39:14.086ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/m2_1.vdev
352024-05-20T20:39:14.086ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362024-05-20T20:39:14.086ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372024-05-20T20:39:14.086ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025 }), tx: ... } file = sled-storage/src/manager.rs:381
382024-05-20T20:39:14.086ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392024-05-20T20:39:14.086ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:121 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402024-05-20T20:39:14.095ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:304
412024-05-20T20:39:14.095ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:315 id = 0cb7111d-dee5-4c65-91df-8aa68aeee77e (zpool)
422024-05-20T20:39:14.183ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: 0cb7111d-dee5-4c65-91df-8aa68aeee77e (zpool), kind: Internal }
432024-05-20T20:39:14.382ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_0.vdev
442024-05-20T20:39:14.382ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 86226832-0042-47df-b114-06085792be9d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: 0cb7111d-dee5-4c65-91df-8aa68aeee77e (zpool), kind: Internal } }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
452024-05-20T20:39:14.382ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
462024-05-20T20:39:14.382ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
472024-05-20T20:39:14.382ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026 }), tx: ... } file = sled-storage/src/manager.rs:381
482024-05-20T20:39:14.382ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
492024-05-20T20:39:14.382ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_1.vdev
502024-05-20T20:39:14.382ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 86226832-0042-47df-b114-06085792be9d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: 0cb7111d-dee5-4c65-91df-8aa68aeee77e (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
512024-05-20T20:39:14.382ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
522024-05-20T20:39:14.382ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
532024-05-20T20:39:14.382ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027 }), tx: ... } file = sled-storage/src/manager.rs:381
542024-05-20T20:39:14.382ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
552024-05-20T20:39:14.382ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_2.vdev
562024-05-20T20:39:14.383ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028 }), tx: ... } file = sled-storage/src/manager.rs:381
572024-05-20T20:39:14.383ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 86226832-0042-47df-b114-06085792be9d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: 0cb7111d-dee5-4c65-91df-8aa68aeee77e (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
582024-05-20T20:39:14.383ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
592024-05-20T20:39:14.383ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
602024-05-20T20:39:14.383ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
612024-05-20T20:39:14.383ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_3.vdev
622024-05-20T20:39:14.383ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029 }), tx: ... } file = sled-storage/src/manager.rs:381
632024-05-20T20:39:14.383ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
642024-05-20T20:39:14.383ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 86226832-0042-47df-b114-06085792be9d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: 0cb7111d-dee5-4c65-91df-8aa68aeee77e (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
652024-05-20T20:39:14.383ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_4.vdev
662024-05-20T20:39:14.383ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030 }), tx: ... } file = sled-storage/src/manager.rs:381
672024-05-20T20:39:14.383ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
682024-05-20T20:39:14.383ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 86226832-0042-47df-b114-06085792be9d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: 0cb7111d-dee5-4c65-91df-8aa68aeee77e (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
692024-05-20T20:39:14.383ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_5.vdev
702024-05-20T20:39:14.383ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031 }), tx: ... } file = sled-storage/src/manager.rs:381
712024-05-20T20:39:14.383ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
722024-05-20T20:39:14.383ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 86226832-0042-47df-b114-06085792be9d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: 0cb7111d-dee5-4c65-91df-8aa68aeee77e (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
732024-05-20T20:39:14.383ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
742024-05-20T20:39:14.383ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
752024-05-20T20:39:14.383ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
762024-05-20T20:39:14.383ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
772024-05-20T20:39:14.383ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
782024-05-20T20:39:14.383ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
792024-05-20T20:39:14.383ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_6.vdev
802024-05-20T20:39:14.383ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032 }), tx: ... } file = sled-storage/src/manager.rs:381
812024-05-20T20:39:14.383ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
822024-05-20T20:39:14.383ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 86226832-0042-47df-b114-06085792be9d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: 0cb7111d-dee5-4c65-91df-8aa68aeee77e (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
832024-05-20T20:39:14.383ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_7.vdev
842024-05-20T20:39:14.383ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033 }), tx: ... } file = sled-storage/src/manager.rs:381
852024-05-20T20:39:14.383ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
862024-05-20T20:39:14.383ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 86226832-0042-47df-b114-06085792be9d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: 0cb7111d-dee5-4c65-91df-8aa68aeee77e (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
872024-05-20T20:39:14.383ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
882024-05-20T20:39:14.383ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
892024-05-20T20:39:14.383ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
902024-05-20T20:39:14.383ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
912024-05-20T20:39:14.383ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_8.vdev
922024-05-20T20:39:14.383ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034 }), tx: ... } file = sled-storage/src/manager.rs:381
932024-05-20T20:39:14.383ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
942024-05-20T20:39:14.383ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 86226832-0042-47df-b114-06085792be9d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: 0cb7111d-dee5-4c65-91df-8aa68aeee77e (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
952024-05-20T20:39:14.383ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:91
962024-05-20T20:39:14.383ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:93
972024-05-20T20:39:14.383ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 86226832-0042-47df-b114-06085792be9d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: 0cb7111d-dee5-4c65-91df-8aa68aeee77e (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
982024-05-20T20:39:14.383ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
992024-05-20T20:39:14.383ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
1002024-05-20T20:39:14.383ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
1012024-05-20T20:39:14.383ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
1022024-05-20T20:39:14.383ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
1032024-05-20T20:39:14.383ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:200
1042024-05-20T20:39:14.383ZINFOSledAgent (bootstore): No ledger in /pool/int/86226832-0042-47df-b114-06085792be9d/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1052024-05-20T20:39:14.383ZINFOSledAgent (bootstore): No ledger in /pool/int/0cb7111d-dee5-4c65-91df-8aa68aeee77e/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1062024-05-20T20:39:14.383ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-sock-i86pc
1072024-05-20T20:39:14.383ZINFOSledAgent (bootstore): No ledger in /pool/int/86226832-0042-47df-b114-06085792be9d/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1082024-05-20T20:39:14.383ZINFOSledAgent (bootstore): No ledger in /pool/int/0cb7111d-dee5-4c65-91df-8aa68aeee77e/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1092024-05-20T20:39:14.383ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-sock-i86pc
1102024-05-20T20:39:14.383ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:205
1112024-05-20T20:39:14.383ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:220
1122024-05-20T20:39:14.393ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:711
1132024-05-20T20:39:14.393ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:289 next_cleanup = Instant { tv_sec: 1322, tv_nsec: 633570350 } time_to_next_cleanup = 599.999915859s
1142024-05-20T20:39:14.393ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
1152024-05-20T20:39:14.393ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3617
1162024-05-20T20:39:14.393ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/86226832-0042-47df-b114-06085792be9d/config/sled-agent-request.json file = common/src/ledger.rs:188
1172024-05-20T20:39:14.393ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/0cb7111d-dee5-4c65-91df-8aa68aeee77e/config/sled-agent-request.json file = common/src/ledger.rs:188
1182024-05-20T20:39:14.396ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:196 local_addr = [fdb0:18c0:4d0d:a02a::1]:80
1192024-05-20T20:39:14.397ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:44 local_addr = [fdb0:18c0:4d0d:a02a::1]:12346
1202024-05-20T20:39:14.397ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.2.164, last: 10.151.2.173, }, ), ], external_dns_ips: [ 10.151.2.164, 10.151.2.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV1 { rack_subnet: Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56, }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV1 { routes: [ RouteConfig { destination: V4( Ipv4Network { addr: 0.0.0.0, prefix: 0, }, ), nexthop: 10.151.2.100, vlan_id: None, }, ], addresses: [ V4( Ipv4Network { addr: 10.151.2.174, prefix: 24, }, ), ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: None, bgp_peers: [], autoneg: false, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1003
1212024-05-20T20:39:14.397ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:60
1222024-05-20T20:39:14.397ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
1232024-05-20T20:39:14.397ZINFOSledAgent (RSS): No ledger in /pool/int/86226832-0042-47df-b114-06085792be9d/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1242024-05-20T20:39:14.397ZINFOSledAgent (RSS): No ledger in /pool/int/0cb7111d-dee5-4c65-91df-8aa68aeee77e/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1252024-05-20T20:39:14.397ZINFOSledAgent (RSS): RSS configuration has not been fully applied yet file = sled-agent/src/rack_setup/service.rs:1063
1262024-05-20T20:39:14.397ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
1272024-05-20T20:39:14.397ZINFOSledAgent (RSS): No ledger in /pool/int/86226832-0042-47df-b114-06085792be9d/config/rss-sled-plan.json file = common/src/ledger.rs:188
1282024-05-20T20:39:14.397ZINFOSledAgent (RSS): No ledger in /pool/int/0cb7111d-dee5-4c65-91df-8aa68aeee77e/config/rss-sled-plan.json file = common/src/ledger.rs:188
1292024-05-20T20:39:14.397ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1104
1302024-05-20T20:39:14.397ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:118
1312024-05-20T20:39:14.397ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:a02a::1 file = sled-agent/src/rack_setup/plan/sled.rs:91
1322024-05-20T20:39:14.397ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
1332024-05-20T20:39:14.397ZINFOSledAgent (RSS): Writing ledger to /pool/int/86226832-0042-47df-b114-06085792be9d/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:199
1342024-05-20T20:39:14.397ZINFOSledAgent (RSS): Writing ledger to /pool/int/0cb7111d-dee5-4c65-91df-8aa68aeee77e/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:199
1352024-05-20T20:39:14.398ZINFOSledAgent (RSS): Sled plan written to storage file = sled-agent/src/rack_setup/plan/sled.rs:138
1362024-05-20T20:39:14.398ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1137
1372024-05-20T20:39:14.398ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
1382024-05-20T20:39:14.398ZINFOSledAgent (bootstore): Writing ledger to /pool/int/86226832-0042-47df-b114-06085792be9d/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1392024-05-20T20:39:14.398ZINFOSledAgent (bootstore): Writing ledger to /pool/int/0cb7111d-dee5-4c65-91df-8aa68aeee77e/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1402024-05-20T20:39:14.398ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
1412024-05-20T20:39:14.398ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:217 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 082c2565-a0d4-4ca8-a689-9276c9a9c8af, rack_id: 940f6265-ca66-4637-a62c-d9c129ad3367, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net(Ipv6Network { addr: fd00:1122:3344:101::, prefix: 64 }) } } } target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
1422024-05-20T20:39:14.398ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:66 remote_addr = [fdb0:18c0:4d0d:a02a::1]:34401
1432024-05-20T20:39:14.398ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 082c2565-a0d4-4ca8-a689-9276c9a9c8af, rack_id: 940f6265-ca66-4637-a62c-d9c129ad3367, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net(Ipv6Network { addr: fd00:1122:3344:101::, prefix: 64 }) } } } file = sled-agent/src/bootstrap/server.rs:360
1442024-05-20T20:39:14.398ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:375
1452024-05-20T20:39:14.398ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:381
1462024-05-20T20:39:14.398ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1472024-05-20T20:39:14.398ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:530
1482024-05-20T20:39:14.398ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:60
1492024-05-20T20:39:14.398ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:87 prefix = Ipv6Prefix { addr: fd00:1122:3344:101::, len: 64 }
1502024-05-20T20:39:14.398ZINFOSledAgent (StorageManager): No ledger in /pool/int/86226832-0042-47df-b114-06085792be9d/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_ledger
1512024-05-20T20:39:14.398ZINFOSledAgent (StorageManager): No ledger in /pool/int/0cb7111d-dee5-4c65-91df-8aa68aeee77e/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_ledger
1522024-05-20T20:39:14.398ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:519
1532024-05-20T20:39:14.398ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:547
1542024-05-20T20:39:14.401ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:3849
1552024-05-20T20:39:14.408ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
1562024-05-20T20:39:14.418ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
1572024-05-20T20:39:14.428ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
1582024-05-20T20:39:14.438ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
1592024-05-20T20:39:14.447ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
1602024-05-20T20:39:14.455ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
1612024-05-20T20:39:14.464ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
1622024-05-20T20:39:14.472ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
1632024-05-20T20:39:14.481ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
1642024-05-20T20:39:14.481ZINFOSledAgent (StorageManager): No disks to be automatically managed file = sled-storage/src/manager.rs:558
1652024-05-20T20:39:14.481ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:370
1662024-05-20T20:39:14.481ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:339
1672024-05-20T20:39:14.481ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:449 result = DisksManagementResult { status: [] }
1682024-05-20T20:39:14.481ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
1692024-05-20T20:39:14.500ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:355 sled_id = 082c2565-a0d4-4ca8-a689-9276c9a9c8af
1702024-05-20T20:39:14.500ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
1712024-05-20T20:39:14.500ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:367 sled_id = 082c2565-a0d4-4ca8-a689-9276c9a9c8af
1722024-05-20T20:39:14.500ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:164
1732024-05-20T20:39:14.502ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:315
1742024-05-20T20:39:14.505ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 120.884869ms DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "25d6a680-e0ca-464b-a6d8-d5917e8c56aa", "content-length": "124", "date": "Mon, 20 May 2024 20:39:13 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "25d6a680-e0ca-464b-a6d8-d5917e8c56aa" } file = clients/ddm-admin-client/src/lib.rs:178
1752024-05-20T20:39:14.512ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_86226832-0042-47df-b114-06085792be9d/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1762024-05-20T20:39:14.521ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:354
1772024-05-20T20:39:14.536ZINFOSledAgent: successfully created encrypted zvol: name="oxi_86226832-0042-47df-b114-06085792be9d/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1782024-05-20T20:39:14.536ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_86226832-0042-47df-b114-06085792be9d/swap" file = sled-agent/src/swap_device.rs:96
1792024-05-20T20:39:14.541ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:382 sled_id = 082c2565-a0d4-4ca8-a689-9276c9a9c8af
1802024-05-20T20:39:14.541ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:126
1812024-05-20T20:39:14.541ZINFOSledAgent (BackingFs): Ensuring dataset oxi_86226832-0042-47df-b114-06085792be9d/backing/fmd file = sled-agent/src/backing_fs.rs:136
1822024-05-20T20:39:14.611ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:170
1832024-05-20T20:39:14.627ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:164
1842024-05-20T20:39:14.628ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 178.313286ms DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "3e62e70c-3578-420f-a62e-779d7ae45e51", "content-length": "124", "date": "Mon, 20 May 2024 20:39:13 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "3e62e70c-3578-420f-a62e-779d7ae45e51" } file = clients/ddm-admin-client/src/lib.rs:178
1852024-05-20T20:39:14.807ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:164
1862024-05-20T20:39:14.807ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 97.283623ms DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "dc46c60e-72f2-4d41-9328-11aae1910bcd", "content-length": "124", "date": "Mon, 20 May 2024 20:39:14 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "dc46c60e-72f2-4d41-9328-11aae1910bcd" } file = clients/ddm-admin-client/src/lib.rs:178
1872024-05-20T20:39:14.829ZINFOSledAgent (BackingFs): Mounting oxi_86226832-0042-47df-b114-06085792be9d/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:178
1882024-05-20T20:39:14.842ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:186
1892024-05-20T20:39:14.842ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:186
1902024-05-20T20:39:14.842ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:186
1912024-05-20T20:39:14.842ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:192
1922024-05-20T20:39:14.905ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:164
1932024-05-20T20:39:14.906ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 210.300511ms DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "f37adf6c-8838-409e-816d-1d4011945c5e", "content-length": "124", "date": "Mon, 20 May 2024 20:39:14 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "f37adf6c-8838-409e-816d-1d4011945c5e" } file = clients/ddm-admin-client/src/lib.rs:178
1942024-05-20T20:39:15.117ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:164
1952024-05-20T20:39:15.118ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 246.078081ms DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "8f737ff7-a591-4fbd-a4bc-ba87e418b079", "content-length": "124", "date": "Mon, 20 May 2024 20:39:14 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "8f737ff7-a591-4fbd-a4bc-ba87e418b079" } file = clients/ddm-admin-client/src/lib.rs:178
1962024-05-20T20:39:15.365ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:164
1972024-05-20T20:39:15.366ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 288.025472ms DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "e924b857-435a-4fe8-962a-da78394a07f0", "content-length": "124", "date": "Mon, 20 May 2024 20:39:14 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "e924b857-435a-4fe8-962a-da78394a07f0" } file = clients/ddm-admin-client/src/lib.rs:178
1982024-05-20T20:39:15.554ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:90 sled_id = 082c2565-a0d4-4ca8-a689-9276c9a9c8af
1992024-05-20T20:39:15.555ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:196 local_addr = [fd00:1122:3344:101::1]:36587 sled_id = 082c2565-a0d4-4ca8-a689-9276c9a9c8af
2002024-05-20T20:39:15.555ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:60 sled_id = 082c2565-a0d4-4ca8-a689-9276c9a9c8af
2012024-05-20T20:39:15.555ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:36587 file = oximeter/producer/src/lib.rs:276 interval = 30s producer_id = 082c2565-a0d4-4ca8-a689-9276c9a9c8af sled_id = 082c2565-a0d4-4ca8-a689-9276c9a9c8af
2022024-05-20T20:39:15.561ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 323.451323ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:384 sled_id = 082c2565-a0d4-4ca8-a689-9276c9a9c8af
2032024-05-20T20:39:15.600ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = 082c2565-a0d4-4ca8-a689-9276c9a9c8af
2042024-05-20T20:39:15.600ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = 082c2565-a0d4-4ca8-a689-9276c9a9c8af
2052024-05-20T20:39:15.600ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:993 underlay_address = fd00:1122:3344:101::1
2062024-05-20T20:39:15.600ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:60
2072024-05-20T20:39:15.601ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:196 local_addr = [fd00:1122:3344:101::1]:12345
2082024-05-20T20:39:15.601ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:430
2092024-05-20T20:39:15.601ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
2102024-05-20T20:39:15.601ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/86226832-0042-47df-b114-06085792be9d/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2112024-05-20T20:39:15.601ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/0cb7111d-dee5-4c65-91df-8aa68aeee77e/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2122024-05-20T20:39:15.602ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2132024-05-20T20:39:15.602ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:73 remote_addr = [fdb0:18c0:4d0d:a02a::1]:34401
2142024-05-20T20:39:15.602ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:262 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV1 { rack_subnet: Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [PortConfigV1 { routes: [RouteConfig { destination: V4(Ipv4Network { addr: 0.0.0.0, prefix: 0 }), nexthop: 10.151.2.100, vlan_id: None }], addresses: [V4(Ipv4Network { addr: 10.151.2.174, prefix: 24 })], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: None, bgp_peers: [], autoneg: false }], bgp: [], bfd: [] })))
2152024-05-20T20:39:15.602ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3617
2162024-05-20T20:39:15.602ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:108 peer = [fdb0:18c0:4d0d:a02a::1]:12346
2172024-05-20T20:39:15.602ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:232 target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
2182024-05-20T20:39:15.803ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
2192024-05-20T20:39:15.803ZINFOSledAgent (RSS): No ledger in /pool/int/86226832-0042-47df-b114-06085792be9d/config/rss-service-plan-v3.json file = common/src/ledger.rs:188
2202024-05-20T20:39:15.803ZINFOSledAgent (RSS): No ledger in /pool/int/0cb7111d-dee5-4c65-91df-8aa68aeee77e/config/rss-service-plan-v3.json file = common/src/ledger.rs:188
2212024-05-20T20:39:15.803ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:164
2222024-05-20T20:39:15.803ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
2232024-05-20T20:39:15.803ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
2242024-05-20T20:39:15.807ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/082c2565-a0d4-4ca8-a689-9276c9a9c8af): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:619 sled_id = 082c2565-a0d4-4ca8-a689-9276c9a9c8af
2252024-05-20T20:39:15.835ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48668
2262024-05-20T20:39:15.835ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
2272024-05-20T20:39:15.835ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 184 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:48668 req_id = 4b0aab0d-5ba9-43dc-8cb9-c22cb352ad31 response_code = 200 uri = /inventory
2282024-05-20T20:39:15.865ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39144
2292024-05-20T20:39:15.865ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 36 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39144 req_id = ed89561f-2d9a-4c89-ba24-5e4aab9b7f13 response_code = 200 uri = /sled-role
2302024-05-20T20:39:15.866ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
2312024-05-20T20:39:15.866ZINFOSledAgent (RSS): Writing ledger to /pool/int/86226832-0042-47df-b114-06085792be9d/config/.rss-service-plan-v3.json.tmp file = common/src/ledger.rs:199
2322024-05-20T20:39:15.867ZINFOSledAgent (RSS): Writing ledger to /pool/int/0cb7111d-dee5-4c65-91df-8aa68aeee77e/config/.rss-service-plan-v3.json.tmp file = common/src/ledger.rs:199
2332024-05-20T20:39:15.867ZINFOSledAgent (RSS): Service plan written to storage file = sled-agent/src/rack_setup/plan/service.rs:815
2342024-05-20T20:39:15.886ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 470.152421ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:384 sled_id = 082c2565-a0d4-4ca8-a689-9276c9a9c8af
2352024-05-20T20:39:15.896ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { disks: [OmicronPhysicalDiskConfig { id: e85e6496-3065-43d0-912a-32fdd7b7fda3, identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, pool_id: 96419ba3-f12e-4ccd-8f37-b0d3a3725e86 (zpool) }, OmicronPhysicalDiskConfig { id: e69f573d-dc73-4f88-a562-b14877bb1eb5, identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, pool_id: 28bf1422-8de2-4580-b168-1e653c2d0ea3 (zpool) }, OmicronPhysicalDiskConfig { id: 67331040-8df6-4036-835d-1059504bfd63, identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, pool_id: 040cf7d2-26fc-4968-9626-951fc09450b4 (zpool) }, OmicronPhysicalDiskConfig { id: f19a3661-a779-4c91-9d43-ff4fa3dce608, identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, pool_id: e9a2b279-e51b-488d-83ef-f697a65badba (zpool) }, OmicronPhysicalDiskConfig { id: c146997d-dc82-4bd6-a374-f37b4f5197bf, identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, pool_id: bdfd1b72-3c3a-4f33-9b7a-f64e90e24f6a (zpool) }, OmicronPhysicalDiskConfig { id: b9157f65-8323-4bd9-a8bc-d282bbce4d3b, identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, pool_id: 63a0c9f9-e34d-401c-a2ae-4888bfc580e3 (zpool) }, OmicronPhysicalDiskConfig { id: 68ee721f-470a-4336-839e-a37a6a6c8fc3, identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, pool_id: b1ad2e3e-e2af-4c2a-94f1-4865bf8462a0 (zpool) }, OmicronPhysicalDiskConfig { id: 092c01b0-e9fb-440d-a916-f4ddc708991d, identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, pool_id: 7f578f7a-8926-4b69-864d-4c8b71340b47 (zpool) }, OmicronPhysicalDiskConfig { id: 6a4c0c30-cf61-43bf-8f52-c78583e7e07f, identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, pool_id: e3e91ef4-fcde-43ae-a5a9-a2d6e1fd7046 (zpool) }], generation: Generation(1) } file = sled-agent/src/rack_setup/service.rs:347 sled_address = [fd00:1122:3344:101::1]:12345
2362024-05-20T20:39:15.897ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43133
2372024-05-20T20:39:15.897ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(1), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: e85e6496-3065-43d0-912a-32fdd7b7fda3, pool_id: 96419ba3-f12e-4ccd-8f37-b0d3a3725e86 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: e69f573d-dc73-4f88-a562-b14877bb1eb5, pool_id: 28bf1422-8de2-4580-b168-1e653c2d0ea3 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 67331040-8df6-4036-835d-1059504bfd63, pool_id: 040cf7d2-26fc-4968-9626-951fc09450b4 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: f19a3661-a779-4c91-9d43-ff4fa3dce608, pool_id: e9a2b279-e51b-488d-83ef-f697a65badba (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: c146997d-dc82-4bd6-a374-f37b4f5197bf, pool_id: bdfd1b72-3c3a-4f33-9b7a-f64e90e24f6a (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: b9157f65-8323-4bd9-a8bc-d282bbce4d3b, pool_id: 63a0c9f9-e34d-401c-a2ae-4888bfc580e3 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 68ee721f-470a-4336-839e-a37a6a6c8fc3, pool_id: b1ad2e3e-e2af-4c2a-94f1-4865bf8462a0 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 092c01b0-e9fb-440d-a916-f4ddc708991d, pool_id: 7f578f7a-8926-4b69-864d-4c8b71340b47 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 6a4c0c30-cf61-43bf-8f52-c78583e7e07f, pool_id: e3e91ef4-fcde-43ae-a5a9-a2d6e1fd7046 (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:381
2382024-05-20T20:39:15.897ZINFOSledAgent (StorageManager): No ledger in /pool/int/86226832-0042-47df-b114-06085792be9d/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2392024-05-20T20:39:15.897ZINFOSledAgent (StorageManager): No ledger in /pool/int/0cb7111d-dee5-4c65-91df-8aa68aeee77e/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2402024-05-20T20:39:15.897ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:681 request = omicron_physical_disks_ensure
2412024-05-20T20:39:15.897ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:339
2422024-05-20T20:39:15.897ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:379
2432024-05-20T20:39:15.897ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
2442024-05-20T20:39:15.897ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:121 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2452024-05-20T20:39:16.018ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:304
2462024-05-20T20:39:16.018ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:310 id = 96419ba3-f12e-4ccd-8f37-b0d3a3725e86 (zpool)
2472024-05-20T20:39:16.386ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 958.850642ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:384 sled_id = 082c2565-a0d4-4ca8-a689-9276c9a9c8af
2482024-05-20T20:39:16.621ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/082c2565-a0d4-4ca8-a689-9276c9a9c8af): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = 082c2565-a0d4-4ca8-a689-9276c9a9c8af
2492024-05-20T20:39:16.993ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: 96419ba3-f12e-4ccd-8f37-b0d3a3725e86 (zpool), kind: External }
2502024-05-20T20:39:17.160ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:332
2512024-05-20T20:39:17.160ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:334
2522024-05-20T20:39:17.160ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:338
2532024-05-20T20:39:17.160ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:340
2542024-05-20T20:39:17.160ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2552024-05-20T20:39:17.160ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2562024-05-20T20:39:17.160ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
2572024-05-20T20:39:17.350ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.655764746s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:384 sled_id = 082c2565-a0d4-4ca8-a689-9276c9a9c8af
2582024-05-20T20:39:17.714ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_switch
2592024-05-20T20:39:17.898ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2602024-05-20T20:39:18.099ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/082c2565-a0d4-4ca8-a689-9276c9a9c8af): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = 082c2565-a0d4-4ca8-a689-9276c9a9c8af
2612024-05-20T20:39:18.099ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/082c2565-a0d4-4ca8-a689-9276c9a9c8af): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:619 sled_id = 082c2565-a0d4-4ca8-a689-9276c9a9c8af
2622024-05-20T20:39:18.317ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_96419ba3-f12e-4ccd-8f37-b0d3a3725e86/crypt/zone file = sled-storage/src/dataset.rs:395
2632024-05-20T20:39:18.498ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 27.137422ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2642024-05-20T20:39:19.023ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 138.714356ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2652024-05-20T20:39:19.024ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 3.566735945s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:384 sled_id = 082c2565-a0d4-4ca8-a689-9276c9a9c8af
2662024-05-20T20:39:19.630ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 157.57112ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2672024-05-20T20:39:19.630ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/082c2565-a0d4-4ca8-a689-9276c9a9c8af): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = 082c2565-a0d4-4ca8-a689-9276c9a9c8af
2682024-05-20T20:39:19.631ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/082c2565-a0d4-4ca8-a689-9276c9a9c8af): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:619 sled_id = 082c2565-a0d4-4ca8-a689-9276c9a9c8af
2692024-05-20T20:39:20.153ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 500.643523ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2702024-05-20T20:39:21.061ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_96419ba3-f12e-4ccd-8f37-b0d3a3725e86 file = sled-storage/src/dataset.rs:480
2712024-05-20T20:39:21.279ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/082c2565-a0d4-4ca8-a689-9276c9a9c8af): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = 082c2565-a0d4-4ca8-a689-9276c9a9c8af
2722024-05-20T20:39:21.279ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.090216268s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2732024-05-20T20:39:21.284ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:477
2742024-05-20T20:39:21.284ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:394
2752024-05-20T20:39:21.284ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:379
2762024-05-20T20:39:21.284ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
2772024-05-20T20:39:21.284ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:121 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2782024-05-20T20:39:21.514ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:304
2792024-05-20T20:39:21.514ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:310 id = 28bf1422-8de2-4580-b168-1e653c2d0ea3 (zpool)
2802024-05-20T20:39:22.710ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: 28bf1422-8de2-4580-b168-1e653c2d0ea3 (zpool), kind: External }
2812024-05-20T20:39:22.951ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:332
2822024-05-20T20:39:22.951ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:334
2832024-05-20T20:39:22.951ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:338
2842024-05-20T20:39:22.951ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:340
2852024-05-20T20:39:22.951ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2862024-05-20T20:39:22.951ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2872024-05-20T20:39:22.951ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
2882024-05-20T20:39:23.678ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/082c2565-a0d4-4ca8-a689-9276c9a9c8af): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = 082c2565-a0d4-4ca8-a689-9276c9a9c8af
2892024-05-20T20:39:23.678ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 7.056923658s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:384 sled_id = 082c2565-a0d4-4ca8-a689-9276c9a9c8af
2902024-05-20T20:39:23.904ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/082c2565-a0d4-4ca8-a689-9276c9a9c8af): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:619 sled_id = 082c2565-a0d4-4ca8-a689-9276c9a9c8af
2912024-05-20T20:39:24.381ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2922024-05-20T20:39:24.871ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_28bf1422-8de2-4580-b168-1e653c2d0ea3/crypt/zone file = sled-storage/src/dataset.rs:395
2932024-05-20T20:39:25.104ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/082c2565-a0d4-4ca8-a689-9276c9a9c8af): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = 082c2565-a0d4-4ca8-a689-9276c9a9c8af
2942024-05-20T20:39:25.104ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/082c2565-a0d4-4ca8-a689-9276c9a9c8af): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:619 sled_id = 082c2565-a0d4-4ca8-a689-9276c9a9c8af
2952024-05-20T20:39:25.570ZINFOSledAgent (ServiceManager): Ensuring tfportrear0_0/ll exists in zone file = sled-agent/src/services.rs:2303
2962024-05-20T20:39:25.781ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = 082c2565-a0d4-4ca8-a689-9276c9a9c8af
2972024-05-20T20:39:25.887ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_28bf1422-8de2-4580-b168-1e653c2d0ea3 file = sled-storage/src/dataset.rs:480
2982024-05-20T20:39:25.894ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:477
2992024-05-20T20:39:25.894ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:394
3002024-05-20T20:39:25.894ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:379
3012024-05-20T20:39:25.894ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
3022024-05-20T20:39:25.894ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:121 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3032024-05-20T20:39:25.904ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:304
3042024-05-20T20:39:25.904ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:310 id = 040cf7d2-26fc-4968-9626-951fc09450b4 (zpool)
3052024-05-20T20:39:25.993ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: 040cf7d2-26fc-4968-9626-951fc09450b4 (zpool), kind: External }
3062024-05-20T20:39:26.001ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:332
3072024-05-20T20:39:26.001ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:334
3082024-05-20T20:39:26.001ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:338
3092024-05-20T20:39:26.001ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:340
3102024-05-20T20:39:26.001ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3112024-05-20T20:39:26.001ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3122024-05-20T20:39:26.001ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
3132024-05-20T20:39:26.035ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3142024-05-20T20:39:26.042ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_040cf7d2-26fc-4968-9626-951fc09450b4/crypt/zone file = sled-storage/src/dataset.rs:395
3152024-05-20T20:39:26.106ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/082c2565-a0d4-4ca8-a689-9276c9a9c8af): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = 082c2565-a0d4-4ca8-a689-9276c9a9c8af
3162024-05-20T20:39:26.164ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_040cf7d2-26fc-4968-9626-951fc09450b4 file = sled-storage/src/dataset.rs:480
3172024-05-20T20:39:26.172ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:477
3182024-05-20T20:39:26.172ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:394
3192024-05-20T20:39:26.172ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:379
3202024-05-20T20:39:26.172ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
3212024-05-20T20:39:26.172ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:121 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3222024-05-20T20:39:26.181ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:304
3232024-05-20T20:39:26.181ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:310 id = e9a2b279-e51b-488d-83ef-f697a65badba (zpool)
3242024-05-20T20:39:26.273ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: e9a2b279-e51b-488d-83ef-f697a65badba (zpool), kind: External }
3252024-05-20T20:39:26.281ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:332
3262024-05-20T20:39:26.281ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:334
3272024-05-20T20:39:26.281ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:338
3282024-05-20T20:39:26.281ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:340
3292024-05-20T20:39:26.281ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3302024-05-20T20:39:26.281ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3312024-05-20T20:39:26.281ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
3322024-05-20T20:39:26.314ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3332024-05-20T20:39:26.322ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_e9a2b279-e51b-488d-83ef-f697a65badba/crypt/zone file = sled-storage/src/dataset.rs:395
3342024-05-20T20:39:26.432ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_e9a2b279-e51b-488d-83ef-f697a65badba file = sled-storage/src/dataset.rs:480
3352024-05-20T20:39:26.438ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:477
3362024-05-20T20:39:26.438ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:394
3372024-05-20T20:39:26.438ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:379
3382024-05-20T20:39:26.438ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
3392024-05-20T20:39:26.438ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:121 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3402024-05-20T20:39:26.448ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:304
3412024-05-20T20:39:26.448ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:310 id = bdfd1b72-3c3a-4f33-9b7a-f64e90e24f6a (zpool)
3422024-05-20T20:39:26.544ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: bdfd1b72-3c3a-4f33-9b7a-f64e90e24f6a (zpool), kind: External }
3432024-05-20T20:39:26.551ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:332
3442024-05-20T20:39:26.551ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:334
3452024-05-20T20:39:26.551ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:338
3462024-05-20T20:39:26.551ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:340
3472024-05-20T20:39:26.551ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3482024-05-20T20:39:26.551ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3492024-05-20T20:39:26.551ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
3502024-05-20T20:39:26.587ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3512024-05-20T20:39:26.594ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_bdfd1b72-3c3a-4f33-9b7a-f64e90e24f6a/crypt/zone file = sled-storage/src/dataset.rs:395
3522024-05-20T20:39:26.715ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_bdfd1b72-3c3a-4f33-9b7a-f64e90e24f6a file = sled-storage/src/dataset.rs:480
3532024-05-20T20:39:26.723ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:477
3542024-05-20T20:39:26.723ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:394
3552024-05-20T20:39:26.723ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:379
3562024-05-20T20:39:26.723ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
3572024-05-20T20:39:26.723ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:121 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3582024-05-20T20:39:26.732ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:304
3592024-05-20T20:39:26.732ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:310 id = 63a0c9f9-e34d-401c-a2ae-4888bfc580e3 (zpool)
3602024-05-20T20:39:26.819ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: 63a0c9f9-e34d-401c-a2ae-4888bfc580e3 (zpool), kind: External }
3612024-05-20T20:39:26.826ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:332
3622024-05-20T20:39:26.826ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:334
3632024-05-20T20:39:26.826ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:338
3642024-05-20T20:39:26.826ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:340
3652024-05-20T20:39:26.826ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3662024-05-20T20:39:26.826ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3672024-05-20T20:39:26.826ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
3682024-05-20T20:39:26.859ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3692024-05-20T20:39:26.866ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_63a0c9f9-e34d-401c-a2ae-4888bfc580e3/crypt/zone file = sled-storage/src/dataset.rs:395
3702024-05-20T20:39:26.989ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_63a0c9f9-e34d-401c-a2ae-4888bfc580e3 file = sled-storage/src/dataset.rs:480
3712024-05-20T20:39:26.996ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:477
3722024-05-20T20:39:26.996ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:394
3732024-05-20T20:39:26.996ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:379
3742024-05-20T20:39:26.996ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
3752024-05-20T20:39:26.997ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:121 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3762024-05-20T20:39:27.006ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:304
3772024-05-20T20:39:27.006ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:310 id = b1ad2e3e-e2af-4c2a-94f1-4865bf8462a0 (zpool)
3782024-05-20T20:39:27.105ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: b1ad2e3e-e2af-4c2a-94f1-4865bf8462a0 (zpool), kind: External }
3792024-05-20T20:39:27.114ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:332
3802024-05-20T20:39:27.114ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:334
3812024-05-20T20:39:27.114ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:338
3822024-05-20T20:39:27.114ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:340
3832024-05-20T20:39:27.114ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3842024-05-20T20:39:27.114ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3852024-05-20T20:39:27.114ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
3862024-05-20T20:39:27.118ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/082c2565-a0d4-4ca8-a689-9276c9a9c8af): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:619 sled_id = 082c2565-a0d4-4ca8-a689-9276c9a9c8af
3872024-05-20T20:39:27.118ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/082c2565-a0d4-4ca8-a689-9276c9a9c8af): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = 082c2565-a0d4-4ca8-a689-9276c9a9c8af
3882024-05-20T20:39:27.151ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3892024-05-20T20:39:27.159ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_b1ad2e3e-e2af-4c2a-94f1-4865bf8462a0/crypt/zone file = sled-storage/src/dataset.rs:395
3902024-05-20T20:39:27.281ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_b1ad2e3e-e2af-4c2a-94f1-4865bf8462a0 file = sled-storage/src/dataset.rs:480
3912024-05-20T20:39:27.289ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:477
3922024-05-20T20:39:27.289ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:394
3932024-05-20T20:39:27.289ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:379
3942024-05-20T20:39:27.289ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
3952024-05-20T20:39:27.289ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:121 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
3962024-05-20T20:39:27.298ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:304
3972024-05-20T20:39:27.298ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:310 id = 7f578f7a-8926-4b69-864d-4c8b71340b47 (zpool)
3982024-05-20T20:39:27.391ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: 7f578f7a-8926-4b69-864d-4c8b71340b47 (zpool), kind: External }
3992024-05-20T20:39:27.400ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:332
4002024-05-20T20:39:27.400ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:334
4012024-05-20T20:39:27.400ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:338
4022024-05-20T20:39:27.400ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:340
4032024-05-20T20:39:27.400ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4042024-05-20T20:39:27.400ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4052024-05-20T20:39:27.400ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
4062024-05-20T20:39:27.439ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4072024-05-20T20:39:27.447ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_7f578f7a-8926-4b69-864d-4c8b71340b47/crypt/zone file = sled-storage/src/dataset.rs:395
4082024-05-20T20:39:27.572ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_7f578f7a-8926-4b69-864d-4c8b71340b47 file = sled-storage/src/dataset.rs:480
4092024-05-20T20:39:27.580ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:477
4102024-05-20T20:39:27.580ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:394
4112024-05-20T20:39:27.580ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:379
4122024-05-20T20:39:27.580ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
4132024-05-20T20:39:27.580ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:121 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4142024-05-20T20:39:27.590ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:304
4152024-05-20T20:39:27.590ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:310 id = e3e91ef4-fcde-43ae-a5a9-a2d6e1fd7046 (zpool)
4162024-05-20T20:39:27.685ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: e3e91ef4-fcde-43ae-a5a9-a2d6e1fd7046 (zpool), kind: External }
4172024-05-20T20:39:27.694ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:332
4182024-05-20T20:39:27.694ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:334
4192024-05-20T20:39:27.694ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:338
4202024-05-20T20:39:27.694ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:340
4212024-05-20T20:39:27.694ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4222024-05-20T20:39:27.694ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4232024-05-20T20:39:27.694ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
4242024-05-20T20:39:27.731ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4252024-05-20T20:39:27.739ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_e3e91ef4-fcde-43ae-a5a9-a2d6e1fd7046/crypt/zone file = sled-storage/src/dataset.rs:395
4262024-05-20T20:39:27.865ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_e3e91ef4-fcde-43ae-a5a9-a2d6e1fd7046 file = sled-storage/src/dataset.rs:480
4272024-05-20T20:39:27.873ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:477
4282024-05-20T20:39:27.873ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:394
4292024-05-20T20:39:27.873ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/86226832-0042-47df-b114-06085792be9d/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4302024-05-20T20:39:27.873ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 86226832-0042-47df-b114-06085792be9d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: 0cb7111d-dee5-4c65-91df-8aa68aeee77e (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026 }, zpool_name: ZpoolName { id: 96419ba3-f12e-4ccd-8f37-b0d3a3725e86 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027 }, zpool_name: ZpoolName { id: 28bf1422-8de2-4580-b168-1e653c2d0ea3 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028 }, zpool_name: ZpoolName { id: 040cf7d2-26fc-4968-9626-951fc09450b4 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029 }, zpool_name: ZpoolName { id: e9a2b279-e51b-488d-83ef-f697a65badba (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030 }, zpool_name: ZpoolName { id: bdfd1b72-3c3a-4f33-9b7a-f64e90e24f6a (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031 }, zpool_name: ZpoolName { id: 63a0c9f9-e34d-401c-a2ae-4888bfc580e3 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032 }, zpool_name: ZpoolName { id: b1ad2e3e-e2af-4c2a-94f1-4865bf8462a0 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033 }, zpool_name: ZpoolName { id: 7f578f7a-8926-4b69-864d-4c8b71340b47 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034 }, zpool_name: ZpoolName { id: e3e91ef4-fcde-43ae-a5a9-a2d6e1fd7046 (zpool), kind: External } }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
4312024-05-20T20:39:27.873ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
4322024-05-20T20:39:27.873ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
4332024-05-20T20:39:27.873ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/0cb7111d-dee5-4c65-91df-8aa68aeee77e/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4342024-05-20T20:39:27.873ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 11976810 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:43133 req_id = 60a4927d-8ca8-46a3-963b-e8b5ca1e7cd8 response_code = 200 uri = /omicron-physical-disks
4352024-05-20T20:39:27.904ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: f55338b5-b00f-4b86-b71e-d8dfd2aabf41, underlay_address: fd00:1122:3344:1::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 96419ba3-f12e-4ccd-8f37-b0d3a3725e86 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: a3b35764-07da-4d8e-ab71-2f82fea2b72e, underlay_address: fd00:1122:3344:2::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 28bf1422-8de2-4580-b168-1e653c2d0ea3 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: e4964c06-6f88-4a3b-a648-893e1b284275, underlay_address: fd00:1122:3344:3::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 040cf7d2-26fc-4968-9626-951fc09450b4 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:430 sled_address = [fd00:1122:3344:101::1]:12345
4362024-05-20T20:39:27.904ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54641
4372024-05-20T20:39:27.904ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: f55338b5-b00f-4b86-b71e-d8dfd2aabf41, dataset_name: DatasetName { pool_name: ZpoolName { id: 96419ba3-f12e-4ccd-8f37-b0d3a3725e86 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
4382024-05-20T20:39:27.904ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: f55338b5-b00f-4b86-b71e-d8dfd2aabf41, dataset_name: DatasetName { pool_name: ZpoolName { id: 96419ba3-f12e-4ccd-8f37-b0d3a3725e86 (zpool), kind: External }, kind: InternalDns }, responder: ... }
4392024-05-20T20:39:27.956ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: a3b35764-07da-4d8e-ab71-2f82fea2b72e, dataset_name: DatasetName { pool_name: ZpoolName { id: 28bf1422-8de2-4580-b168-1e653c2d0ea3 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
4402024-05-20T20:39:27.956ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: a3b35764-07da-4d8e-ab71-2f82fea2b72e, dataset_name: DatasetName { pool_name: ZpoolName { id: 28bf1422-8de2-4580-b168-1e653c2d0ea3 (zpool), kind: External }, kind: InternalDns }, responder: ... }
4412024-05-20T20:39:28.006ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e4964c06-6f88-4a3b-a648-893e1b284275, dataset_name: DatasetName { pool_name: ZpoolName { id: 040cf7d2-26fc-4968-9626-951fc09450b4 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
4422024-05-20T20:39:28.006ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: e4964c06-6f88-4a3b-a648-893e1b284275, dataset_name: DatasetName { pool_name: ZpoolName { id: 040cf7d2-26fc-4968-9626-951fc09450b4 (zpool), kind: External }, kind: InternalDns }, responder: ... }
4432024-05-20T20:39:28.057ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
4442024-05-20T20:39:28.057ZINFOSledAgent (ServiceManager): No ledger in /pool/int/86226832-0042-47df-b114-06085792be9d/config/omicron-zones.json file = common/src/ledger.rs:188
4452024-05-20T20:39:28.057ZINFOSledAgent (ServiceManager): No ledger in /pool/int/0cb7111d-dee5-4c65-91df-8aa68aeee77e/config/omicron-zones.json file = common/src/ledger.rs:188
4462024-05-20T20:39:28.057ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
4472024-05-20T20:39:28.102ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
4482024-05-20T20:39:28.102ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
4492024-05-20T20:39:28.102ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
4502024-05-20T20:39:28.124ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/082c2565-a0d4-4ca8-a689-9276c9a9c8af): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = 082c2565-a0d4-4ca8-a689-9276c9a9c8af
4512024-05-20T20:39:28.155ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_f55338b5-b00f-4b86-b71e-d8dfd2aabf41 file = illumos-utils/src/zone.rs:315
4522024-05-20T20:39:28.159ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_a3b35764-07da-4d8e-ab71-2f82fea2b72e file = illumos-utils/src/zone.rs:315
4532024-05-20T20:39:28.163ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_e4964c06-6f88-4a3b-a648-893e1b284275 file = illumos-utils/src/zone.rs:315
4542024-05-20T20:39:28.176ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_f55338b5-b00f-4b86-b71e-d8dfd2aabf41 file = illumos-utils/src/zone.rs:354
4552024-05-20T20:39:28.180ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_a3b35764-07da-4d8e-ab71-2f82fea2b72e file = illumos-utils/src/zone.rs:354
4562024-05-20T20:39:28.183ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_e4964c06-6f88-4a3b-a648-893e1b284275 file = illumos-utils/src/zone.rs:354
4572024-05-20T20:39:29.116ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/082c2565-a0d4-4ca8-a689-9276c9a9c8af): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:619 sled_id = 082c2565-a0d4-4ca8-a689-9276c9a9c8af
4582024-05-20T20:39:29.126ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/082c2565-a0d4-4ca8-a689-9276c9a9c8af): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = 082c2565-a0d4-4ca8-a689-9276c9a9c8af
4592024-05-20T20:39:29.703ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_f55338b5-b00f-4b86-b71e-d8dfd2aabf41: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService1"/> <propval type="astring" name="gateway" value="fd00:1122:3344:1::2"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:1::1"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value="[fd00:1122:3344:1::1]:5353"/> <propval type="astring" name="dns_address" value="[fd00:1122:3344:1::1]:53"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
4602024-05-20T20:39:29.703ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:87 prefix = Ipv6Prefix { addr: fd00:1122:3344:1::, len: 64 }
4612024-05-20T20:39:29.703ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_internal_dns_f55338b5-b00f-4b86-b71e-d8dfd2aabf41
4622024-05-20T20:39:30.189ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_a3b35764-07da-4d8e-ab71-2f82fea2b72e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService2"/> <propval type="astring" name="gateway" value="fd00:1122:3344:2::2"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:2::1"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value="[fd00:1122:3344:2::1]:5353"/> <propval type="astring" name="dns_address" value="[fd00:1122:3344:2::1]:53"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
4632024-05-20T20:39:30.668ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:87 prefix = Ipv6Prefix { addr: fd00:1122:3344:2::, len: 64 }
4642024-05-20T20:39:30.668ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_e4964c06-6f88-4a3b-a648-893e1b284275: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService3"/> <propval type="astring" name="gateway" value="fd00:1122:3344:3::2"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:3::1"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value="[fd00:1122:3344:3::1]:5353"/> <propval type="astring" name="dns_address" value="[fd00:1122:3344:3::1]:53"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
4652024-05-20T20:39:30.668ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:87 prefix = Ipv6Prefix { addr: fd00:1122:3344:3::, len: 64 }
4662024-05-20T20:39:30.677ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f55338b5-b00f-4b86-b71e-d8dfd2aabf41") failed: Property not found. retry in 51.813533ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_f55338b5-b00f-4b86-b71e-d8dfd2aabf41
4672024-05-20T20:39:30.677ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_internal_dns_a3b35764-07da-4d8e-ab71-2f82fea2b72e
4682024-05-20T20:39:30.680ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_internal_dns_e4964c06-6f88-4a3b-a648-893e1b284275
4692024-05-20T20:39:30.737ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f55338b5-b00f-4b86-b71e-d8dfd2aabf41") failed: Property not found. retry in 114.128076ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_f55338b5-b00f-4b86-b71e-d8dfd2aabf41
4702024-05-20T20:39:30.798ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e4964c06-6f88-4a3b-a648-893e1b284275") failed: Property not found. retry in 41.993732ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_e4964c06-6f88-4a3b-a648-893e1b284275
4712024-05-20T20:39:30.804ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_a3b35764-07da-4d8e-ab71-2f82fea2b72e") failed: Property not found. retry in 50.889578ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_a3b35764-07da-4d8e-ab71-2f82fea2b72e
4722024-05-20T20:39:30.847ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e4964c06-6f88-4a3b-a648-893e1b284275") failed: Property not found. retry in 140.958866ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_e4964c06-6f88-4a3b-a648-893e1b284275
4732024-05-20T20:39:30.859ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f55338b5-b00f-4b86-b71e-d8dfd2aabf41") failed: Property not found. retry in 247.519533ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_f55338b5-b00f-4b86-b71e-d8dfd2aabf41
4742024-05-20T20:39:30.876ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_a3b35764-07da-4d8e-ab71-2f82fea2b72e") failed: Property not found. retry in 81.41495ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_a3b35764-07da-4d8e-ab71-2f82fea2b72e
4752024-05-20T20:39:31.125ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_a3b35764-07da-4d8e-ab71-2f82fea2b72e") failed: Property not found. retry in 247.213295ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_a3b35764-07da-4d8e-ab71-2f82fea2b72e
4762024-05-20T20:39:31.164ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f55338b5-b00f-4b86-b71e-d8dfd2aabf41") failed: Property not found. retry in 454.76183ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_f55338b5-b00f-4b86-b71e-d8dfd2aabf41
4772024-05-20T20:39:31.173ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e4964c06-6f88-4a3b-a648-893e1b284275") failed: Property not found. retry in 172.562815ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_e4964c06-6f88-4a3b-a648-893e1b284275
4782024-05-20T20:39:31.358ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e4964c06-6f88-4a3b-a648-893e1b284275") failed: Property not found. retry in 381.209181ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_e4964c06-6f88-4a3b-a648-893e1b284275
4792024-05-20T20:39:31.384ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_a3b35764-07da-4d8e-ab71-2f82fea2b72e") failed: Property not found. retry in 579.167534ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_a3b35764-07da-4d8e-ab71-2f82fea2b72e
4802024-05-20T20:39:31.627ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f55338b5-b00f-4b86-b71e-d8dfd2aabf41") failed: Property not found. retry in 515.007095ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_f55338b5-b00f-4b86-b71e-d8dfd2aabf41
4812024-05-20T20:39:31.748ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e4964c06-6f88-4a3b-a648-893e1b284275") failed: Property not found. retry in 846.215146ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_e4964c06-6f88-4a3b-a648-893e1b284275
4822024-05-20T20:39:31.974ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_a3b35764-07da-4d8e-ab71-2f82fea2b72e") failed: Property not found. retry in 445.249584ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_a3b35764-07da-4d8e-ab71-2f82fea2b72e
4832024-05-20T20:39:32.151ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f55338b5-b00f-4b86-b71e-d8dfd2aabf41") failed: Property not found. retry in 700.94958ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_f55338b5-b00f-4b86-b71e-d8dfd2aabf41
4842024-05-20T20:39:32.429ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_a3b35764-07da-4d8e-ab71-2f82fea2b72e") failed: Property not found. retry in 1.472067308s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_a3b35764-07da-4d8e-ab71-2f82fea2b72e
4852024-05-20T20:39:32.604ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e4964c06-6f88-4a3b-a648-893e1b284275") failed: Property not found. retry in 631.02241ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_e4964c06-6f88-4a3b-a648-893e1b284275
4862024-05-20T20:39:32.862ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f55338b5-b00f-4b86-b71e-d8dfd2aabf41") failed: Property not found. retry in 1.170116429s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_f55338b5-b00f-4b86-b71e-d8dfd2aabf41
4872024-05-20T20:39:33.244ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e4964c06-6f88-4a3b-a648-893e1b284275") failed: Property not found. retry in 756.079325ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_e4964c06-6f88-4a3b-a648-893e1b284275
4882024-05-20T20:39:33.434ZINFOSledAgent (ServiceManager): Ensuring bootstrap address fdb0:18c0:4d0d:a02a::2 exists in switch zone file = sled-agent/src/services.rs:2320
4892024-05-20T20:39:33.434ZINFOSledAgent (ServiceManager): Adding bootstrap address file = illumos-utils/src/running_zone.rs:626 zone = oxz_switch
4902024-05-20T20:39:33.909ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_a3b35764-07da-4d8e-ab71-2f82fea2b72e") failed: Property not found. retry in 1.183478354s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_a3b35764-07da-4d8e-ab71-2f82fea2b72e
4912024-05-20T20:39:33.979ZINFOSledAgent (ServiceManager): Forwarding bootstrap traffic via oxBootstrap0 to fe80::8:20ff:fe43:19bc file = sled-agent/src/services.rs:2327
4922024-05-20T20:39:33.984ZINFOSledAgent (ServiceManager): Zone not using gateway (even though underlay is up) file = sled-agent/src/services.rs:2388
4932024-05-20T20:39:34.009ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e4964c06-6f88-4a3b-a648-893e1b284275") failed: Property not found. retry in 702.371668ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_e4964c06-6f88-4a3b-a648-893e1b284275
4942024-05-20T20:39:34.040ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f55338b5-b00f-4b86-b71e-d8dfd2aabf41") failed: Property not found. retry in 837.824657ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_f55338b5-b00f-4b86-b71e-d8dfd2aabf41
4952024-05-20T20:39:34.105ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2573
4962024-05-20T20:39:34.345ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2737
4972024-05-20T20:39:34.534ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2452
4982024-05-20T20:39:34.722ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e4964c06-6f88-4a3b-a648-893e1b284275") failed: Property not found. retry in 824.28927ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_e4964c06-6f88-4a3b-a648-893e1b284275
4992024-05-20T20:39:34.850ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2487
5002024-05-20T20:39:34.887ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f55338b5-b00f-4b86-b71e-d8dfd2aabf41") failed: Property not found. retry in 752.192611ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_f55338b5-b00f-4b86-b71e-d8dfd2aabf41
5012024-05-20T20:39:35.071ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:2787
5022024-05-20T20:39:35.103ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_a3b35764-07da-4d8e-ab71-2f82fea2b72e") failed: Property not found. retry in 655.140475ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_a3b35764-07da-4d8e-ab71-2f82fea2b72e
5032024-05-20T20:39:35.261ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:2814
5042024-05-20T20:39:35.489ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2681
5052024-05-20T20:39:35.555ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e4964c06-6f88-4a3b-a648-893e1b284275") failed: Property not found. retry in 1.212090212s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_e4964c06-6f88-4a3b-a648-893e1b284275
5062024-05-20T20:39:35.691ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2481
5072024-05-20T20:39:35.702ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:3873 new = [fd00:1122:3344:101::2, ::1] old = [::1]
5082024-05-20T20:39:35.702ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:3889
5092024-05-20T20:39:35.702ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:609 zone = oxz_switch
5102024-05-20T20:39:36.265ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:3897
5112024-05-20T20:39:36.271ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:3953
5122024-05-20T20:39:36.407ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4015
5132024-05-20T20:39:36.501ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:3996 rack_subnet = fd00:1122:3344::
5142024-05-20T20:39:36.522ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4043
5152024-05-20T20:39:36.620ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4070
5162024-05-20T20:39:36.741ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:365
5172024-05-20T20:39:36.779ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:413
5182024-05-20T20:39:36.784ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_internal_dns_f55338b5-b00f-4b86-b71e-d8dfd2aabf41
5192024-05-20T20:39:36.784ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_internal_dns_a3b35764-07da-4d8e-ab71-2f82fea2b72e
5202024-05-20T20:39:36.784ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_internal_dns_e4964c06-6f88-4a3b-a648-893e1b284275
5212024-05-20T20:39:36.784ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/86226832-0042-47df-b114-06085792be9d/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
5222024-05-20T20:39:36.784ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/0cb7111d-dee5-4c65-91df-8aa68aeee77e/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
5232024-05-20T20:39:36.785ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 8880446 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:54641 req_id = b43d6109-e749-414d-b751-8db925fdfba6 response_code = 204 uri = /omicron-zones
5242024-05-20T20:39:36.787ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:548
5252024-05-20T20:39:36.836ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:651
5262024-05-20T20:39:36.836ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:689
5272024-05-20T20:39:36.837ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:692 uptime = 2
5282024-05-20T20:39:36.837ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.2.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: None,\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:435
5292024-05-20T20:39:36.864ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:548
5302024-05-20T20:39:36.947ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:381
5312024-05-20T20:39:36.947ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
5322024-05-20T20:39:36.947ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
5332024-05-20T20:39:36.947ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
5342024-05-20T20:39:36.947ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
5352024-05-20T20:39:36.947ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
5362024-05-20T20:39:36.947ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
5372024-05-20T20:39:36.947ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
5382024-05-20T20:39:36.947ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
5392024-05-20T20:39:36.947ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
5402024-05-20T20:39:36.947ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
5412024-05-20T20:39:36.947ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
5422024-05-20T20:39:36.947ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
5432024-05-20T20:39:36.947ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
5442024-05-20T20:39:36.947ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
5452024-05-20T20:39:36.947ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
5462024-05-20T20:39:36.947ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
5472024-05-20T20:39:36.947ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
5482024-05-20T20:39:36.947ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
5492024-05-20T20:39:36.947ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
5502024-05-20T20:39:36.947ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
5512024-05-20T20:39:36.947ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
5522024-05-20T20:39:36.947ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
5532024-05-20T20:39:36.949ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:548
5542024-05-20T20:39:36.994ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:584
5552024-05-20T20:39:36.994ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:259
5562024-05-20T20:39:37.027ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:276
5572024-05-20T20:39:37.028ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:301
5582024-05-20T20:39:37.028ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:193
5592024-05-20T20:39:37.057ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: f55338b5-b00f-4b86-b71e-d8dfd2aabf41, underlay_address: fd00:1122:3344:1::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 96419ba3-f12e-4ccd-8f37-b0d3a3725e86 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: a3b35764-07da-4d8e-ab71-2f82fea2b72e, underlay_address: fd00:1122:3344:2::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 28bf1422-8de2-4580-b168-1e653c2d0ea3 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: e4964c06-6f88-4a3b-a648-893e1b284275, underlay_address: fd00:1122:3344:3::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 040cf7d2-26fc-4968-9626-951fc09450b4 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: eb6fe6a5-1b06-4333-aa2b-b8c6eb43781b, underlay_address: fd00:1122:3344:101::1b, zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 2ce92be2-b9f0-4885-b13f-febe1893037f, kind: Service { id: eb6fe6a5-1b06-4333-aa2b-b8c6eb43781b }, name: Name("ntp-eb6fe6a5-1b06-4333-aa2b-b8c6eb43781b"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 153, 226])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.3.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:430 sled_address = [fd00:1122:3344:101::1]:12345
5602024-05-20T20:39:37.057ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64157
5612024-05-20T20:39:37.057ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: f55338b5-b00f-4b86-b71e-d8dfd2aabf41, dataset_name: DatasetName { pool_name: ZpoolName { id: 96419ba3-f12e-4ccd-8f37-b0d3a3725e86 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
5622024-05-20T20:39:37.057ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: f55338b5-b00f-4b86-b71e-d8dfd2aabf41, dataset_name: DatasetName { pool_name: ZpoolName { id: 96419ba3-f12e-4ccd-8f37-b0d3a3725e86 (zpool), kind: External }, kind: InternalDns }, responder: ... }
5632024-05-20T20:39:37.080ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: a3b35764-07da-4d8e-ab71-2f82fea2b72e, dataset_name: DatasetName { pool_name: ZpoolName { id: 28bf1422-8de2-4580-b168-1e653c2d0ea3 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
5642024-05-20T20:39:37.080ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: a3b35764-07da-4d8e-ab71-2f82fea2b72e, dataset_name: DatasetName { pool_name: ZpoolName { id: 28bf1422-8de2-4580-b168-1e653c2d0ea3 (zpool), kind: External }, kind: InternalDns }, responder: ... }
5652024-05-20T20:39:37.098ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e4964c06-6f88-4a3b-a648-893e1b284275, dataset_name: DatasetName { pool_name: ZpoolName { id: 040cf7d2-26fc-4968-9626-951fc09450b4 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
5662024-05-20T20:39:37.098ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: e4964c06-6f88-4a3b-a648-893e1b284275, dataset_name: DatasetName { pool_name: ZpoolName { id: 040cf7d2-26fc-4968-9626-951fc09450b4 (zpool), kind: External }, kind: InternalDns }, responder: ... }
5672024-05-20T20:39:37.115ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
5682024-05-20T20:39:37.115ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/86226832-0042-47df-b114-06085792be9d/config/omicron-zones.json file = common/src/ledger.rs:177
5692024-05-20T20:39:37.115ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/0cb7111d-dee5-4c65-91df-8aa68aeee77e/config/omicron-zones.json file = common/src/ledger.rs:177
5702024-05-20T20:39:37.115ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
5712024-05-20T20:39:37.126ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:259
5722024-05-20T20:39:37.159ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:276
5732024-05-20T20:39:37.159ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:301
5742024-05-20T20:39:37.159ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:193
5752024-05-20T20:39:37.203ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:394 port = Port { inner: PortInner { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 153, 226]), slot: 0, vni: Vni { inner: 100 }, gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 }, vnic: "vopte0" } }
5762024-05-20T20:39:37.203ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1290 zone_type = ntp
5772024-05-20T20:39:37.204ZINFOSledAgent (ServiceManager): no nat entry found for: V4( Ipv4Network { addr: 10.151.2.169, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:102
5782024-05-20T20:39:37.204ZINFOSledAgent (ServiceManager): creating nat entry for: V4( Ipv4Network { addr: 10.151.2.169, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:109
5792024-05-20T20:39:37.204ZINFOSledAgent (ServiceManager): creation of nat entry successful for: V4( Ipv4Network { addr: 10.151.2.169, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:137
5802024-05-20T20:39:37.207ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
5812024-05-20T20:39:37.230ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_eb6fe6a5-1b06-4333-aa2b-b8c6eb43781b file = illumos-utils/src/zone.rs:315
5822024-05-20T20:39:37.248ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_eb6fe6a5-1b06-4333-aa2b-b8c6eb43781b file = illumos-utils/src/zone.rs:354
5832024-05-20T20:39:37.863ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_eb6fe6a5-1b06-4333-aa2b-b8c6eb43781b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService4"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::1b"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value="fd00:1122:3344:100::/56"/> <propval type="boolean" name="boundary" value="true"/> <propval type="astring" name="server" value="0.pool.ntp.org"/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value="vopte0"/> <propval type="astring" name="gateway" value="172.30.3.1"/> <propval type="astring" name="ip" value="172.30.3.5"/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
5842024-05-20T20:39:37.863ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_ntp_eb6fe6a5-1b06-4333-aa2b-b8c6eb43781b
5852024-05-20T20:39:37.988ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_eb6fe6a5-1b06-4333-aa2b-b8c6eb43781b") failed: Property not found. retry in 64.024446ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_eb6fe6a5-1b06-4333-aa2b-b8c6eb43781b
5862024-05-20T20:39:38.070ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_eb6fe6a5-1b06-4333-aa2b-b8c6eb43781b") failed: Property not found. retry in 59.669966ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_eb6fe6a5-1b06-4333-aa2b-b8c6eb43781b
5872024-05-20T20:39:38.172ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_eb6fe6a5-1b06-4333-aa2b-b8c6eb43781b") failed: Property not found. retry in 284.967382ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_eb6fe6a5-1b06-4333-aa2b-b8c6eb43781b
5882024-05-20T20:39:38.469ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_eb6fe6a5-1b06-4333-aa2b-b8c6eb43781b") failed: Property not found. retry in 352.607537ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_eb6fe6a5-1b06-4333-aa2b-b8c6eb43781b
5892024-05-20T20:39:38.830ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_eb6fe6a5-1b06-4333-aa2b-b8c6eb43781b") failed: Property not found. retry in 668.932475ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_eb6fe6a5-1b06-4333-aa2b-b8c6eb43781b
5902024-05-20T20:39:39.509ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_eb6fe6a5-1b06-4333-aa2b-b8c6eb43781b") failed: Property not found. retry in 1.408888092s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_eb6fe6a5-1b06-4333-aa2b-b8c6eb43781b
5912024-05-20T20:39:40.143ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:32993
5922024-05-20T20:39:40.143ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 91 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:32993 req_id = e5d69722-577c-4fbe-b56c-cca865733dce response_code = 200 uri = /baseboard
5932024-05-20T20:39:40.927ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_eb6fe6a5-1b06-4333-aa2b-b8c6eb43781b") failed: Property not found. retry in 1.394062437s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_eb6fe6a5-1b06-4333-aa2b-b8c6eb43781b
5942024-05-20T20:39:42.331ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_eb6fe6a5-1b06-4333-aa2b-b8c6eb43781b") failed: Property not found. retry in 1.133625348s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_eb6fe6a5-1b06-4333-aa2b-b8c6eb43781b
5952024-05-20T20:39:43.483ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_ntp_eb6fe6a5-1b06-4333-aa2b-b8c6eb43781b
5962024-05-20T20:39:43.483ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/86226832-0042-47df-b114-06085792be9d/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
5972024-05-20T20:39:43.483ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/0cb7111d-dee5-4c65-91df-8aa68aeee77e/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
5982024-05-20T20:39:43.484ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 6426635 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:64157 req_id = e15bbc5a-6617-4f38-b24f-a06b13c2f304 response_code = 204 uri = /omicron-zones
5992024-05-20T20:39:43.486ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:625
6002024-05-20T20:39:43.515ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
6012024-05-20T20:39:43.515ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43778
6022024-05-20T20:39:43.524ZINFOSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_eb6fe6a5-1b06-4333-aa2b-b8c6eb43781b': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3603
6032024-05-20T20:39:43.524ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:866 latency_us = 9111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43778 req_id = 3e29d8f6-e526-490d-b7ae-de9bca8a8a55 response_code = 500 uri = /timesync
6042024-05-20T20:39:43.527ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
6052024-05-20T20:39:43.696ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
6062024-05-20T20:39:43.696ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52409
6072024-05-20T20:39:47.704ZINFOSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_eb6fe6a5-1b06-4333-aa2b-b8c6eb43781b': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3603
6082024-05-20T20:39:47.704ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:866 latency_us = 4007917 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:52409 req_id = 8555b6f5-ef43-4f8a-88fc-a92176bfe792 response_code = 500 uri = /timesync
6092024-05-20T20:39:47.708ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
6102024-05-20T20:39:47.813ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
6112024-05-20T20:39:47.813ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43947
6122024-05-20T20:39:47.822ZINFOSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_eb6fe6a5-1b06-4333-aa2b-b8c6eb43781b': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3603
6132024-05-20T20:39:47.822ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:866 latency_us = 8793 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43947 req_id = 740b51ee-9222-440c-bc39-628856d9ed3a response_code = 500 uri = /timesync
6142024-05-20T20:39:47.824ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
6152024-05-20T20:39:48.032ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
6162024-05-20T20:39:48.033ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62702
6172024-05-20T20:39:48.041ZINFOSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_eb6fe6a5-1b06-4333-aa2b-b8c6eb43781b': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3603
6182024-05-20T20:39:48.041ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:866 latency_us = 8462 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:62702 req_id = 92f72885-f824-471c-9734-d3423071b04a response_code = 500 uri = /timesync
6192024-05-20T20:39:48.044ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
6202024-05-20T20:39:48.168ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
6212024-05-20T20:39:48.168ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59106
6222024-05-20T20:39:50.177ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 2008660 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:59106 req_id = 997edda5-e79d-42e9-a939-86e7f4bba522 response_code = 200 uri = /timesync
6232024-05-20T20:39:50.181ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:633
6242024-05-20T20:39:50.181ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
6252024-05-20T20:39:50.451ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
6262024-05-20T20:39:50.451ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35771
6272024-05-20T20:39:50.461ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 9330 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:35771 req_id = 2434e6a3-116d-45f9-ab93-b54eb9073ee1 response_code = 200 uri = /timesync
6282024-05-20T20:39:50.463ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:633
6292024-05-20T20:39:50.463ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
6302024-05-20T20:39:50.731ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
6312024-05-20T20:39:50.731ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56017
6322024-05-20T20:39:50.740ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 8873 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:56017 req_id = f8bf443e-e16b-471e-b3ad-8c3910ca8a97 response_code = 200 uri = /timesync
6332024-05-20T20:39:50.743ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:633
6342024-05-20T20:39:50.743ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
6352024-05-20T20:39:51.203ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
6362024-05-20T20:39:51.203ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54601
6372024-05-20T20:39:51.212ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 8236 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:54601 req_id = d68d6809-11b8-4d70-b70a-6fbe26e4d5aa response_code = 200 uri = /timesync
6382024-05-20T20:39:51.214ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:633
6392024-05-20T20:39:51.214ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
6402024-05-20T20:39:51.469ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
6412024-05-20T20:39:51.469ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45269
6422024-05-20T20:39:51.478ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 8404 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:45269 req_id = 9d16254b-4e7c-4613-a6b5-8dd3fff8d851 response_code = 200 uri = /timesync
6432024-05-20T20:39:51.480ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:633
6442024-05-20T20:39:51.480ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
6452024-05-20T20:39:52.123ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
6462024-05-20T20:39:52.124ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39099
6472024-05-20T20:39:52.133ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 9058 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39099 req_id = 0526a587-9f5c-422e-a731-7fcd27b01c18 response_code = 200 uri = /timesync
6482024-05-20T20:39:52.135ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:633
6492024-05-20T20:39:52.135ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
6502024-05-20T20:39:52.827ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
6512024-05-20T20:39:52.827ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59978
6522024-05-20T20:39:52.835ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 8334 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:59978 req_id = 4bcc7680-f9d5-488e-8013-99c95ca16c91 response_code = 200 uri = /timesync
6532024-05-20T20:39:52.837ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:633
6542024-05-20T20:39:52.837ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
6552024-05-20T20:39:54.030ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
6562024-05-20T20:39:54.030ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33575
6572024-05-20T20:39:54.039ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 8311 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:33575 req_id = 81770877-0ef0-49e1-a8ac-efda10b67e95 response_code = 200 uri = /timesync
6582024-05-20T20:39:54.042ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:633
6592024-05-20T20:39:54.042ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
6602024-05-20T20:39:55.106ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
6612024-05-20T20:39:55.107ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54015
6622024-05-20T20:39:55.114ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 7581 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:54015 req_id = 362f426c-d943-45ec-9d2b-a952ce4187d0 response_code = 200 uri = /timesync
6632024-05-20T20:39:55.116ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:633
6642024-05-20T20:39:55.116ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
6652024-05-20T20:39:55.750ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
6662024-05-20T20:39:55.750ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48940
6672024-05-20T20:39:55.759ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 8326 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:48940 req_id = f66ec3e4-6c1a-49a8-9137-4667130b0e82 response_code = 200 uri = /timesync
6682024-05-20T20:39:55.761ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:633
6692024-05-20T20:39:55.761ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
6702024-05-20T20:39:56.242ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 189.042907ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:417 sled_id = 082c2565-a0d4-4ca8-a689-9276c9a9c8af
6712024-05-20T20:39:56.354ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
6722024-05-20T20:39:56.354ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45878
6732024-05-20T20:39:56.362ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 8285 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:45878 req_id = 867cbfa3-6f0f-4eb9-b9d5-ff4a763c53d6 response_code = 200 uri = /timesync
6742024-05-20T20:39:56.366ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.036116999 } file = sled-agent/src/rack_setup/service.rs:633
6752024-05-20T20:39:56.366ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
6762024-05-20T20:39:57.071ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
6772024-05-20T20:39:57.071ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63317
6782024-05-20T20:39:57.081ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 9185 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:63317 req_id = b6de13fb-1c77-4a54-8b00-9a96d755cc1f response_code = 200 uri = /timesync
6792024-05-20T20:39:57.083ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.034177035 } file = sled-agent/src/rack_setup/service.rs:633
6802024-05-20T20:39:57.083ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
6812024-05-20T20:39:59.332ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
6822024-05-20T20:39:59.332ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52973
6832024-05-20T20:39:59.340ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 8146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:52973 req_id = 123cc5fd-c4ad-4615-aac6-0df19bf44d44 response_code = 200 uri = /timesync
6842024-05-20T20:39:59.343ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.028072976 } file = sled-agent/src/rack_setup/service.rs:633
6852024-05-20T20:39:59.343ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
6862024-05-20T20:40:01.141ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
6872024-05-20T20:40:01.141ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44800
6882024-05-20T20:40:01.150ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 8453 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:44800 req_id = 097a0028-7ee1-4e33-8246-2aee4fb37812 response_code = 200 uri = /timesync
6892024-05-20T20:40:01.152ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.023185862 } file = sled-agent/src/rack_setup/service.rs:633
6902024-05-20T20:40:01.152ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
6912024-05-20T20:40:02.514ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
6922024-05-20T20:40:02.514ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41759
6932024-05-20T20:40:02.523ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 8647 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41759 req_id = a383326e-f860-424a-abea-6599229d7cbb response_code = 200 uri = /timesync
6942024-05-20T20:40:02.525ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.019477943 } file = sled-agent/src/rack_setup/service.rs:633
6952024-05-20T20:40:02.525ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
6962024-05-20T20:40:04.363ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
6972024-05-20T20:40:04.363ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37022
6982024-05-20T20:40:04.371ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 8225 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:37022 req_id = 00af69dc-106d-4c9f-b1a9-8f2f54c0662d response_code = 200 uri = /timesync
6992024-05-20T20:40:04.374ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.014484595 } file = sled-agent/src/rack_setup/service.rs:633
7002024-05-20T20:40:04.374ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
7012024-05-20T20:40:07.456ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
7022024-05-20T20:40:07.456ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48949
7032024-05-20T20:40:07.465ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 8765 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:48949 req_id = 213372a0-9af8-426c-b208-b781a3c06ba2 response_code = 200 uri = /timesync
7042024-05-20T20:40:07.467ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.006128627 } file = sled-agent/src/rack_setup/service.rs:633
7052024-05-20T20:40:07.467ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
7062024-05-20T20:40:10.493ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
7072024-05-20T20:40:10.493ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34991
7082024-05-20T20:40:10.502ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 8482 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:34991 req_id = ea9e5b46-a88a-484b-9c19-893bfb67ee57 response_code = 200 uri = /timesync
7092024-05-20T20:40:10.504ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -1.6641e-5 } file = sled-agent/src/rack_setup/service.rs:633
7102024-05-20T20:40:10.504ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
7112024-05-20T20:40:10.690ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:46685
7122024-05-20T20:40:10.690ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 65 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:46685 req_id = 7d465bba-6219-45f1-9ff3-a84e18534fe7 response_code = 200 uri = /baseboard
7132024-05-20T20:40:11.503ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 487.653642ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:417 sled_id = 082c2565-a0d4-4ca8-a689-9276c9a9c8af
7142024-05-20T20:40:16.133ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
7152024-05-20T20:40:16.133ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55308
7162024-05-20T20:40:16.142ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 9365 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:55308 req_id = 0dd7f7b2-0cdc-49fd-abea-4493d17a3efc response_code = 200 uri = /timesync
7172024-05-20T20:40:16.145ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -1.6539e-5 } file = sled-agent/src/rack_setup/service.rs:633
7182024-05-20T20:40:16.145ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
7192024-05-20T20:40:18.999ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
7202024-05-20T20:40:18.999ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62538
7212024-05-20T20:40:19.008ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 8775 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:62538 req_id = 2ba3f725-c336-4323-949d-cb573293dead response_code = 200 uri = /timesync
7222024-05-20T20:40:19.009ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -1.6487e-5 } file = sled-agent/src/rack_setup/service.rs:633
7232024-05-20T20:40:19.009ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
7242024-05-20T20:40:24.572ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
7252024-05-20T20:40:24.572ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58765
7262024-05-20T20:40:24.580ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 8516 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:58765 req_id = 6d8865d4-e469-4636-90d7-37f59e2bfa7d response_code = 200 uri = /timesync
7272024-05-20T20:40:24.582ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -1.6387e-5 } file = sled-agent/src/rack_setup/service.rs:633
7282024-05-20T20:40:24.582ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
7292024-05-20T20:40:27.026ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 653.778213ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:417 sled_id = 082c2565-a0d4-4ca8-a689-9276c9a9c8af
7302024-05-20T20:40:36.376ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
7312024-05-20T20:40:36.376ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46786
7322024-05-20T20:40:36.385ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 8723 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46786 req_id = 08945f05-8671-472c-ab6e-ca28fd7b9a49 response_code = 200 uri = /timesync
7332024-05-20T20:40:36.387ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -1.6174e-5 } file = sled-agent/src/rack_setup/service.rs:633
7342024-05-20T20:40:36.387ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
7352024-05-20T20:40:40.730ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:50659
7362024-05-20T20:40:40.730ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 36 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:50659 req_id = ce317a95-75d7-4ebc-9486-c37d93ae28a3 response_code = 200 uri = /baseboard
7372024-05-20T20:40:42.717ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 2.369213322s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:417 sled_id = 082c2565-a0d4-4ca8-a689-9276c9a9c8af
7382024-05-20T20:40:46.959ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
7392024-05-20T20:40:46.959ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56087
7402024-05-20T20:40:46.968ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 8925 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:56087 req_id = 91c8da0b-c52b-4546-b9ea-13ce6094b385 response_code = 200 uri = /timesync
7412024-05-20T20:40:46.971ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -1.5983e-5 } file = sled-agent/src/rack_setup/service.rs:633
7422024-05-20T20:40:46.971ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
7432024-05-20T20:40:59.303ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
7442024-05-20T20:40:59.303ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46981
7452024-05-20T20:40:59.313ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 9100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46981 req_id = a1be07ef-522c-4076-99d8-76bd0a8ee1b3 response_code = 200 uri = /timesync
7462024-05-20T20:40:59.315ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -1.576e-5 } file = sled-agent/src/rack_setup/service.rs:633
7472024-05-20T20:40:59.315ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
7482024-05-20T20:41:00.122ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 2.536788981s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:417 sled_id = 082c2565-a0d4-4ca8-a689-9276c9a9c8af
7492024-05-20T20:41:06.573ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
7502024-05-20T20:41:06.573ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43235
7512024-05-20T20:41:06.583ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 10070 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43235 req_id = 93bfe554-3245-453c-ab3c-b41d4d900bdf response_code = 200 uri = /timesync
7522024-05-20T20:41:06.586ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.001999454 } file = sled-agent/src/rack_setup/service.rs:633
7532024-05-20T20:41:06.586ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
7542024-05-20T20:41:10.762ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:45070
7552024-05-20T20:41:10.762ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 64 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:45070 req_id = 0a43cd01-18f2-4928-8e8f-66fb5dcfb7cf response_code = 200 uri = /baseboard
7562024-05-20T20:41:16.316ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
7572024-05-20T20:41:16.316ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64538
7582024-05-20T20:41:16.325ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 8851 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:64538 req_id = b294b314-e919-4383-89f5-1a806696df26 response_code = 200 uri = /timesync
7592024-05-20T20:41:16.328ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.001961587 } file = sled-agent/src/rack_setup/service.rs:633
7602024-05-20T20:41:16.328ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
7612024-05-20T20:41:17.693ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 7.333927612s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:417 sled_id = 082c2565-a0d4-4ca8-a689-9276c9a9c8af
7622024-05-20T20:41:40.061ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 19.584707531s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:417 sled_id = 082c2565-a0d4-4ca8-a689-9276c9a9c8af
7632024-05-20T20:41:40.797ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:57474
7642024-05-20T20:41:40.797ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 33 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:57474 req_id = 62f97247-5839-4c25-9553-a7f33ee1fc4d response_code = 200 uri = /baseboard
7652024-05-20T20:41:44.982ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
7662024-05-20T20:41:44.982ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47532
7672024-05-20T20:41:44.991ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 8889 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:47532 req_id = 559bc5b3-a3d8-4749-954f-15644dfa21c4 response_code = 200 uri = /timesync
7682024-05-20T20:41:44.994ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.001850159 } file = sled-agent/src/rack_setup/service.rs:633
7692024-05-20T20:41:44.994ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
7702024-05-20T20:42:10.834ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:56491
7712024-05-20T20:42:10.834ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 54 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:56491 req_id = b03c2cc6-af7c-4441-84ec-bb1f5569033c response_code = 200 uri = /baseboard
7722024-05-20T20:42:11.969ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
7732024-05-20T20:42:11.969ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52537
7742024-05-20T20:42:11.990ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 20564 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:52537 req_id = ae0e301a-6e87-47f7-82b4-8d38a7152ebb response_code = 200 uri = /timesync
7752024-05-20T20:42:11.992ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 395716986, ip_addr: 23.150.41.122, stratum: 5, ref_time: 1716237724.4138014, correction: 0.003491171 } file = sled-agent/src/rack_setup/service.rs:633
7762024-05-20T20:42:11.992ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1216
7772024-05-20T20:42:12.021ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: f55338b5-b00f-4b86-b71e-d8dfd2aabf41, underlay_address: fd00:1122:3344:1::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 96419ba3-f12e-4ccd-8f37-b0d3a3725e86 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: a3b35764-07da-4d8e-ab71-2f82fea2b72e, underlay_address: fd00:1122:3344:2::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 28bf1422-8de2-4580-b168-1e653c2d0ea3 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: e4964c06-6f88-4a3b-a648-893e1b284275, underlay_address: fd00:1122:3344:3::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 040cf7d2-26fc-4968-9626-951fc09450b4 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: eb6fe6a5-1b06-4333-aa2b-b8c6eb43781b, underlay_address: fd00:1122:3344:101::1b, zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 2ce92be2-b9f0-4885-b13f-febe1893037f, kind: Service { id: eb6fe6a5-1b06-4333-aa2b-b8c6eb43781b }, name: Name("ntp-eb6fe6a5-1b06-4333-aa2b-b8c6eb43781b"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 153, 226])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.3.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: add1aa38-2c19-4128-afb9-4ef0c1c573df, underlay_address: fd00:1122:3344:101::3, zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 96419ba3-f12e-4ccd-8f37-b0d3a3725e86 (zpool), kind: External } } } }, OmicronZoneConfig { id: 300a6627-3dd3-4fb3-8c11-31ec45b04ad8, underlay_address: fd00:1122:3344:101::4, zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 28bf1422-8de2-4580-b168-1e653c2d0ea3 (zpool), kind: External } } } }, OmicronZoneConfig { id: a54f1b35-2b42-4794-95c7-0fbef9317c1d, underlay_address: fd00:1122:3344:101::5, zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 040cf7d2-26fc-4968-9626-951fc09450b4 (zpool), kind: External } } } }, OmicronZoneConfig { id: 2184ae6d-adb6-4870-97fe-71bfdf53dac3, underlay_address: fd00:1122:3344:101::6, zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e9a2b279-e51b-488d-83ef-f697a65badba (zpool), kind: External } } } }, OmicronZoneConfig { id: 408f58fe-b1c6-41da-865a-87a0a89099ac, underlay_address: fd00:1122:3344:101::7, zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: bdfd1b72-3c3a-4f33-9b7a-f64e90e24f6a (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:430 sled_address = [fd00:1122:3344:101::1]:12345
7782024-05-20T20:42:12.021ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58077
7792024-05-20T20:42:12.021ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: f55338b5-b00f-4b86-b71e-d8dfd2aabf41, dataset_name: DatasetName { pool_name: ZpoolName { id: 96419ba3-f12e-4ccd-8f37-b0d3a3725e86 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
7802024-05-20T20:42:12.021ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: f55338b5-b00f-4b86-b71e-d8dfd2aabf41, dataset_name: DatasetName { pool_name: ZpoolName { id: 96419ba3-f12e-4ccd-8f37-b0d3a3725e86 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7812024-05-20T20:42:12.044ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: a3b35764-07da-4d8e-ab71-2f82fea2b72e, dataset_name: DatasetName { pool_name: ZpoolName { id: 28bf1422-8de2-4580-b168-1e653c2d0ea3 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
7822024-05-20T20:42:12.044ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: a3b35764-07da-4d8e-ab71-2f82fea2b72e, dataset_name: DatasetName { pool_name: ZpoolName { id: 28bf1422-8de2-4580-b168-1e653c2d0ea3 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7832024-05-20T20:42:12.062ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e4964c06-6f88-4a3b-a648-893e1b284275, dataset_name: DatasetName { pool_name: ZpoolName { id: 040cf7d2-26fc-4968-9626-951fc09450b4 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
7842024-05-20T20:42:12.062ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: e4964c06-6f88-4a3b-a648-893e1b284275, dataset_name: DatasetName { pool_name: ZpoolName { id: 040cf7d2-26fc-4968-9626-951fc09450b4 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7852024-05-20T20:42:12.079ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: add1aa38-2c19-4128-afb9-4ef0c1c573df, dataset_name: DatasetName { pool_name: ZpoolName { id: 96419ba3-f12e-4ccd-8f37-b0d3a3725e86 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
7862024-05-20T20:42:12.079ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: add1aa38-2c19-4128-afb9-4ef0c1c573df, dataset_name: DatasetName { pool_name: ZpoolName { id: 96419ba3-f12e-4ccd-8f37-b0d3a3725e86 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
7872024-05-20T20:42:12.131ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 300a6627-3dd3-4fb3-8c11-31ec45b04ad8, dataset_name: DatasetName { pool_name: ZpoolName { id: 28bf1422-8de2-4580-b168-1e653c2d0ea3 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
7882024-05-20T20:42:12.131ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 300a6627-3dd3-4fb3-8c11-31ec45b04ad8, dataset_name: DatasetName { pool_name: ZpoolName { id: 28bf1422-8de2-4580-b168-1e653c2d0ea3 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
7892024-05-20T20:42:12.182ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: a54f1b35-2b42-4794-95c7-0fbef9317c1d, dataset_name: DatasetName { pool_name: ZpoolName { id: 040cf7d2-26fc-4968-9626-951fc09450b4 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
7902024-05-20T20:42:12.182ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: a54f1b35-2b42-4794-95c7-0fbef9317c1d, dataset_name: DatasetName { pool_name: ZpoolName { id: 040cf7d2-26fc-4968-9626-951fc09450b4 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
7912024-05-20T20:42:12.233ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 2184ae6d-adb6-4870-97fe-71bfdf53dac3, dataset_name: DatasetName { pool_name: ZpoolName { id: e9a2b279-e51b-488d-83ef-f697a65badba (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
7922024-05-20T20:42:12.233ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 2184ae6d-adb6-4870-97fe-71bfdf53dac3, dataset_name: DatasetName { pool_name: ZpoolName { id: e9a2b279-e51b-488d-83ef-f697a65badba (zpool), kind: External }, kind: CockroachDb }, responder: ... }
7932024-05-20T20:42:12.285ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 408f58fe-b1c6-41da-865a-87a0a89099ac, dataset_name: DatasetName { pool_name: ZpoolName { id: bdfd1b72-3c3a-4f33-9b7a-f64e90e24f6a (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
7942024-05-20T20:42:12.285ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 408f58fe-b1c6-41da-865a-87a0a89099ac, dataset_name: DatasetName { pool_name: ZpoolName { id: bdfd1b72-3c3a-4f33-9b7a-f64e90e24f6a (zpool), kind: External }, kind: CockroachDb }, responder: ... }
7952024-05-20T20:42:12.335ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
7962024-05-20T20:42:12.335ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/86226832-0042-47df-b114-06085792be9d/config/omicron-zones.json file = common/src/ledger.rs:177
7972024-05-20T20:42:12.336ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/0cb7111d-dee5-4c65-91df-8aa68aeee77e/config/omicron-zones.json file = common/src/ledger.rs:177
7982024-05-20T20:42:12.336ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
7992024-05-20T20:42:12.415ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
8002024-05-20T20:42:12.415ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
8012024-05-20T20:42:12.415ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
8022024-05-20T20:42:12.415ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
8032024-05-20T20:42:12.415ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
8042024-05-20T20:42:12.506ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_408f58fe-b1c6-41da-865a-87a0a89099ac file = illumos-utils/src/zone.rs:315
8052024-05-20T20:42:12.510ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_add1aa38-2c19-4128-afb9-4ef0c1c573df file = illumos-utils/src/zone.rs:315
8062024-05-20T20:42:12.514ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_2184ae6d-adb6-4870-97fe-71bfdf53dac3 file = illumos-utils/src/zone.rs:315
8072024-05-20T20:42:12.519ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_a54f1b35-2b42-4794-95c7-0fbef9317c1d file = illumos-utils/src/zone.rs:315
8082024-05-20T20:42:12.523ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_300a6627-3dd3-4fb3-8c11-31ec45b04ad8 file = illumos-utils/src/zone.rs:315
8092024-05-20T20:42:12.528ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_408f58fe-b1c6-41da-865a-87a0a89099ac file = illumos-utils/src/zone.rs:354
8102024-05-20T20:42:12.532ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_add1aa38-2c19-4128-afb9-4ef0c1c573df file = illumos-utils/src/zone.rs:354
8112024-05-20T20:42:12.536ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_2184ae6d-adb6-4870-97fe-71bfdf53dac3 file = illumos-utils/src/zone.rs:354
8122024-05-20T20:42:12.541ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_a54f1b35-2b42-4794-95c7-0fbef9317c1d file = illumos-utils/src/zone.rs:354
8132024-05-20T20:42:12.545ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_300a6627-3dd3-4fb3-8c11-31ec45b04ad8 file = illumos-utils/src/zone.rs:354
8142024-05-20T20:42:14.682ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 39.9452008s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:417 sled_id = 082c2565-a0d4-4ca8-a689-9276c9a9c8af
8152024-05-20T20:42:15.238ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_2184ae6d-adb6-4870-97fe-71bfdf53dac3: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService7"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::6"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::6"/> <propval type="astring" name="listen_port" value="32221"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> <value_node value="fd00:1122:3344:1::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8162024-05-20T20:42:15.240ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_cockroachdb_2184ae6d-adb6-4870-97fe-71bfdf53dac3
8172024-05-20T20:42:15.246ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_a54f1b35-2b42-4794-95c7-0fbef9317c1d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService8"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::5"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::5"/> <propval type="astring" name="listen_port" value="32221"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> <value_node value="fd00:1122:3344:1::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8182024-05-20T20:42:15.247ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_cockroachdb_a54f1b35-2b42-4794-95c7-0fbef9317c1d
8192024-05-20T20:42:15.253ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_add1aa38-2c19-4128-afb9-4ef0c1c573df: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService6"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::3"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::3"/> <propval type="astring" name="listen_port" value="32221"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> <value_node value="fd00:1122:3344:1::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8202024-05-20T20:42:15.253ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_cockroachdb_add1aa38-2c19-4128-afb9-4ef0c1c573df
8212024-05-20T20:42:15.308ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_300a6627-3dd3-4fb3-8c11-31ec45b04ad8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService9"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::4"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::4"/> <propval type="astring" name="listen_port" value="32221"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> <value_node value="fd00:1122:3344:1::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8222024-05-20T20:42:15.308ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_cockroachdb_300a6627-3dd3-4fb3-8c11-31ec45b04ad8
8232024-05-20T20:42:15.319ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_408f58fe-b1c6-41da-865a-87a0a89099ac: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService5"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::7"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::7"/> <propval type="astring" name="listen_port" value="32221"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> <value_node value="fd00:1122:3344:1::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8242024-05-20T20:42:15.319ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_cockroachdb_408f58fe-b1c6-41da-865a-87a0a89099ac
8252024-05-20T20:42:15.385ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2184ae6d-adb6-4870-97fe-71bfdf53dac3") failed: Property not found. retry in 45.240159ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2184ae6d-adb6-4870-97fe-71bfdf53dac3
8262024-05-20T20:42:15.393ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a54f1b35-2b42-4794-95c7-0fbef9317c1d") failed: Property not found. retry in 56.694077ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a54f1b35-2b42-4794-95c7-0fbef9317c1d
8272024-05-20T20:42:15.400ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_add1aa38-2c19-4128-afb9-4ef0c1c573df") failed: Property not found. retry in 51.712044ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_add1aa38-2c19-4128-afb9-4ef0c1c573df
8282024-05-20T20:42:15.439ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2184ae6d-adb6-4870-97fe-71bfdf53dac3") failed: Property not found. retry in 88.177445ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2184ae6d-adb6-4870-97fe-71bfdf53dac3
8292024-05-20T20:42:15.458ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_300a6627-3dd3-4fb3-8c11-31ec45b04ad8") failed: Property not found. retry in 44.605522ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_300a6627-3dd3-4fb3-8c11-31ec45b04ad8
8302024-05-20T20:42:15.552ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_408f58fe-b1c6-41da-865a-87a0a89099ac") failed: Property not found. retry in 28.125811ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_408f58fe-b1c6-41da-865a-87a0a89099ac
8312024-05-20T20:42:15.698ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_add1aa38-2c19-4128-afb9-4ef0c1c573df") failed: Property not found. retry in 118.65207ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_add1aa38-2c19-4128-afb9-4ef0c1c573df
8322024-05-20T20:42:16.427ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a54f1b35-2b42-4794-95c7-0fbef9317c1d") failed: Property not found. retry in 51.456549ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a54f1b35-2b42-4794-95c7-0fbef9317c1d
8332024-05-20T20:42:16.565ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_408f58fe-b1c6-41da-865a-87a0a89099ac") failed: Property not found. retry in 59.450988ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_408f58fe-b1c6-41da-865a-87a0a89099ac
8342024-05-20T20:42:16.620ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_add1aa38-2c19-4128-afb9-4ef0c1c573df") failed: Property not found. retry in 122.034368ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_add1aa38-2c19-4128-afb9-4ef0c1c573df
8352024-05-20T20:42:17.293ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2184ae6d-adb6-4870-97fe-71bfdf53dac3") failed: Property not found. retry in 178.055291ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2184ae6d-adb6-4870-97fe-71bfdf53dac3
8362024-05-20T20:42:17.531ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a54f1b35-2b42-4794-95c7-0fbef9317c1d") failed: Property not found. retry in 261.101275ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a54f1b35-2b42-4794-95c7-0fbef9317c1d
8372024-05-20T20:42:17.611ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_300a6627-3dd3-4fb3-8c11-31ec45b04ad8") failed: Property not found. retry in 68.445831ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_300a6627-3dd3-4fb3-8c11-31ec45b04ad8
8382024-05-20T20:42:17.640ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_408f58fe-b1c6-41da-865a-87a0a89099ac") failed: Property not found. retry in 175.042089ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_408f58fe-b1c6-41da-865a-87a0a89099ac
8392024-05-20T20:42:17.664ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_add1aa38-2c19-4128-afb9-4ef0c1c573df") failed: Property not found. retry in 446.028572ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_add1aa38-2c19-4128-afb9-4ef0c1c573df
8402024-05-20T20:42:17.731ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2184ae6d-adb6-4870-97fe-71bfdf53dac3") failed: Property not found. retry in 488.909448ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2184ae6d-adb6-4870-97fe-71bfdf53dac3
8412024-05-20T20:42:17.759ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_300a6627-3dd3-4fb3-8c11-31ec45b04ad8") failed: Property not found. retry in 156.52525ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_300a6627-3dd3-4fb3-8c11-31ec45b04ad8
8422024-05-20T20:42:17.802ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a54f1b35-2b42-4794-95c7-0fbef9317c1d") failed: Property not found. retry in 355.748893ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a54f1b35-2b42-4794-95c7-0fbef9317c1d
8432024-05-20T20:42:17.827ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_408f58fe-b1c6-41da-865a-87a0a89099ac") failed: Property not found. retry in 484.768999ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_408f58fe-b1c6-41da-865a-87a0a89099ac
8442024-05-20T20:42:17.926ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_300a6627-3dd3-4fb3-8c11-31ec45b04ad8") failed: Property not found. retry in 447.342826ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_300a6627-3dd3-4fb3-8c11-31ec45b04ad8
8452024-05-20T20:42:18.120ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_add1aa38-2c19-4128-afb9-4ef0c1c573df") failed: Property not found. retry in 755.00715ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_add1aa38-2c19-4128-afb9-4ef0c1c573df
8462024-05-20T20:42:18.170ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a54f1b35-2b42-4794-95c7-0fbef9317c1d") failed: Property not found. retry in 1.051996662s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a54f1b35-2b42-4794-95c7-0fbef9317c1d
8472024-05-20T20:42:18.231ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2184ae6d-adb6-4870-97fe-71bfdf53dac3") failed: Property not found. retry in 559.512538ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2184ae6d-adb6-4870-97fe-71bfdf53dac3
8482024-05-20T20:42:18.327ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_408f58fe-b1c6-41da-865a-87a0a89099ac") failed: Property not found. retry in 845.908478ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_408f58fe-b1c6-41da-865a-87a0a89099ac
8492024-05-20T20:42:18.386ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_300a6627-3dd3-4fb3-8c11-31ec45b04ad8") failed: Property not found. retry in 780.255495ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_300a6627-3dd3-4fb3-8c11-31ec45b04ad8
8502024-05-20T20:42:18.799ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2184ae6d-adb6-4870-97fe-71bfdf53dac3") failed: Property not found. retry in 566.810313ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2184ae6d-adb6-4870-97fe-71bfdf53dac3
8512024-05-20T20:42:18.883ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_add1aa38-2c19-4128-afb9-4ef0c1c573df") failed: Property not found. retry in 953.07026ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_add1aa38-2c19-4128-afb9-4ef0c1c573df
8522024-05-20T20:42:19.175ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_300a6627-3dd3-4fb3-8c11-31ec45b04ad8") failed: Property not found. retry in 583.70109ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_300a6627-3dd3-4fb3-8c11-31ec45b04ad8
8532024-05-20T20:42:19.182ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_408f58fe-b1c6-41da-865a-87a0a89099ac") failed: Property not found. retry in 1.059253996s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_408f58fe-b1c6-41da-865a-87a0a89099ac
8542024-05-20T20:42:19.228ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a54f1b35-2b42-4794-95c7-0fbef9317c1d") failed: Property not found. retry in 1.450400816s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a54f1b35-2b42-4794-95c7-0fbef9317c1d
8552024-05-20T20:42:19.374ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2184ae6d-adb6-4870-97fe-71bfdf53dac3") failed: Property not found. retry in 887.131734ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2184ae6d-adb6-4870-97fe-71bfdf53dac3
8562024-05-20T20:42:19.768ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_300a6627-3dd3-4fb3-8c11-31ec45b04ad8") failed: Property not found. retry in 647.395597ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_300a6627-3dd3-4fb3-8c11-31ec45b04ad8
8572024-05-20T20:42:19.845ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_add1aa38-2c19-4128-afb9-4ef0c1c573df") failed: Property not found. retry in 1.273062822s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_add1aa38-2c19-4128-afb9-4ef0c1c573df
8582024-05-20T20:42:20.251ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_408f58fe-b1c6-41da-865a-87a0a89099ac") failed: Property not found. retry in 734.600153ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_408f58fe-b1c6-41da-865a-87a0a89099ac
8592024-05-20T20:42:20.271ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2184ae6d-adb6-4870-97fe-71bfdf53dac3") failed: Property not found. retry in 592.785164ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2184ae6d-adb6-4870-97fe-71bfdf53dac3
8602024-05-20T20:42:20.428ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_300a6627-3dd3-4fb3-8c11-31ec45b04ad8") failed: Property not found. retry in 1.023208767s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_300a6627-3dd3-4fb3-8c11-31ec45b04ad8
8612024-05-20T20:42:20.691ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a54f1b35-2b42-4794-95c7-0fbef9317c1d") failed: Property not found. retry in 1.076330766s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a54f1b35-2b42-4794-95c7-0fbef9317c1d
8622024-05-20T20:42:20.875ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2184ae6d-adb6-4870-97fe-71bfdf53dac3") failed: Property not found. retry in 970.173675ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2184ae6d-adb6-4870-97fe-71bfdf53dac3
8632024-05-20T20:42:20.997ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_408f58fe-b1c6-41da-865a-87a0a89099ac") failed: Property not found. retry in 1.332831617s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_408f58fe-b1c6-41da-865a-87a0a89099ac
8642024-05-20T20:42:21.127ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_add1aa38-2c19-4128-afb9-4ef0c1c573df") failed: Property not found. retry in 1.178750395s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_add1aa38-2c19-4128-afb9-4ef0c1c573df
8652024-05-20T20:42:21.459ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_300a6627-3dd3-4fb3-8c11-31ec45b04ad8") failed: Property not found. retry in 1.032605878s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_300a6627-3dd3-4fb3-8c11-31ec45b04ad8
8662024-05-20T20:42:21.775ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a54f1b35-2b42-4794-95c7-0fbef9317c1d") failed: Property not found. retry in 1.151889575s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a54f1b35-2b42-4794-95c7-0fbef9317c1d
8672024-05-20T20:42:21.853ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2184ae6d-adb6-4870-97fe-71bfdf53dac3") failed: Property not found. retry in 647.13285ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2184ae6d-adb6-4870-97fe-71bfdf53dac3
8682024-05-20T20:42:22.314ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_add1aa38-2c19-4128-afb9-4ef0c1c573df") failed: Property not found. retry in 1.091584397s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_add1aa38-2c19-4128-afb9-4ef0c1c573df
8692024-05-20T20:42:22.338ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_408f58fe-b1c6-41da-865a-87a0a89099ac") failed: Property not found. retry in 1.097140116s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_408f58fe-b1c6-41da-865a-87a0a89099ac
8702024-05-20T20:42:22.501ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_300a6627-3dd3-4fb3-8c11-31ec45b04ad8") failed: Property not found. retry in 591.852602ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_300a6627-3dd3-4fb3-8c11-31ec45b04ad8
8712024-05-20T20:42:22.509ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2184ae6d-adb6-4870-97fe-71bfdf53dac3") failed: Property not found. retry in 1.35395604s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2184ae6d-adb6-4870-97fe-71bfdf53dac3
8722024-05-20T20:42:22.937ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a54f1b35-2b42-4794-95c7-0fbef9317c1d") failed: Property not found. retry in 875.39783ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a54f1b35-2b42-4794-95c7-0fbef9317c1d
8732024-05-20T20:42:23.103ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_300a6627-3dd3-4fb3-8c11-31ec45b04ad8") failed: Property not found. retry in 1.127595054s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_300a6627-3dd3-4fb3-8c11-31ec45b04ad8
8742024-05-20T20:42:23.416ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_add1aa38-2c19-4128-afb9-4ef0c1c573df") failed: Property not found. retry in 971.47357ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_add1aa38-2c19-4128-afb9-4ef0c1c573df
8752024-05-20T20:42:23.446ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_408f58fe-b1c6-41da-865a-87a0a89099ac") failed: Property not found. retry in 586.760142ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_408f58fe-b1c6-41da-865a-87a0a89099ac
8762024-05-20T20:42:24.242ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_300a6627-3dd3-4fb3-8c11-31ec45b04ad8") failed: Property not found. retry in 1.046543269s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_300a6627-3dd3-4fb3-8c11-31ec45b04ad8
8772024-05-20T20:42:25.299ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_300a6627-3dd3-4fb3-8c11-31ec45b04ad8") failed: Property not found. retry in 974.466388ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_300a6627-3dd3-4fb3-8c11-31ec45b04ad8
8782024-05-20T20:42:26.285ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_300a6627-3dd3-4fb3-8c11-31ec45b04ad8") failed: Property not found. retry in 600.075158ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_300a6627-3dd3-4fb3-8c11-31ec45b04ad8
8792024-05-20T20:42:26.895ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_300a6627-3dd3-4fb3-8c11-31ec45b04ad8") failed: Property not found. retry in 1.371854687s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_300a6627-3dd3-4fb3-8c11-31ec45b04ad8
8802024-05-20T20:42:28.284ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_300a6627-3dd3-4fb3-8c11-31ec45b04ad8") failed: Property not found. retry in 1.019528518s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_300a6627-3dd3-4fb3-8c11-31ec45b04ad8
8812024-05-20T20:42:29.316ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_300a6627-3dd3-4fb3-8c11-31ec45b04ad8") failed: Property not found. retry in 554.499272ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_300a6627-3dd3-4fb3-8c11-31ec45b04ad8
8822024-05-20T20:42:29.882ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_300a6627-3dd3-4fb3-8c11-31ec45b04ad8") failed: Property not found. retry in 1.236950676s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_300a6627-3dd3-4fb3-8c11-31ec45b04ad8
8832024-05-20T20:42:31.134ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_300a6627-3dd3-4fb3-8c11-31ec45b04ad8") failed: Property not found. retry in 683.188531ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_300a6627-3dd3-4fb3-8c11-31ec45b04ad8
8842024-05-20T20:42:31.827ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_300a6627-3dd3-4fb3-8c11-31ec45b04ad8") failed: Property not found. retry in 1.335755312s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_300a6627-3dd3-4fb3-8c11-31ec45b04ad8
8852024-05-20T20:42:33.172ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_300a6627-3dd3-4fb3-8c11-31ec45b04ad8") failed: Property not found. retry in 1.318309516s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_300a6627-3dd3-4fb3-8c11-31ec45b04ad8
8862024-05-20T20:42:34.511ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_cockroachdb_408f58fe-b1c6-41da-865a-87a0a89099ac
8872024-05-20T20:42:34.511ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_cockroachdb_add1aa38-2c19-4128-afb9-4ef0c1c573df
8882024-05-20T20:42:34.511ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_cockroachdb_2184ae6d-adb6-4870-97fe-71bfdf53dac3
8892024-05-20T20:42:34.511ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_cockroachdb_a54f1b35-2b42-4794-95c7-0fbef9317c1d
8902024-05-20T20:42:34.511ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_cockroachdb_300a6627-3dd3-4fb3-8c11-31ec45b04ad8
8912024-05-20T20:42:34.511ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/86226832-0042-47df-b114-06085792be9d/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8922024-05-20T20:42:34.513ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/0cb7111d-dee5-4c65-91df-8aa68aeee77e/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8932024-05-20T20:42:34.514ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 22490920 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:58077 req_id = a38a2327-c493-4f23-b8ef-d3a7edd04d7c response_code = 204 uri = /omicron-zones
8942024-05-20T20:42:34.552ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43325
8952024-05-20T20:42:34.582ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::6]:32221 file = sled-agent/src/services.rs:3437
8962024-05-20T20:42:34.761ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3455
8972024-05-20T20:42:38.423ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3478
8982024-05-20T20:42:38.423ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 3869765 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:43325 req_id = 55ddcb0a-6352-445b-8fa9-94c863919b4b response_code = 204 uri = /cockroachdb
8992024-05-20T20:42:38.461ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: f55338b5-b00f-4b86-b71e-d8dfd2aabf41, underlay_address: fd00:1122:3344:1::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 96419ba3-f12e-4ccd-8f37-b0d3a3725e86 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: a3b35764-07da-4d8e-ab71-2f82fea2b72e, underlay_address: fd00:1122:3344:2::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 28bf1422-8de2-4580-b168-1e653c2d0ea3 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: e4964c06-6f88-4a3b-a648-893e1b284275, underlay_address: fd00:1122:3344:3::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 040cf7d2-26fc-4968-9626-951fc09450b4 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: eb6fe6a5-1b06-4333-aa2b-b8c6eb43781b, underlay_address: fd00:1122:3344:101::1b, zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 2ce92be2-b9f0-4885-b13f-febe1893037f, kind: Service { id: eb6fe6a5-1b06-4333-aa2b-b8c6eb43781b }, name: Name("ntp-eb6fe6a5-1b06-4333-aa2b-b8c6eb43781b"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 153, 226])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.3.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: add1aa38-2c19-4128-afb9-4ef0c1c573df, underlay_address: fd00:1122:3344:101::3, zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 96419ba3-f12e-4ccd-8f37-b0d3a3725e86 (zpool), kind: External } } } }, OmicronZoneConfig { id: 300a6627-3dd3-4fb3-8c11-31ec45b04ad8, underlay_address: fd00:1122:3344:101::4, zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 28bf1422-8de2-4580-b168-1e653c2d0ea3 (zpool), kind: External } } } }, OmicronZoneConfig { id: a54f1b35-2b42-4794-95c7-0fbef9317c1d, underlay_address: fd00:1122:3344:101::5, zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 040cf7d2-26fc-4968-9626-951fc09450b4 (zpool), kind: External } } } }, OmicronZoneConfig { id: 2184ae6d-adb6-4870-97fe-71bfdf53dac3, underlay_address: fd00:1122:3344:101::6, zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e9a2b279-e51b-488d-83ef-f697a65badba (zpool), kind: External } } } }, OmicronZoneConfig { id: 408f58fe-b1c6-41da-865a-87a0a89099ac, underlay_address: fd00:1122:3344:101::7, zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: bdfd1b72-3c3a-4f33-9b7a-f64e90e24f6a (zpool), kind: External } } } }, OmicronZoneConfig { id: 9d0d72ea-cc41-4566-a012-82f5edda1c26, underlay_address: fd00:1122:3344:101::8, zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 96419ba3-f12e-4ccd-8f37-b0d3a3725e86 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.2.164:53, nic: NetworkInterface { id: dfb110e8-e16f-4231-86dd-b23805b0877a, kind: Service { id: 9d0d72ea-cc41-4566-a012-82f5edda1c26 }, name: Name("external-dns-9d0d72ea-cc41-4566-a012-82f5edda1c26"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 207, 102])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.1.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 } } }, OmicronZoneConfig { id: 00a5b8be-3547-4e9c-a8ff-18e0e241f74a, underlay_address: fd00:1122:3344:101::9, zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 28bf1422-8de2-4580-b168-1e653c2d0ea3 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.2.165:53, nic: NetworkInterface { id: 981f5b38-f83e-40a7-9cf1-d0896f922726, kind: Service { id: 00a5b8be-3547-4e9c-a8ff-18e0e241f74a }, name: Name("external-dns-00a5b8be-3547-4e9c-a8ff-18e0e241f74a"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 162, 221])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.1.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 } } }, OmicronZoneConfig { id: 2f0b1227-85e6-4def-9a56-3028cc1a9e6b, underlay_address: fd00:1122:3344:101::a, zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.2.166, nic: NetworkInterface { id: 1815df3d-95ec-4321-bea5-d3e0f5b97de4, kind: Service { id: 2f0b1227-85e6-4def-9a56-3028cc1a9e6b }, name: Name("nexus-2f0b1227-85e6-4def-9a56-3028cc1a9e6b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 226, 143])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 14030859-ed0f-47ae-9477-941c8fd9b402, underlay_address: fd00:1122:3344:101::b, zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.2.167, nic: NetworkInterface { id: 991eba9a-7b5f-4507-b76d-809d413181e4, kind: Service { id: 14030859-ed0f-47ae-9477-941c8fd9b402 }, name: Name("nexus-14030859-ed0f-47ae-9477-941c8fd9b402"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 157, 245])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: baf5303b-2c5b-4e5f-aa55-2481f975633b, underlay_address: fd00:1122:3344:101::c, zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.2.168, nic: NetworkInterface { id: c941a686-cef2-46f1-998f-92fc74d8d410, kind: Service { id: baf5303b-2c5b-4e5f-aa55-2481f975633b }, name: Name("nexus-baf5303b-2c5b-4e5f-aa55-2481f975633b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 193, 155])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: eac960af-0b57-4d85-a12d-2817f002da93, underlay_address: fd00:1122:3344:101::d, zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: 1722682a-0a76-447a-b2fd-ed2d5eb1e165, underlay_address: fd00:1122:3344:101::e, zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 96419ba3-f12e-4ccd-8f37-b0d3a3725e86 (zpool), kind: External } } } }, OmicronZoneConfig { id: 17d00716-dd0a-4d24-ab6e-9a5cb155744b, underlay_address: fd00:1122:3344:101::f, zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: c0fd353f-5a49-444e-bc05-f198e4716be9, underlay_address: fd00:1122:3344:101::10, zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: 6f643d6c-2570-4985-a55f-74539d274616, underlay_address: fd00:1122:3344:101::11, zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: 7d929bd2-96bc-4806-b33d-98add78507f8, underlay_address: fd00:1122:3344:101::12, zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 96419ba3-f12e-4ccd-8f37-b0d3a3725e86 (zpool), kind: External } } } }, OmicronZoneConfig { id: 917418e2-81ce-4591-8db5-632c4bd582f5, underlay_address: fd00:1122:3344:101::13, zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 28bf1422-8de2-4580-b168-1e653c2d0ea3 (zpool), kind: External } } } }, OmicronZoneConfig { id: 3f6e3246-067c-4284-96f0-5c240c8d574f, underlay_address: fd00:1122:3344:101::14, zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 040cf7d2-26fc-4968-9626-951fc09450b4 (zpool), kind: External } } } }, OmicronZoneConfig { id: fb9ca965-4ea9-4346-a9e2-23efb7ce8f74, underlay_address: fd00:1122:3344:101::15, zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e9a2b279-e51b-488d-83ef-f697a65badba (zpool), kind: External } } } }, OmicronZoneConfig { id: 6ea6981d-af75-4034-ab13-1ff89fb41fe0, underlay_address: fd00:1122:3344:101::16, zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: bdfd1b72-3c3a-4f33-9b7a-f64e90e24f6a (zpool), kind: External } } } }, OmicronZoneConfig { id: 4e563445-4d41-489d-ba9b-67ee7c445814, underlay_address: fd00:1122:3344:101::17, zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 63a0c9f9-e34d-401c-a2ae-4888bfc580e3 (zpool), kind: External } } } }, OmicronZoneConfig { id: e84f7596-a85d-4c73-b3d4-f0329d444614, underlay_address: fd00:1122:3344:101::18, zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b1ad2e3e-e2af-4c2a-94f1-4865bf8462a0 (zpool), kind: External } } } }, OmicronZoneConfig { id: 6b7319ee-db54-4949-bb6e-3910882850a6, underlay_address: fd00:1122:3344:101::19, zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7f578f7a-8926-4b69-864d-4c8b71340b47 (zpool), kind: External } } } }, OmicronZoneConfig { id: dde34b1a-6b49-4e8c-b9a4-a6feddc5a27e, underlay_address: fd00:1122:3344:101::1a, zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e3e91ef4-fcde-43ae-a5a9-a2d6e1fd7046 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:430 sled_address = [fd00:1122:3344:101::1]:12345
9002024-05-20T20:42:38.461ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58986
9012024-05-20T20:42:38.462ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: f55338b5-b00f-4b86-b71e-d8dfd2aabf41, dataset_name: DatasetName { pool_name: ZpoolName { id: 96419ba3-f12e-4ccd-8f37-b0d3a3725e86 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
9022024-05-20T20:42:38.462ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: f55338b5-b00f-4b86-b71e-d8dfd2aabf41, dataset_name: DatasetName { pool_name: ZpoolName { id: 96419ba3-f12e-4ccd-8f37-b0d3a3725e86 (zpool), kind: External }, kind: InternalDns }, responder: ... }
9032024-05-20T20:42:38.485ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: a3b35764-07da-4d8e-ab71-2f82fea2b72e, dataset_name: DatasetName { pool_name: ZpoolName { id: 28bf1422-8de2-4580-b168-1e653c2d0ea3 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
9042024-05-20T20:42:38.485ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: a3b35764-07da-4d8e-ab71-2f82fea2b72e, dataset_name: DatasetName { pool_name: ZpoolName { id: 28bf1422-8de2-4580-b168-1e653c2d0ea3 (zpool), kind: External }, kind: InternalDns }, responder: ... }
9052024-05-20T20:42:38.506ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e4964c06-6f88-4a3b-a648-893e1b284275, dataset_name: DatasetName { pool_name: ZpoolName { id: 040cf7d2-26fc-4968-9626-951fc09450b4 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
9062024-05-20T20:42:38.506ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: e4964c06-6f88-4a3b-a648-893e1b284275, dataset_name: DatasetName { pool_name: ZpoolName { id: 040cf7d2-26fc-4968-9626-951fc09450b4 (zpool), kind: External }, kind: InternalDns }, responder: ... }
9072024-05-20T20:42:38.526ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: add1aa38-2c19-4128-afb9-4ef0c1c573df, dataset_name: DatasetName { pool_name: ZpoolName { id: 96419ba3-f12e-4ccd-8f37-b0d3a3725e86 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
9082024-05-20T20:42:38.526ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: add1aa38-2c19-4128-afb9-4ef0c1c573df, dataset_name: DatasetName { pool_name: ZpoolName { id: 96419ba3-f12e-4ccd-8f37-b0d3a3725e86 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
9092024-05-20T20:42:38.546ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 300a6627-3dd3-4fb3-8c11-31ec45b04ad8, dataset_name: DatasetName { pool_name: ZpoolName { id: 28bf1422-8de2-4580-b168-1e653c2d0ea3 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
9102024-05-20T20:42:38.547ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 300a6627-3dd3-4fb3-8c11-31ec45b04ad8, dataset_name: DatasetName { pool_name: ZpoolName { id: 28bf1422-8de2-4580-b168-1e653c2d0ea3 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
9112024-05-20T20:42:38.567ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: a54f1b35-2b42-4794-95c7-0fbef9317c1d, dataset_name: DatasetName { pool_name: ZpoolName { id: 040cf7d2-26fc-4968-9626-951fc09450b4 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
9122024-05-20T20:42:38.567ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: a54f1b35-2b42-4794-95c7-0fbef9317c1d, dataset_name: DatasetName { pool_name: ZpoolName { id: 040cf7d2-26fc-4968-9626-951fc09450b4 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
9132024-05-20T20:42:38.587ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 2184ae6d-adb6-4870-97fe-71bfdf53dac3, dataset_name: DatasetName { pool_name: ZpoolName { id: e9a2b279-e51b-488d-83ef-f697a65badba (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
9142024-05-20T20:42:38.587ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 2184ae6d-adb6-4870-97fe-71bfdf53dac3, dataset_name: DatasetName { pool_name: ZpoolName { id: e9a2b279-e51b-488d-83ef-f697a65badba (zpool), kind: External }, kind: CockroachDb }, responder: ... }
9152024-05-20T20:42:38.607ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 408f58fe-b1c6-41da-865a-87a0a89099ac, dataset_name: DatasetName { pool_name: ZpoolName { id: bdfd1b72-3c3a-4f33-9b7a-f64e90e24f6a (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
9162024-05-20T20:42:38.607ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 408f58fe-b1c6-41da-865a-87a0a89099ac, dataset_name: DatasetName { pool_name: ZpoolName { id: bdfd1b72-3c3a-4f33-9b7a-f64e90e24f6a (zpool), kind: External }, kind: CockroachDb }, responder: ... }
9172024-05-20T20:42:38.629ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 9d0d72ea-cc41-4566-a012-82f5edda1c26, dataset_name: DatasetName { pool_name: ZpoolName { id: 96419ba3-f12e-4ccd-8f37-b0d3a3725e86 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
9182024-05-20T20:42:38.629ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 9d0d72ea-cc41-4566-a012-82f5edda1c26, dataset_name: DatasetName { pool_name: ZpoolName { id: 96419ba3-f12e-4ccd-8f37-b0d3a3725e86 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
9192024-05-20T20:42:38.705ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 00a5b8be-3547-4e9c-a8ff-18e0e241f74a, dataset_name: DatasetName { pool_name: ZpoolName { id: 28bf1422-8de2-4580-b168-1e653c2d0ea3 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
9202024-05-20T20:42:38.705ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 00a5b8be-3547-4e9c-a8ff-18e0e241f74a, dataset_name: DatasetName { pool_name: ZpoolName { id: 28bf1422-8de2-4580-b168-1e653c2d0ea3 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
9212024-05-20T20:42:38.785ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 1722682a-0a76-447a-b2fd-ed2d5eb1e165, dataset_name: DatasetName { pool_name: ZpoolName { id: 96419ba3-f12e-4ccd-8f37-b0d3a3725e86 (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:381
9222024-05-20T20:42:38.785ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 1722682a-0a76-447a-b2fd-ed2d5eb1e165, dataset_name: DatasetName { pool_name: ZpoolName { id: 96419ba3-f12e-4ccd-8f37-b0d3a3725e86 (zpool), kind: External }, kind: Clickhouse }, responder: ... }
9232024-05-20T20:42:38.859ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 7d929bd2-96bc-4806-b33d-98add78507f8, dataset_name: DatasetName { pool_name: ZpoolName { id: 96419ba3-f12e-4ccd-8f37-b0d3a3725e86 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
9242024-05-20T20:42:38.859ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 7d929bd2-96bc-4806-b33d-98add78507f8, dataset_name: DatasetName { pool_name: ZpoolName { id: 96419ba3-f12e-4ccd-8f37-b0d3a3725e86 (zpool), kind: External }, kind: Crucible }, responder: ... }
9252024-05-20T20:42:38.927ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 917418e2-81ce-4591-8db5-632c4bd582f5, dataset_name: DatasetName { pool_name: ZpoolName { id: 28bf1422-8de2-4580-b168-1e653c2d0ea3 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
9262024-05-20T20:42:38.927ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 917418e2-81ce-4591-8db5-632c4bd582f5, dataset_name: DatasetName { pool_name: ZpoolName { id: 28bf1422-8de2-4580-b168-1e653c2d0ea3 (zpool), kind: External }, kind: Crucible }, responder: ... }
9272024-05-20T20:42:39.001ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 3f6e3246-067c-4284-96f0-5c240c8d574f, dataset_name: DatasetName { pool_name: ZpoolName { id: 040cf7d2-26fc-4968-9626-951fc09450b4 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
9282024-05-20T20:42:39.001ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 3f6e3246-067c-4284-96f0-5c240c8d574f, dataset_name: DatasetName { pool_name: ZpoolName { id: 040cf7d2-26fc-4968-9626-951fc09450b4 (zpool), kind: External }, kind: Crucible }, responder: ... }
9292024-05-20T20:42:39.073ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: fb9ca965-4ea9-4346-a9e2-23efb7ce8f74, dataset_name: DatasetName { pool_name: ZpoolName { id: e9a2b279-e51b-488d-83ef-f697a65badba (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
9302024-05-20T20:42:39.073ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: fb9ca965-4ea9-4346-a9e2-23efb7ce8f74, dataset_name: DatasetName { pool_name: ZpoolName { id: e9a2b279-e51b-488d-83ef-f697a65badba (zpool), kind: External }, kind: Crucible }, responder: ... }
9312024-05-20T20:42:39.148ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 6ea6981d-af75-4034-ab13-1ff89fb41fe0, dataset_name: DatasetName { pool_name: ZpoolName { id: bdfd1b72-3c3a-4f33-9b7a-f64e90e24f6a (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
9322024-05-20T20:42:39.148ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 6ea6981d-af75-4034-ab13-1ff89fb41fe0, dataset_name: DatasetName { pool_name: ZpoolName { id: bdfd1b72-3c3a-4f33-9b7a-f64e90e24f6a (zpool), kind: External }, kind: Crucible }, responder: ... }
9332024-05-20T20:42:39.221ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 4e563445-4d41-489d-ba9b-67ee7c445814, dataset_name: DatasetName { pool_name: ZpoolName { id: 63a0c9f9-e34d-401c-a2ae-4888bfc580e3 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
9342024-05-20T20:42:39.221ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 4e563445-4d41-489d-ba9b-67ee7c445814, dataset_name: DatasetName { pool_name: ZpoolName { id: 63a0c9f9-e34d-401c-a2ae-4888bfc580e3 (zpool), kind: External }, kind: Crucible }, responder: ... }
9352024-05-20T20:42:39.281ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e84f7596-a85d-4c73-b3d4-f0329d444614, dataset_name: DatasetName { pool_name: ZpoolName { id: b1ad2e3e-e2af-4c2a-94f1-4865bf8462a0 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
9362024-05-20T20:42:39.281ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: e84f7596-a85d-4c73-b3d4-f0329d444614, dataset_name: DatasetName { pool_name: ZpoolName { id: b1ad2e3e-e2af-4c2a-94f1-4865bf8462a0 (zpool), kind: External }, kind: Crucible }, responder: ... }
9372024-05-20T20:42:39.344ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 6b7319ee-db54-4949-bb6e-3910882850a6, dataset_name: DatasetName { pool_name: ZpoolName { id: 7f578f7a-8926-4b69-864d-4c8b71340b47 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
9382024-05-20T20:42:39.344ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 6b7319ee-db54-4949-bb6e-3910882850a6, dataset_name: DatasetName { pool_name: ZpoolName { id: 7f578f7a-8926-4b69-864d-4c8b71340b47 (zpool), kind: External }, kind: Crucible }, responder: ... }
9392024-05-20T20:42:39.407ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: dde34b1a-6b49-4e8c-b9a4-a6feddc5a27e, dataset_name: DatasetName { pool_name: ZpoolName { id: e3e91ef4-fcde-43ae-a5a9-a2d6e1fd7046 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
9402024-05-20T20:42:39.407ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: dde34b1a-6b49-4e8c-b9a4-a6feddc5a27e, dataset_name: DatasetName { pool_name: ZpoolName { id: e3e91ef4-fcde-43ae-a5a9-a2d6e1fd7046 (zpool), kind: External }, kind: Crucible }, responder: ... }
9412024-05-20T20:42:39.468ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9422024-05-20T20:42:39.469ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/86226832-0042-47df-b114-06085792be9d/config/omicron-zones.json file = common/src/ledger.rs:177
9432024-05-20T20:42:39.469ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/0cb7111d-dee5-4c65-91df-8aa68aeee77e/config/omicron-zones.json file = common/src/ledger.rs:177
9442024-05-20T20:42:39.469ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9452024-05-20T20:42:39.569ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:259
9462024-05-20T20:42:39.583ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:259
9472024-05-20T20:42:39.583ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9482024-05-20T20:42:39.668ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9492024-05-20T20:42:39.668ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9502024-05-20T20:42:39.668ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9512024-05-20T20:42:39.668ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9522024-05-20T20:42:39.668ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9532024-05-20T20:42:39.668ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9542024-05-20T20:42:39.668ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9552024-05-20T20:42:39.828ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:259
9562024-05-20T20:42:39.829ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9572024-05-20T20:42:39.829ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9582024-05-20T20:42:39.855ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:259
9592024-05-20T20:42:39.855ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9602024-05-20T20:42:39.855ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9612024-05-20T20:42:39.868ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:259
9622024-05-20T20:42:39.868ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9632024-05-20T20:42:39.881ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9642024-05-20T20:42:39.882ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_eac960af-0b57-4d85-a12d-2817f002da93 file = illumos-utils/src/zone.rs:315
9652024-05-20T20:42:39.887ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_1722682a-0a76-447a-b2fd-ed2d5eb1e165 file = illumos-utils/src/zone.rs:315
9662024-05-20T20:42:39.892ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_fb9ca965-4ea9-4346-a9e2-23efb7ce8f74 file = illumos-utils/src/zone.rs:315
9672024-05-20T20:42:39.896ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_6ea6981d-af75-4034-ab13-1ff89fb41fe0 file = illumos-utils/src/zone.rs:315
9682024-05-20T20:42:39.902ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_e84f7596-a85d-4c73-b3d4-f0329d444614 file = illumos-utils/src/zone.rs:315
9692024-05-20T20:42:39.907ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_6b7319ee-db54-4949-bb6e-3910882850a6 file = illumos-utils/src/zone.rs:315
9702024-05-20T20:42:39.911ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_7d929bd2-96bc-4806-b33d-98add78507f8 file = illumos-utils/src/zone.rs:315
9712024-05-20T20:42:39.915ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_dde34b1a-6b49-4e8c-b9a4-a6feddc5a27e file = illumos-utils/src/zone.rs:315
9722024-05-20T20:42:40.039ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_eac960af-0b57-4d85-a12d-2817f002da93 file = illumos-utils/src/zone.rs:354
9732024-05-20T20:42:40.044ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_1722682a-0a76-447a-b2fd-ed2d5eb1e165 file = illumos-utils/src/zone.rs:354
9742024-05-20T20:42:40.048ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_fb9ca965-4ea9-4346-a9e2-23efb7ce8f74 file = illumos-utils/src/zone.rs:354
9752024-05-20T20:42:40.052ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_6ea6981d-af75-4034-ab13-1ff89fb41fe0 file = illumos-utils/src/zone.rs:354
9762024-05-20T20:42:40.056ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_e84f7596-a85d-4c73-b3d4-f0329d444614 file = illumos-utils/src/zone.rs:354
9772024-05-20T20:42:40.061ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_6b7319ee-db54-4949-bb6e-3910882850a6 file = illumos-utils/src/zone.rs:354
9782024-05-20T20:42:40.066ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_7d929bd2-96bc-4806-b33d-98add78507f8 file = illumos-utils/src/zone.rs:354
9792024-05-20T20:42:40.071ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_dde34b1a-6b49-4e8c-b9a4-a6feddc5a27e file = illumos-utils/src/zone.rs:354
9802024-05-20T20:42:40.077ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_17d00716-dd0a-4d24-ab6e-9a5cb155744b file = illumos-utils/src/zone.rs:315
9812024-05-20T20:42:40.082ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_c0fd353f-5a49-444e-bc05-f198e4716be9 file = illumos-utils/src/zone.rs:315
9822024-05-20T20:42:40.088ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_917418e2-81ce-4591-8db5-632c4bd582f5 file = illumos-utils/src/zone.rs:315
9832024-05-20T20:42:40.093ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_6f643d6c-2570-4985-a55f-74539d274616 file = illumos-utils/src/zone.rs:315
9842024-05-20T20:42:40.098ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_3f6e3246-067c-4284-96f0-5c240c8d574f file = illumos-utils/src/zone.rs:315
9852024-05-20T20:42:40.105ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_4e563445-4d41-489d-ba9b-67ee7c445814 file = illumos-utils/src/zone.rs:315
9862024-05-20T20:42:40.111ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_17d00716-dd0a-4d24-ab6e-9a5cb155744b file = illumos-utils/src/zone.rs:354
9872024-05-20T20:42:40.117ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_c0fd353f-5a49-444e-bc05-f198e4716be9 file = illumos-utils/src/zone.rs:354
9882024-05-20T20:42:40.124ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_917418e2-81ce-4591-8db5-632c4bd582f5 file = illumos-utils/src/zone.rs:354
9892024-05-20T20:42:40.130ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_6f643d6c-2570-4985-a55f-74539d274616 file = illumos-utils/src/zone.rs:354
9902024-05-20T20:42:40.137ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_3f6e3246-067c-4284-96f0-5c240c8d574f file = illumos-utils/src/zone.rs:354
9912024-05-20T20:42:40.144ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_4e563445-4d41-489d-ba9b-67ee7c445814 file = illumos-utils/src/zone.rs:354
9922024-05-20T20:42:40.208ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:276
9932024-05-20T20:42:40.328ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:276
9942024-05-20T20:42:40.392ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:276
9952024-05-20T20:42:40.453ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:276
9962024-05-20T20:42:40.520ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:276
9972024-05-20T20:42:40.522ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:301
9982024-05-20T20:42:40.522ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:193
9992024-05-20T20:42:40.668ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:394 port = Port { inner: PortInner { name: "opte1", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 193, 155]), slot: 0, vni: Vni { inner: 100 }, gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 }, vnic: "vopte1" } }
10002024-05-20T20:42:40.668ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1290 zone_type = nexus
10012024-05-20T20:42:40.674ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:301
10022024-05-20T20:42:40.674ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:193
10032024-05-20T20:42:40.808ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:394 port = Port { inner: PortInner { name: "opte2", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 207, 102]), slot: 0, vni: Vni { inner: 100 }, gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 }, vnic: "vopte2" } }
10042024-05-20T20:42:40.808ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1290 zone_type = external_dns
10052024-05-20T20:42:40.811ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:301
10062024-05-20T20:42:40.811ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:193
10072024-05-20T20:42:40.914ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:41933
10082024-05-20T20:42:40.914ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 130 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:41933 req_id = 01cf40cb-d32b-4fde-a39e-2c82572cbb93 response_code = 200 uri = /baseboard
10092024-05-20T20:42:40.922ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:394 port = Port { inner: PortInner { name: "opte3", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 157, 245]), slot: 0, vni: Vni { inner: 100 }, gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 }, vnic: "vopte3" } }
10102024-05-20T20:42:40.922ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1290 zone_type = nexus
10112024-05-20T20:42:40.925ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:301
10122024-05-20T20:42:40.925ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:193
10132024-05-20T20:42:41.109ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:394 port = Port { inner: PortInner { name: "opte4", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 226, 143]), slot: 0, vni: Vni { inner: 100 }, gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 }, vnic: "vopte4" } }
10142024-05-20T20:42:41.109ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1290 zone_type = nexus
10152024-05-20T20:42:41.114ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:301
10162024-05-20T20:42:41.114ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:193
10172024-05-20T20:42:41.199ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:394 port = Port { inner: PortInner { name: "opte5", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 162, 221]), slot: 0, vni: Vni { inner: 100 }, gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 }, vnic: "vopte5" } }
10182024-05-20T20:42:41.199ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1290 zone_type = external_dns
10192024-05-20T20:42:41.199ZINFOSledAgent (ServiceManager): no nat entry found for: V4( Ipv4Network { addr: 10.151.2.168, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:102
10202024-05-20T20:42:41.200ZINFOSledAgent (ServiceManager): creating nat entry for: V4( Ipv4Network { addr: 10.151.2.168, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:109
10212024-05-20T20:42:41.201ZINFOSledAgent (ServiceManager): creation of nat entry successful for: V4( Ipv4Network { addr: 10.151.2.168, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:137
10222024-05-20T20:42:41.206ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
10232024-05-20T20:42:41.238ZINFOSledAgent (ServiceManager): no nat entry found for: V4( Ipv4Network { addr: 10.151.2.164, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:102
10242024-05-20T20:42:41.238ZINFOSledAgent (ServiceManager): creating nat entry for: V4( Ipv4Network { addr: 10.151.2.164, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:109
10252024-05-20T20:42:41.238ZINFOSledAgent (ServiceManager): no nat entry found for: V4( Ipv4Network { addr: 10.151.2.167, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:102
10262024-05-20T20:42:41.238ZINFOSledAgent (ServiceManager): creating nat entry for: V4( Ipv4Network { addr: 10.151.2.167, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:109
10272024-05-20T20:42:41.238ZINFOSledAgent (ServiceManager): no nat entry found for: V4( Ipv4Network { addr: 10.151.2.165, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:102
10282024-05-20T20:42:41.238ZINFOSledAgent (ServiceManager): creating nat entry for: V4( Ipv4Network { addr: 10.151.2.165, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:109
10292024-05-20T20:42:41.238ZINFOSledAgent (ServiceManager): no nat entry found for: V4( Ipv4Network { addr: 10.151.2.166, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:102
10302024-05-20T20:42:41.238ZINFOSledAgent (ServiceManager): creating nat entry for: V4( Ipv4Network { addr: 10.151.2.166, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:109
10312024-05-20T20:42:41.239ZINFOSledAgent (ServiceManager): creation of nat entry successful for: V4( Ipv4Network { addr: 10.151.2.164, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:137
10322024-05-20T20:42:41.243ZINFOSledAgent (ServiceManager): creation of nat entry successful for: V4( Ipv4Network { addr: 10.151.2.167, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:137
10332024-05-20T20:42:41.246ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
10342024-05-20T20:42:41.246ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
10352024-05-20T20:42:41.246ZINFOSledAgent (ServiceManager): creation of nat entry successful for: V4( Ipv4Network { addr: 10.151.2.165, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:137
10362024-05-20T20:42:41.250ZINFOSledAgent (ServiceManager): creation of nat entry successful for: V4( Ipv4Network { addr: 10.151.2.166, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:137
10372024-05-20T20:42:41.252ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
10382024-05-20T20:42:41.252ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
10392024-05-20T20:42:41.367ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_baf5303b-2c5b-4e5f-aa55-2481f975633b file = illumos-utils/src/zone.rs:315
10402024-05-20T20:42:41.373ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_9d0d72ea-cc41-4566-a012-82f5edda1c26 file = illumos-utils/src/zone.rs:315
10412024-05-20T20:42:41.380ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_14030859-ed0f-47ae-9477-941c8fd9b402 file = illumos-utils/src/zone.rs:315
10422024-05-20T20:42:41.386ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_00a5b8be-3547-4e9c-a8ff-18e0e241f74a file = illumos-utils/src/zone.rs:315
10432024-05-20T20:42:41.392ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_2f0b1227-85e6-4def-9a56-3028cc1a9e6b file = illumos-utils/src/zone.rs:315
10442024-05-20T20:42:41.399ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_baf5303b-2c5b-4e5f-aa55-2481f975633b file = illumos-utils/src/zone.rs:354
10452024-05-20T20:42:41.406ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_9d0d72ea-cc41-4566-a012-82f5edda1c26 file = illumos-utils/src/zone.rs:354
10462024-05-20T20:42:41.413ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_14030859-ed0f-47ae-9477-941c8fd9b402 file = illumos-utils/src/zone.rs:354
10472024-05-20T20:42:41.419ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_00a5b8be-3547-4e9c-a8ff-18e0e241f74a file = illumos-utils/src/zone.rs:354
10482024-05-20T20:42:41.426ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_2f0b1227-85e6-4def-9a56-3028cc1a9e6b file = illumos-utils/src/zone.rs:354
10492024-05-20T20:42:42.702ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_17d00716-dd0a-4d24-ab6e-9a5cb155744b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService18"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::f"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::f"/> <propval type="astring" name="listen_port" value="17000"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10502024-05-20T20:42:42.702ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_pantry_17d00716-dd0a-4d24-ab6e-9a5cb155744b
10512024-05-20T20:42:42.715ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_6f643d6c-2570-4985-a55f-74539d274616: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService21"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::11"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::11"/> <propval type="astring" name="listen_port" value="17000"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10522024-05-20T20:42:42.715ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_pantry_6f643d6c-2570-4985-a55f-74539d274616
10532024-05-20T20:42:42.877ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_4e563445-4d41-489d-ba9b-67ee7c445814: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService23"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::17"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_63a0c9f9-e34d-401c-a2ae-4888bfc580e3/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::17"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="f5d71dec-c99b-4a1a-b409-89e0299e2494"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10542024-05-20T20:42:42.877ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_4e563445-4d41-489d-ba9b-67ee7c445814
10552024-05-20T20:42:42.892ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_6ea6981d-af75-4034-ab13-1ff89fb41fe0: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService13"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::16"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_bdfd1b72-3c3a-4f33-9b7a-f64e90e24f6a/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::16"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="bde365e4-0b2b-4970-8cfc-1582ca032fb7"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10562024-05-20T20:42:42.892ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_dde34b1a-6b49-4e8c-b9a4-a6feddc5a27e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService17"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::1a"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_e3e91ef4-fcde-43ae-a5a9-a2d6e1fd7046/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::1a"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="e3178f02-f87f-4cec-b729-924b881b4062"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10572024-05-20T20:42:42.892ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_6ea6981d-af75-4034-ab13-1ff89fb41fe0
10582024-05-20T20:42:42.897ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_dde34b1a-6b49-4e8c-b9a4-a6feddc5a27e
10592024-05-20T20:42:42.904ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_3f6e3246-067c-4284-96f0-5c240c8d574f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService22"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::14"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_040cf7d2-26fc-4968-9626-951fc09450b4/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::14"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="a04ed8ab-8cc0-4d38-be64-4b6b19e21f5b"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10602024-05-20T20:42:42.904ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_3f6e3246-067c-4284-96f0-5c240c8d574f
10612024-05-20T20:42:42.914ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_e84f7596-a85d-4c73-b3d4-f0329d444614: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService14"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::18"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_b1ad2e3e-e2af-4c2a-94f1-4865bf8462a0/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::18"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="2f672634-2b18-46e2-833c-74ad3a43a62c"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10622024-05-20T20:42:42.915ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_e84f7596-a85d-4c73-b3d4-f0329d444614
10632024-05-20T20:42:42.926ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_eac960af-0b57-4d85-a12d-2817f002da93: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService10"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::d"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value="eac960af-0b57-4d85-a12d-2817f002da93"/> <propval type="astring" name="address" value="[fd00:1122:3344:101::d]:12223"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10642024-05-20T20:42:42.926ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_oximeter_eac960af-0b57-4d85-a12d-2817f002da93
10652024-05-20T20:42:42.945ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_917418e2-81ce-4591-8db5-632c4bd582f5: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService20"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::13"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_28bf1422-8de2-4580-b168-1e653c2d0ea3/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::13"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="e7bfea28-4923-4e14-ab01-26f8761f766a"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10662024-05-20T20:42:42.946ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_917418e2-81ce-4591-8db5-632c4bd582f5
10672024-05-20T20:42:42.977ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_6b7319ee-db54-4949-bb6e-3910882850a6: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService15"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::19"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_7f578f7a-8926-4b69-864d-4c8b71340b47/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::19"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="fdf03175-1ff3-48e2-909f-e24d77b88084"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10682024-05-20T20:42:42.977ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_6b7319ee-db54-4949-bb6e-3910882850a6
10692024-05-20T20:42:43.007ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_fb9ca965-4ea9-4346-a9e2-23efb7ce8f74: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService12"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::15"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_e9a2b279-e51b-488d-83ef-f697a65badba/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::15"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="ca02ec83-82f4-47be-9c35-d0c3ad1b4e85"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10702024-05-20T20:42:43.008ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_fb9ca965-4ea9-4346-a9e2-23efb7ce8f74
10712024-05-20T20:42:43.366ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_917418e2-81ce-4591-8db5-632c4bd582f5") failed: Property not found. retry in 35.456535ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_917418e2-81ce-4591-8db5-632c4bd582f5
10722024-05-20T20:42:43.374ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eac960af-0b57-4d85-a12d-2817f002da93") failed: Property not found. retry in 26.158812ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eac960af-0b57-4d85-a12d-2817f002da93
10732024-05-20T20:42:43.382ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb9ca965-4ea9-4346-a9e2-23efb7ce8f74") failed: Property not found. retry in 46.720525ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb9ca965-4ea9-4346-a9e2-23efb7ce8f74
10742024-05-20T20:42:43.390ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e84f7596-a85d-4c73-b3d4-f0329d444614") failed: Property not found. retry in 49.551707ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e84f7596-a85d-4c73-b3d4-f0329d444614
10752024-05-20T20:42:43.399ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6b7319ee-db54-4949-bb6e-3910882850a6") failed: Property not found. retry in 61.715522ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6b7319ee-db54-4949-bb6e-3910882850a6
10762024-05-20T20:42:43.408ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dde34b1a-6b49-4e8c-b9a4-a6feddc5a27e") failed: Property not found. retry in 36.880547ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dde34b1a-6b49-4e8c-b9a4-a6feddc5a27e
10772024-05-20T20:42:43.417ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_17d00716-dd0a-4d24-ab6e-9a5cb155744b") failed: Property not found. retry in 62.785911ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_17d00716-dd0a-4d24-ab6e-9a5cb155744b
10782024-05-20T20:42:43.426ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3f6e3246-067c-4284-96f0-5c240c8d574f") failed: Property not found. retry in 66.586221ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3f6e3246-067c-4284-96f0-5c240c8d574f
10792024-05-20T20:42:43.436ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4e563445-4d41-489d-ba9b-67ee7c445814") failed: Property not found. retry in 25.238257ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4e563445-4d41-489d-ba9b-67ee7c445814
10802024-05-20T20:42:43.473ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eac960af-0b57-4d85-a12d-2817f002da93") failed: Property not found. retry in 116.38682ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eac960af-0b57-4d85-a12d-2817f002da93
10812024-05-20T20:42:43.553ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb9ca965-4ea9-4346-a9e2-23efb7ce8f74") failed: Property not found. retry in 106.862419ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb9ca965-4ea9-4346-a9e2-23efb7ce8f74
10822024-05-20T20:42:43.580ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6ea6981d-af75-4034-ab13-1ff89fb41fe0") failed: Property not found. retry in 59.157988ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6ea6981d-af75-4034-ab13-1ff89fb41fe0
10832024-05-20T20:42:43.604ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e84f7596-a85d-4c73-b3d4-f0329d444614") failed: Property not found. retry in 54.620669ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e84f7596-a85d-4c73-b3d4-f0329d444614
10842024-05-20T20:42:43.630ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6b7319ee-db54-4949-bb6e-3910882850a6") failed: Property not found. retry in 145.156581ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6b7319ee-db54-4949-bb6e-3910882850a6
10852024-05-20T20:42:43.661ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dde34b1a-6b49-4e8c-b9a4-a6feddc5a27e") failed: Property not found. retry in 76.680936ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dde34b1a-6b49-4e8c-b9a4-a6feddc5a27e
10862024-05-20T20:42:43.712ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_17d00716-dd0a-4d24-ab6e-9a5cb155744b") failed: Property not found. retry in 72.69052ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_17d00716-dd0a-4d24-ab6e-9a5cb155744b
10872024-05-20T20:42:43.729ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_917418e2-81ce-4591-8db5-632c4bd582f5") failed: Property not found. retry in 62.117983ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_917418e2-81ce-4591-8db5-632c4bd582f5
10882024-05-20T20:42:43.793ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6f643d6c-2570-4985-a55f-74539d274616") failed: Property not found. retry in 33.455738ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6f643d6c-2570-4985-a55f-74539d274616
10892024-05-20T20:42:43.817ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3f6e3246-067c-4284-96f0-5c240c8d574f") failed: Property not found. retry in 101.895172ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3f6e3246-067c-4284-96f0-5c240c8d574f
10902024-05-20T20:42:43.836ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4e563445-4d41-489d-ba9b-67ee7c445814") failed: Property not found. retry in 149.050068ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4e563445-4d41-489d-ba9b-67ee7c445814
10912024-05-20T20:42:43.869ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eac960af-0b57-4d85-a12d-2817f002da93") failed: Property not found. retry in 206.977698ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eac960af-0b57-4d85-a12d-2817f002da93
10922024-05-20T20:42:43.884ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb9ca965-4ea9-4346-a9e2-23efb7ce8f74") failed: Property not found. retry in 154.278667ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb9ca965-4ea9-4346-a9e2-23efb7ce8f74
10932024-05-20T20:42:43.899ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6ea6981d-af75-4034-ab13-1ff89fb41fe0") failed: Property not found. retry in 107.801626ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6ea6981d-af75-4034-ab13-1ff89fb41fe0
10942024-05-20T20:42:43.914ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e84f7596-a85d-4c73-b3d4-f0329d444614") failed: Property not found. retry in 173.372721ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e84f7596-a85d-4c73-b3d4-f0329d444614
10952024-05-20T20:42:43.927ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6b7319ee-db54-4949-bb6e-3910882850a6") failed: Property not found. retry in 192.630841ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6b7319ee-db54-4949-bb6e-3910882850a6
10962024-05-20T20:42:43.940ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dde34b1a-6b49-4e8c-b9a4-a6feddc5a27e") failed: Property not found. retry in 225.604245ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dde34b1a-6b49-4e8c-b9a4-a6feddc5a27e
10972024-05-20T20:42:43.955ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_17d00716-dd0a-4d24-ab6e-9a5cb155744b") failed: Property not found. retry in 163.962905ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_17d00716-dd0a-4d24-ab6e-9a5cb155744b
10982024-05-20T20:42:43.973ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_917418e2-81ce-4591-8db5-632c4bd582f5") failed: Property not found. retry in 290.827143ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_917418e2-81ce-4591-8db5-632c4bd582f5
10992024-05-20T20:42:43.988ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6f643d6c-2570-4985-a55f-74539d274616") failed: Property not found. retry in 145.899669ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6f643d6c-2570-4985-a55f-74539d274616
11002024-05-20T20:42:44.000ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3f6e3246-067c-4284-96f0-5c240c8d574f") failed: Property not found. retry in 258.790155ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3f6e3246-067c-4284-96f0-5c240c8d574f
11012024-05-20T20:42:44.016ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4e563445-4d41-489d-ba9b-67ee7c445814") failed: Property not found. retry in 122.243536ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4e563445-4d41-489d-ba9b-67ee7c445814
11022024-05-20T20:42:44.029ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6ea6981d-af75-4034-ab13-1ff89fb41fe0") failed: Property not found. retry in 281.208378ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6ea6981d-af75-4034-ab13-1ff89fb41fe0
11032024-05-20T20:42:44.051ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb9ca965-4ea9-4346-a9e2-23efb7ce8f74") failed: Property not found. retry in 578.626073ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb9ca965-4ea9-4346-a9e2-23efb7ce8f74
11042024-05-20T20:42:44.091ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eac960af-0b57-4d85-a12d-2817f002da93") failed: Property not found. retry in 587.960455ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eac960af-0b57-4d85-a12d-2817f002da93
11052024-05-20T20:42:44.102ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e84f7596-a85d-4c73-b3d4-f0329d444614") failed: Property not found. retry in 306.908091ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e84f7596-a85d-4c73-b3d4-f0329d444614
11062024-05-20T20:42:44.134ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_17d00716-dd0a-4d24-ab6e-9a5cb155744b") failed: Property not found. retry in 215.734633ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_17d00716-dd0a-4d24-ab6e-9a5cb155744b
11072024-05-20T20:42:44.144ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6b7319ee-db54-4949-bb6e-3910882850a6") failed: Property not found. retry in 577.370357ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6b7319ee-db54-4949-bb6e-3910882850a6
11082024-05-20T20:42:44.156ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6f643d6c-2570-4985-a55f-74539d274616") failed: Property not found. retry in 188.139958ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6f643d6c-2570-4985-a55f-74539d274616
11092024-05-20T20:42:44.166ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4e563445-4d41-489d-ba9b-67ee7c445814") failed: Property not found. retry in 516.722965ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4e563445-4d41-489d-ba9b-67ee7c445814
11102024-05-20T20:42:44.177ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dde34b1a-6b49-4e8c-b9a4-a6feddc5a27e") failed: Property not found. retry in 452.228382ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dde34b1a-6b49-4e8c-b9a4-a6feddc5a27e
11112024-05-20T20:42:44.273ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3f6e3246-067c-4284-96f0-5c240c8d574f") failed: Property not found. retry in 339.833031ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3f6e3246-067c-4284-96f0-5c240c8d574f
11122024-05-20T20:42:44.286ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_917418e2-81ce-4591-8db5-632c4bd582f5") failed: Property not found. retry in 444.955946ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_917418e2-81ce-4591-8db5-632c4bd582f5
11132024-05-20T20:42:44.323ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6ea6981d-af75-4034-ab13-1ff89fb41fe0") failed: Property not found. retry in 310.00765ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6ea6981d-af75-4034-ab13-1ff89fb41fe0
11142024-05-20T20:42:44.357ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6f643d6c-2570-4985-a55f-74539d274616") failed: Property not found. retry in 437.155413ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6f643d6c-2570-4985-a55f-74539d274616
11152024-05-20T20:42:44.369ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_17d00716-dd0a-4d24-ab6e-9a5cb155744b") failed: Property not found. retry in 809.153867ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_17d00716-dd0a-4d24-ab6e-9a5cb155744b
11162024-05-20T20:42:44.425ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e84f7596-a85d-4c73-b3d4-f0329d444614") failed: Property not found. retry in 1.125450875s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e84f7596-a85d-4c73-b3d4-f0329d444614
11172024-05-20T20:42:44.630ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3f6e3246-067c-4284-96f0-5c240c8d574f") failed: Property not found. retry in 877.829641ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3f6e3246-067c-4284-96f0-5c240c8d574f
11182024-05-20T20:42:44.643ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dde34b1a-6b49-4e8c-b9a4-a6feddc5a27e") failed: Property not found. retry in 559.490983ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dde34b1a-6b49-4e8c-b9a4-a6feddc5a27e
11192024-05-20T20:42:44.655ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb9ca965-4ea9-4346-a9e2-23efb7ce8f74") failed: Property not found. retry in 797.794877ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb9ca965-4ea9-4346-a9e2-23efb7ce8f74
11202024-05-20T20:42:44.668ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6ea6981d-af75-4034-ab13-1ff89fb41fe0") failed: Property not found. retry in 693.477703ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6ea6981d-af75-4034-ab13-1ff89fb41fe0
11212024-05-20T20:42:44.691ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eac960af-0b57-4d85-a12d-2817f002da93") failed: Property not found. retry in 817.955212ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eac960af-0b57-4d85-a12d-2817f002da93
11222024-05-20T20:42:44.702ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4e563445-4d41-489d-ba9b-67ee7c445814") failed: Property not found. retry in 969.051935ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4e563445-4d41-489d-ba9b-67ee7c445814
11232024-05-20T20:42:44.734ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6b7319ee-db54-4949-bb6e-3910882850a6") failed: Property not found. retry in 534.1661ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6b7319ee-db54-4949-bb6e-3910882850a6
11242024-05-20T20:42:44.748ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_917418e2-81ce-4591-8db5-632c4bd582f5") failed: Property not found. retry in 1.023947812s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_917418e2-81ce-4591-8db5-632c4bd582f5
11252024-05-20T20:42:44.808ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6f643d6c-2570-4985-a55f-74539d274616") failed: Property not found. retry in 1.130073848s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6f643d6c-2570-4985-a55f-74539d274616
11262024-05-20T20:42:45.192ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_17d00716-dd0a-4d24-ab6e-9a5cb155744b") failed: Property not found. retry in 1.077128153s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_17d00716-dd0a-4d24-ab6e-9a5cb155744b
11272024-05-20T20:42:45.215ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dde34b1a-6b49-4e8c-b9a4-a6feddc5a27e") failed: Property not found. retry in 760.829511ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dde34b1a-6b49-4e8c-b9a4-a6feddc5a27e
11282024-05-20T20:42:45.289ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6b7319ee-db54-4949-bb6e-3910882850a6") failed: Property not found. retry in 1.088093478s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6b7319ee-db54-4949-bb6e-3910882850a6
11292024-05-20T20:42:45.430ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6ea6981d-af75-4034-ab13-1ff89fb41fe0") failed: Property not found. retry in 1.474211891s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6ea6981d-af75-4034-ab13-1ff89fb41fe0
11302024-05-20T20:42:45.599ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb9ca965-4ea9-4346-a9e2-23efb7ce8f74") failed: Property not found. retry in 1.338984717s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb9ca965-4ea9-4346-a9e2-23efb7ce8f74
11312024-05-20T20:42:45.640ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eac960af-0b57-4d85-a12d-2817f002da93") failed: Property not found. retry in 1.317274801s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eac960af-0b57-4d85-a12d-2817f002da93
11322024-05-20T20:42:45.669ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3f6e3246-067c-4284-96f0-5c240c8d574f") failed: Property not found. retry in 938.011611ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3f6e3246-067c-4284-96f0-5c240c8d574f
11332024-05-20T20:42:45.701ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e84f7596-a85d-4c73-b3d4-f0329d444614") failed: Property not found. retry in 1.168824716s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e84f7596-a85d-4c73-b3d4-f0329d444614
11342024-05-20T20:42:45.743ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4e563445-4d41-489d-ba9b-67ee7c445814") failed: Property not found. retry in 1.005752269s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4e563445-4d41-489d-ba9b-67ee7c445814
11352024-05-20T20:42:45.807ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_917418e2-81ce-4591-8db5-632c4bd582f5") failed: Property not found. retry in 1.49022504s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_917418e2-81ce-4591-8db5-632c4bd582f5
11362024-05-20T20:42:45.959ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6f643d6c-2570-4985-a55f-74539d274616") failed: Property not found. retry in 1.309620354s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6f643d6c-2570-4985-a55f-74539d274616
11372024-05-20T20:42:46.021ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dde34b1a-6b49-4e8c-b9a4-a6feddc5a27e") failed: Property not found. retry in 1.469669756s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dde34b1a-6b49-4e8c-b9a4-a6feddc5a27e
11382024-05-20T20:42:46.320ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_17d00716-dd0a-4d24-ab6e-9a5cb155744b") failed: Property not found. retry in 797.990582ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_17d00716-dd0a-4d24-ab6e-9a5cb155744b
11392024-05-20T20:42:46.409ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6b7319ee-db54-4949-bb6e-3910882850a6") failed: Property not found. retry in 1.408689428s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6b7319ee-db54-4949-bb6e-3910882850a6
11402024-05-20T20:42:48.495ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3f6e3246-067c-4284-96f0-5c240c8d574f") failed: Property not found. retry in 1.15966136s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3f6e3246-067c-4284-96f0-5c240c8d574f
11412024-05-20T20:42:48.662ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eac960af-0b57-4d85-a12d-2817f002da93") failed: Property not found. retry in 1.450512606s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eac960af-0b57-4d85-a12d-2817f002da93
11422024-05-20T20:42:48.677ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb9ca965-4ea9-4346-a9e2-23efb7ce8f74") failed: Property not found. retry in 559.266463ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb9ca965-4ea9-4346-a9e2-23efb7ce8f74
11432024-05-20T20:42:48.689ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6ea6981d-af75-4034-ab13-1ff89fb41fe0") failed: Property not found. retry in 1.357373012s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6ea6981d-af75-4034-ab13-1ff89fb41fe0
11442024-05-20T20:42:48.701ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e84f7596-a85d-4c73-b3d4-f0329d444614") failed: Property not found. retry in 669.596684ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e84f7596-a85d-4c73-b3d4-f0329d444614
11452024-05-20T20:42:48.713ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6b7319ee-db54-4949-bb6e-3910882850a6") failed: Property not found. retry in 588.397068ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6b7319ee-db54-4949-bb6e-3910882850a6
11462024-05-20T20:42:48.725ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dde34b1a-6b49-4e8c-b9a4-a6feddc5a27e") failed: Property not found. retry in 688.042513ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dde34b1a-6b49-4e8c-b9a4-a6feddc5a27e
11472024-05-20T20:42:48.741ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_17d00716-dd0a-4d24-ab6e-9a5cb155744b") failed: Property not found. retry in 1.381491528s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_17d00716-dd0a-4d24-ab6e-9a5cb155744b
11482024-05-20T20:42:48.753ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_917418e2-81ce-4591-8db5-632c4bd582f5") failed: Property not found. retry in 553.325938ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_917418e2-81ce-4591-8db5-632c4bd582f5
11492024-05-20T20:42:48.765ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6f643d6c-2570-4985-a55f-74539d274616") failed: Property not found. retry in 1.451360035s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6f643d6c-2570-4985-a55f-74539d274616
11502024-05-20T20:42:48.776ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4e563445-4d41-489d-ba9b-67ee7c445814") failed: Property not found. retry in 873.549327ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4e563445-4d41-489d-ba9b-67ee7c445814
11512024-05-20T20:42:48.948ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_c0fd353f-5a49-444e-bc05-f198e4716be9: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService19"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::10"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::10"/> <propval type="astring" name="listen_port" value="17000"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11522024-05-20T20:42:48.949ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_pantry_c0fd353f-5a49-444e-bc05-f198e4716be9
11532024-05-20T20:42:49.073ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_7d929bd2-96bc-4806-b33d-98add78507f8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService16"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::12"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_96419ba3-f12e-4ccd-8f37-b0d3a3725e86/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::12"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="18376572-c9b6-48ca-95de-3cb906937b53"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11542024-05-20T20:42:49.073ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_7d929bd2-96bc-4806-b33d-98add78507f8
11552024-05-20T20:42:49.201ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c0fd353f-5a49-444e-bc05-f198e4716be9") failed: Property not found. retry in 52.347592ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c0fd353f-5a49-444e-bc05-f198e4716be9
11562024-05-20T20:42:49.249ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb9ca965-4ea9-4346-a9e2-23efb7ce8f74") failed: Property not found. retry in 1.466166354s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb9ca965-4ea9-4346-a9e2-23efb7ce8f74
11572024-05-20T20:42:49.266ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c0fd353f-5a49-444e-bc05-f198e4716be9") failed: Property not found. retry in 68.505813ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c0fd353f-5a49-444e-bc05-f198e4716be9
11582024-05-20T20:42:49.314ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6b7319ee-db54-4949-bb6e-3910882850a6") failed: Property not found. retry in 1.428405021s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6b7319ee-db54-4949-bb6e-3910882850a6
11592024-05-20T20:42:49.327ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_917418e2-81ce-4591-8db5-632c4bd582f5") failed: Property not found. retry in 1.019406907s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_917418e2-81ce-4591-8db5-632c4bd582f5
11602024-05-20T20:42:49.347ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c0fd353f-5a49-444e-bc05-f198e4716be9") failed: Property not found. retry in 286.070238ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c0fd353f-5a49-444e-bc05-f198e4716be9
11612024-05-20T20:42:49.385ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e84f7596-a85d-4c73-b3d4-f0329d444614") failed: Property not found. retry in 1.262433327s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e84f7596-a85d-4c73-b3d4-f0329d444614
11622024-05-20T20:42:49.395ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7d929bd2-96bc-4806-b33d-98add78507f8") failed: Property not found. retry in 34.544847ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7d929bd2-96bc-4806-b33d-98add78507f8
11632024-05-20T20:42:49.429ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dde34b1a-6b49-4e8c-b9a4-a6feddc5a27e") failed: Property not found. retry in 1.130489957s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dde34b1a-6b49-4e8c-b9a4-a6feddc5a27e
11642024-05-20T20:42:49.445ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7d929bd2-96bc-4806-b33d-98add78507f8") failed: Property not found. retry in 91.929242ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7d929bd2-96bc-4806-b33d-98add78507f8
11652024-05-20T20:42:49.552ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7d929bd2-96bc-4806-b33d-98add78507f8") failed: Property not found. retry in 242.024008ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7d929bd2-96bc-4806-b33d-98add78507f8
11662024-05-20T20:42:49.648ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c0fd353f-5a49-444e-bc05-f198e4716be9") failed: Property not found. retry in 331.731687ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c0fd353f-5a49-444e-bc05-f198e4716be9
11672024-05-20T20:42:49.662ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4e563445-4d41-489d-ba9b-67ee7c445814") failed: Property not found. retry in 1.264288955s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4e563445-4d41-489d-ba9b-67ee7c445814
11682024-05-20T20:42:49.676ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3f6e3246-067c-4284-96f0-5c240c8d574f") failed: Property not found. retry in 830.97297ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3f6e3246-067c-4284-96f0-5c240c8d574f
11692024-05-20T20:42:49.812ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7d929bd2-96bc-4806-b33d-98add78507f8") failed: Property not found. retry in 396.963027ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7d929bd2-96bc-4806-b33d-98add78507f8
11702024-05-20T20:42:49.994ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c0fd353f-5a49-444e-bc05-f198e4716be9") failed: Property not found. retry in 424.293103ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c0fd353f-5a49-444e-bc05-f198e4716be9
11712024-05-20T20:42:50.061ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6ea6981d-af75-4034-ab13-1ff89fb41fe0") failed: Property not found. retry in 1.33576434s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6ea6981d-af75-4034-ab13-1ff89fb41fe0
11722024-05-20T20:42:50.127ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eac960af-0b57-4d85-a12d-2817f002da93") failed: Property not found. retry in 1.20680535s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eac960af-0b57-4d85-a12d-2817f002da93
11732024-05-20T20:42:50.140ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_17d00716-dd0a-4d24-ab6e-9a5cb155744b") failed: Property not found. retry in 1.347991095s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_17d00716-dd0a-4d24-ab6e-9a5cb155744b
11742024-05-20T20:42:50.222ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7d929bd2-96bc-4806-b33d-98add78507f8") failed: Property not found. retry in 1.051347391s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7d929bd2-96bc-4806-b33d-98add78507f8
11752024-05-20T20:42:50.236ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6f643d6c-2570-4985-a55f-74539d274616") failed: Property not found. retry in 1.180877821s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6f643d6c-2570-4985-a55f-74539d274616
11762024-05-20T20:42:50.360ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_917418e2-81ce-4591-8db5-632c4bd582f5") failed: Property not found. retry in 1.085028303s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_917418e2-81ce-4591-8db5-632c4bd582f5
11772024-05-20T20:42:50.432ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c0fd353f-5a49-444e-bc05-f198e4716be9") failed: Property not found. retry in 758.82032ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c0fd353f-5a49-444e-bc05-f198e4716be9
11782024-05-20T20:42:50.523ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3f6e3246-067c-4284-96f0-5c240c8d574f") failed: Property not found. retry in 887.371515ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3f6e3246-067c-4284-96f0-5c240c8d574f
11792024-05-20T20:42:50.572ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dde34b1a-6b49-4e8c-b9a4-a6feddc5a27e") failed: Property not found. retry in 1.48551214s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dde34b1a-6b49-4e8c-b9a4-a6feddc5a27e
11802024-05-20T20:42:50.661ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e84f7596-a85d-4c73-b3d4-f0329d444614") failed: Property not found. retry in 1.15763255s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e84f7596-a85d-4c73-b3d4-f0329d444614
11812024-05-20T20:42:50.727ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb9ca965-4ea9-4346-a9e2-23efb7ce8f74") failed: Property not found. retry in 753.723922ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb9ca965-4ea9-4346-a9e2-23efb7ce8f74
11822024-05-20T20:42:50.754ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6b7319ee-db54-4949-bb6e-3910882850a6") failed: Property not found. retry in 985.337283ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6b7319ee-db54-4949-bb6e-3910882850a6
11832024-05-20T20:42:50.940ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4e563445-4d41-489d-ba9b-67ee7c445814") failed: Property not found. retry in 924.106091ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4e563445-4d41-489d-ba9b-67ee7c445814
11842024-05-20T20:42:51.204ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c0fd353f-5a49-444e-bc05-f198e4716be9") failed: Property not found. retry in 1.076706891s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c0fd353f-5a49-444e-bc05-f198e4716be9
11852024-05-20T20:42:51.288ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7d929bd2-96bc-4806-b33d-98add78507f8") failed: Property not found. retry in 1.272320384s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7d929bd2-96bc-4806-b33d-98add78507f8
11862024-05-20T20:42:51.346ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eac960af-0b57-4d85-a12d-2817f002da93") failed: Property not found. retry in 1.096191074s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eac960af-0b57-4d85-a12d-2817f002da93
11872024-05-20T20:42:51.410ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6ea6981d-af75-4034-ab13-1ff89fb41fe0") failed: Property not found. retry in 1.008732942s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6ea6981d-af75-4034-ab13-1ff89fb41fe0
11882024-05-20T20:42:51.423ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3f6e3246-067c-4284-96f0-5c240c8d574f") failed: Property not found. retry in 590.523775ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3f6e3246-067c-4284-96f0-5c240c8d574f
11892024-05-20T20:42:51.436ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6f643d6c-2570-4985-a55f-74539d274616") failed: Property not found. retry in 1.334836503s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6f643d6c-2570-4985-a55f-74539d274616
11902024-05-20T20:42:51.458ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_917418e2-81ce-4591-8db5-632c4bd582f5") failed: Property not found. retry in 1.430049232s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_917418e2-81ce-4591-8db5-632c4bd582f5
11912024-05-20T20:42:51.495ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb9ca965-4ea9-4346-a9e2-23efb7ce8f74") failed: Property not found. retry in 813.070368ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb9ca965-4ea9-4346-a9e2-23efb7ce8f74
11922024-05-20T20:42:51.508ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_17d00716-dd0a-4d24-ab6e-9a5cb155744b") failed: Property not found. retry in 1.282705789s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_17d00716-dd0a-4d24-ab6e-9a5cb155744b
11932024-05-20T20:42:51.756ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6b7319ee-db54-4949-bb6e-3910882850a6") failed: Property not found. retry in 1.241136299s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6b7319ee-db54-4949-bb6e-3910882850a6
11942024-05-20T20:42:51.832ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e84f7596-a85d-4c73-b3d4-f0329d444614") failed: Property not found. retry in 615.391117ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e84f7596-a85d-4c73-b3d4-f0329d444614
11952024-05-20T20:42:51.877ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4e563445-4d41-489d-ba9b-67ee7c445814") failed: Property not found. retry in 828.446947ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4e563445-4d41-489d-ba9b-67ee7c445814
11962024-05-20T20:42:52.027ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3f6e3246-067c-4284-96f0-5c240c8d574f") failed: Property not found. retry in 1.160807592s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3f6e3246-067c-4284-96f0-5c240c8d574f
11972024-05-20T20:42:52.072ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dde34b1a-6b49-4e8c-b9a4-a6feddc5a27e") failed: Property not found. retry in 1.281433467s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dde34b1a-6b49-4e8c-b9a4-a6feddc5a27e
11982024-05-20T20:42:52.295ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c0fd353f-5a49-444e-bc05-f198e4716be9") failed: Property not found. retry in 949.978637ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c0fd353f-5a49-444e-bc05-f198e4716be9
11992024-05-20T20:42:52.321ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb9ca965-4ea9-4346-a9e2-23efb7ce8f74") failed: Property not found. retry in 1.265986626s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb9ca965-4ea9-4346-a9e2-23efb7ce8f74
12002024-05-20T20:42:52.429ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6ea6981d-af75-4034-ab13-1ff89fb41fe0") failed: Property not found. retry in 920.987582ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6ea6981d-af75-4034-ab13-1ff89fb41fe0
12012024-05-20T20:42:52.454ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eac960af-0b57-4d85-a12d-2817f002da93") failed: Property not found. retry in 1.45034407s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eac960af-0b57-4d85-a12d-2817f002da93
12022024-05-20T20:42:52.464ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e84f7596-a85d-4c73-b3d4-f0329d444614") failed: Property not found. retry in 1.325717042s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e84f7596-a85d-4c73-b3d4-f0329d444614
12032024-05-20T20:42:52.574ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7d929bd2-96bc-4806-b33d-98add78507f8") failed: Property not found. retry in 559.585197ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7d929bd2-96bc-4806-b33d-98add78507f8
12042024-05-20T20:42:52.718ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4e563445-4d41-489d-ba9b-67ee7c445814") failed: Property not found. retry in 795.641893ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4e563445-4d41-489d-ba9b-67ee7c445814
12052024-05-20T20:42:52.784ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6f643d6c-2570-4985-a55f-74539d274616") failed: Property not found. retry in 560.926368ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6f643d6c-2570-4985-a55f-74539d274616
12062024-05-20T20:42:52.804ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_17d00716-dd0a-4d24-ab6e-9a5cb155744b") failed: Property not found. retry in 1.410496162s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_17d00716-dd0a-4d24-ab6e-9a5cb155744b
12072024-05-20T20:42:52.901ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_917418e2-81ce-4591-8db5-632c4bd582f5") failed: Property not found. retry in 672.693226ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_917418e2-81ce-4591-8db5-632c4bd582f5
12082024-05-20T20:42:53.011ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6b7319ee-db54-4949-bb6e-3910882850a6") failed: Property not found. retry in 547.054436ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6b7319ee-db54-4949-bb6e-3910882850a6
12092024-05-20T20:42:53.147ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7d929bd2-96bc-4806-b33d-98add78507f8") failed: Property not found. retry in 1.209342896s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7d929bd2-96bc-4806-b33d-98add78507f8
12102024-05-20T20:42:53.199ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3f6e3246-067c-4284-96f0-5c240c8d574f") failed: Property not found. retry in 573.267252ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3f6e3246-067c-4284-96f0-5c240c8d574f
12112024-05-20T20:42:53.257ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c0fd353f-5a49-444e-bc05-f198e4716be9") failed: Property not found. retry in 1.445046098s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c0fd353f-5a49-444e-bc05-f198e4716be9
12122024-05-20T20:42:53.356ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6f643d6c-2570-4985-a55f-74539d274616") failed: Property not found. retry in 921.470602ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6f643d6c-2570-4985-a55f-74539d274616
12132024-05-20T20:42:53.365ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6ea6981d-af75-4034-ab13-1ff89fb41fe0") failed: Property not found. retry in 1.143652313s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6ea6981d-af75-4034-ab13-1ff89fb41fe0
12142024-05-20T20:42:53.375ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dde34b1a-6b49-4e8c-b9a4-a6feddc5a27e") failed: Property not found. retry in 1.444515328s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dde34b1a-6b49-4e8c-b9a4-a6feddc5a27e
12152024-05-20T20:42:53.523ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4e563445-4d41-489d-ba9b-67ee7c445814") failed: Property not found. retry in 780.294354ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4e563445-4d41-489d-ba9b-67ee7c445814
12162024-05-20T20:42:53.567ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6b7319ee-db54-4949-bb6e-3910882850a6") failed: Property not found. retry in 1.16609946s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6b7319ee-db54-4949-bb6e-3910882850a6
12172024-05-20T20:42:53.583ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_917418e2-81ce-4591-8db5-632c4bd582f5") failed: Property not found. retry in 825.059219ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_917418e2-81ce-4591-8db5-632c4bd582f5
12182024-05-20T20:42:53.595ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb9ca965-4ea9-4346-a9e2-23efb7ce8f74") failed: Property not found. retry in 1.43429526s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb9ca965-4ea9-4346-a9e2-23efb7ce8f74
12192024-05-20T20:42:53.782ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3f6e3246-067c-4284-96f0-5c240c8d574f") failed: Property not found. retry in 972.627913ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3f6e3246-067c-4284-96f0-5c240c8d574f
12202024-05-20T20:42:53.798ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e84f7596-a85d-4c73-b3d4-f0329d444614") failed: Property not found. retry in 598.47044ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e84f7596-a85d-4c73-b3d4-f0329d444614
12212024-05-20T20:42:53.915ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eac960af-0b57-4d85-a12d-2817f002da93") failed: Property not found. retry in 1.308498122s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eac960af-0b57-4d85-a12d-2817f002da93
12222024-05-20T20:42:54.225ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_17d00716-dd0a-4d24-ab6e-9a5cb155744b") failed: Property not found. retry in 1.280613056s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_17d00716-dd0a-4d24-ab6e-9a5cb155744b
12232024-05-20T20:42:54.286ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6f643d6c-2570-4985-a55f-74539d274616") failed: Property not found. retry in 1.185715498s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6f643d6c-2570-4985-a55f-74539d274616
12242024-05-20T20:42:54.313ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4e563445-4d41-489d-ba9b-67ee7c445814") failed: Property not found. retry in 1.381797822s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4e563445-4d41-489d-ba9b-67ee7c445814
12252024-05-20T20:42:54.366ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7d929bd2-96bc-4806-b33d-98add78507f8") failed: Property not found. retry in 1.417378353s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7d929bd2-96bc-4806-b33d-98add78507f8
12262024-05-20T20:42:54.405ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e84f7596-a85d-4c73-b3d4-f0329d444614") failed: Property not found. retry in 972.022485ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e84f7596-a85d-4c73-b3d4-f0329d444614
12272024-05-20T20:42:54.418ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_917418e2-81ce-4591-8db5-632c4bd582f5") failed: Property not found. retry in 1.0545663s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_917418e2-81ce-4591-8db5-632c4bd582f5
12282024-05-20T20:42:54.518ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6ea6981d-af75-4034-ab13-1ff89fb41fe0") failed: Property not found. retry in 1.250885747s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6ea6981d-af75-4034-ab13-1ff89fb41fe0
12292024-05-20T20:42:54.711ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c0fd353f-5a49-444e-bc05-f198e4716be9") failed: Property not found. retry in 1.335944486s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c0fd353f-5a49-444e-bc05-f198e4716be9
12302024-05-20T20:42:54.742ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6b7319ee-db54-4949-bb6e-3910882850a6") failed: Property not found. retry in 1.014787556s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6b7319ee-db54-4949-bb6e-3910882850a6
12312024-05-20T20:42:54.763ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3f6e3246-067c-4284-96f0-5c240c8d574f") failed: Property not found. retry in 987.521008ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3f6e3246-067c-4284-96f0-5c240c8d574f
12322024-05-20T20:42:54.829ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dde34b1a-6b49-4e8c-b9a4-a6feddc5a27e") failed: Property not found. retry in 1.410348311s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dde34b1a-6b49-4e8c-b9a4-a6feddc5a27e
12332024-05-20T20:42:55.039ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb9ca965-4ea9-4346-a9e2-23efb7ce8f74") failed: Property not found. retry in 833.10836ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb9ca965-4ea9-4346-a9e2-23efb7ce8f74
12342024-05-20T20:42:55.233ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eac960af-0b57-4d85-a12d-2817f002da93") failed: Property not found. retry in 1.429870917s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eac960af-0b57-4d85-a12d-2817f002da93
12352024-05-20T20:42:55.387ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e84f7596-a85d-4c73-b3d4-f0329d444614") failed: Property not found. retry in 1.442066756s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e84f7596-a85d-4c73-b3d4-f0329d444614
12362024-05-20T20:42:55.481ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6f643d6c-2570-4985-a55f-74539d274616") failed: Property not found. retry in 869.760039ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6f643d6c-2570-4985-a55f-74539d274616
12372024-05-20T20:42:55.490ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_917418e2-81ce-4591-8db5-632c4bd582f5") failed: Property not found. retry in 1.484868972s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_917418e2-81ce-4591-8db5-632c4bd582f5
12382024-05-20T20:42:55.513ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_17d00716-dd0a-4d24-ab6e-9a5cb155744b") failed: Property not found. retry in 500.966153ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_17d00716-dd0a-4d24-ab6e-9a5cb155744b
12392024-05-20T20:42:55.788ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4e563445-4d41-489d-ba9b-67ee7c445814") failed: Property not found. retry in 944.993356ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4e563445-4d41-489d-ba9b-67ee7c445814
12402024-05-20T20:42:55.832ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6ea6981d-af75-4034-ab13-1ff89fb41fe0") failed: Property not found. retry in 1.065543777s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6ea6981d-af75-4034-ab13-1ff89fb41fe0
12412024-05-20T20:42:55.873ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6b7319ee-db54-4949-bb6e-3910882850a6") failed: Property not found. retry in 588.532834ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6b7319ee-db54-4949-bb6e-3910882850a6
12422024-05-20T20:42:56.105ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7d929bd2-96bc-4806-b33d-98add78507f8") failed: Property not found. retry in 1.085496511s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7d929bd2-96bc-4806-b33d-98add78507f8
12432024-05-20T20:42:56.116ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3f6e3246-067c-4284-96f0-5c240c8d574f") failed: Property not found. retry in 713.617758ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3f6e3246-067c-4284-96f0-5c240c8d574f
12442024-05-20T20:42:56.186ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb9ca965-4ea9-4346-a9e2-23efb7ce8f74") failed: Property not found. retry in 1.168573175s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb9ca965-4ea9-4346-a9e2-23efb7ce8f74
12452024-05-20T20:42:56.203ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_17d00716-dd0a-4d24-ab6e-9a5cb155744b") failed: Property not found. retry in 1.129982058s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_17d00716-dd0a-4d24-ab6e-9a5cb155744b
12462024-05-20T20:42:56.219ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c0fd353f-5a49-444e-bc05-f198e4716be9") failed: Property not found. retry in 1.00082376s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c0fd353f-5a49-444e-bc05-f198e4716be9
12472024-05-20T20:42:56.254ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dde34b1a-6b49-4e8c-b9a4-a6feddc5a27e") failed: Property not found. retry in 1.337520133s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dde34b1a-6b49-4e8c-b9a4-a6feddc5a27e
12482024-05-20T20:42:56.366ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6f643d6c-2570-4985-a55f-74539d274616") failed: Property not found. retry in 702.453514ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6f643d6c-2570-4985-a55f-74539d274616
12492024-05-20T20:42:56.473ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6b7319ee-db54-4949-bb6e-3910882850a6") failed: Property not found. retry in 1.220038525s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6b7319ee-db54-4949-bb6e-3910882850a6
12502024-05-20T20:42:56.676ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eac960af-0b57-4d85-a12d-2817f002da93") failed: Property not found. retry in 1.225672481s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eac960af-0b57-4d85-a12d-2817f002da93
12512024-05-20T20:42:56.744ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4e563445-4d41-489d-ba9b-67ee7c445814") failed: Property not found. retry in 946.461886ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4e563445-4d41-489d-ba9b-67ee7c445814
12522024-05-20T20:42:56.842ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e84f7596-a85d-4c73-b3d4-f0329d444614") failed: Property not found. retry in 1.265241106s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e84f7596-a85d-4c73-b3d4-f0329d444614
12532024-05-20T20:42:56.853ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3f6e3246-067c-4284-96f0-5c240c8d574f") failed: Property not found. retry in 904.406353ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3f6e3246-067c-4284-96f0-5c240c8d574f
12542024-05-20T20:42:56.911ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6ea6981d-af75-4034-ab13-1ff89fb41fe0") failed: Property not found. retry in 1.329404012s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6ea6981d-af75-4034-ab13-1ff89fb41fe0
12552024-05-20T20:42:56.987ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_917418e2-81ce-4591-8db5-632c4bd582f5") failed: Property not found. retry in 814.315748ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_917418e2-81ce-4591-8db5-632c4bd582f5
12562024-05-20T20:42:57.036ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7d929bd2-96bc-4806-b33d-98add78507f8") failed: Property not found. retry in 1.183518932s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7d929bd2-96bc-4806-b33d-98add78507f8
12572024-05-20T20:42:57.080ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6f643d6c-2570-4985-a55f-74539d274616") failed: Property not found. retry in 563.116759ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6f643d6c-2570-4985-a55f-74539d274616
12582024-05-20T20:42:57.231ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c0fd353f-5a49-444e-bc05-f198e4716be9") failed: Property not found. retry in 575.694594ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c0fd353f-5a49-444e-bc05-f198e4716be9
12592024-05-20T20:42:57.346ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_17d00716-dd0a-4d24-ab6e-9a5cb155744b") failed: Property not found. retry in 1.444909687s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_17d00716-dd0a-4d24-ab6e-9a5cb155744b
12602024-05-20T20:42:57.368ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb9ca965-4ea9-4346-a9e2-23efb7ce8f74") failed: Property not found. retry in 1.066918684s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb9ca965-4ea9-4346-a9e2-23efb7ce8f74
12612024-05-20T20:42:57.660ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dde34b1a-6b49-4e8c-b9a4-a6feddc5a27e") failed: Property not found. retry in 811.349385ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dde34b1a-6b49-4e8c-b9a4-a6feddc5a27e
12622024-05-20T20:42:57.742ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6f643d6c-2570-4985-a55f-74539d274616") failed: Property not found. retry in 776.438844ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6f643d6c-2570-4985-a55f-74539d274616
12632024-05-20T20:42:57.744ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_00a5b8be-3547-4e9c-a8ff-18e0e241f74a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService27"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::9"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value="vopte5"/> <propval type="astring" name="gateway" value="172.30.1.1"/> <propval type="astring" name="ip" value="172.30.1.6"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value="[fd00:1122:3344:101::9]:5353"/> <propval type="astring" name="dns_address" value="172.30.1.6:53"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12642024-05-20T20:42:57.834ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6b7319ee-db54-4949-bb6e-3910882850a6") failed: Property not found. retry in 1.031843184s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6b7319ee-db54-4949-bb6e-3910882850a6
12652024-05-20T20:42:57.834ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_external_dns_00a5b8be-3547-4e9c-a8ff-18e0e241f74a
12662024-05-20T20:42:57.912ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4e563445-4d41-489d-ba9b-67ee7c445814") failed: Property not found. retry in 726.780762ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4e563445-4d41-489d-ba9b-67ee7c445814
12672024-05-20T20:42:57.971ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eac960af-0b57-4d85-a12d-2817f002da93") failed: Property not found. retry in 1.303719459s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eac960af-0b57-4d85-a12d-2817f002da93
12682024-05-20T20:42:57.980ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c0fd353f-5a49-444e-bc05-f198e4716be9") failed: Property not found. retry in 1.231438302s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c0fd353f-5a49-444e-bc05-f198e4716be9
12692024-05-20T20:42:57.991ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_917418e2-81ce-4591-8db5-632c4bd582f5") failed: Property not found. retry in 1.262878033s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_917418e2-81ce-4591-8db5-632c4bd582f5
12702024-05-20T20:42:58.002ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3f6e3246-067c-4284-96f0-5c240c8d574f") failed: Property not found. retry in 901.894516ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3f6e3246-067c-4284-96f0-5c240c8d574f
12712024-05-20T20:42:58.117ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e84f7596-a85d-4c73-b3d4-f0329d444614") failed: Property not found. retry in 828.93444ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e84f7596-a85d-4c73-b3d4-f0329d444614
12722024-05-20T20:42:58.173ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_00a5b8be-3547-4e9c-a8ff-18e0e241f74a") failed: Property not found. retry in 66.765755ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_00a5b8be-3547-4e9c-a8ff-18e0e241f74a
12732024-05-20T20:42:58.230ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7d929bd2-96bc-4806-b33d-98add78507f8") failed: Property not found. retry in 677.980392ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7d929bd2-96bc-4806-b33d-98add78507f8
12742024-05-20T20:42:58.248ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_00a5b8be-3547-4e9c-a8ff-18e0e241f74a") failed: Property not found. retry in 58.733983ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_00a5b8be-3547-4e9c-a8ff-18e0e241f74a
12752024-05-20T20:42:58.256ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6ea6981d-af75-4034-ab13-1ff89fb41fe0") failed: Property not found. retry in 1.159092344s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6ea6981d-af75-4034-ab13-1ff89fb41fe0
12762024-05-20T20:42:58.320ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_00a5b8be-3547-4e9c-a8ff-18e0e241f74a") failed: Property not found. retry in 138.228592ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_00a5b8be-3547-4e9c-a8ff-18e0e241f74a
12772024-05-20T20:42:58.445ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb9ca965-4ea9-4346-a9e2-23efb7ce8f74") failed: Property not found. retry in 1.346594983s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb9ca965-4ea9-4346-a9e2-23efb7ce8f74
12782024-05-20T20:42:58.467ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_00a5b8be-3547-4e9c-a8ff-18e0e241f74a") failed: Property not found. retry in 365.224736ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_00a5b8be-3547-4e9c-a8ff-18e0e241f74a
12792024-05-20T20:42:58.478ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dde34b1a-6b49-4e8c-b9a4-a6feddc5a27e") failed: Property not found. retry in 831.313043ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dde34b1a-6b49-4e8c-b9a4-a6feddc5a27e
12802024-05-20T20:42:58.527ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6f643d6c-2570-4985-a55f-74539d274616") failed: Property not found. retry in 1.240421429s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6f643d6c-2570-4985-a55f-74539d274616
12812024-05-20T20:42:58.601ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_2f0b1227-85e6-4def-9a56-3028cc1a9e6b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService28"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::a"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value="vopte4"/> <propval type="astring" name="gateway" value="172.30.2.1"/> <propval type="astring" name="ip" value="172.30.2.5"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12822024-05-20T20:42:58.601ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_baf5303b-2c5b-4e5f-aa55-2481f975633b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService24"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::c"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value="vopte1"/> <propval type="astring" name="gateway" value="172.30.2.1"/> <propval type="astring" name="ip" value="172.30.2.7"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12832024-05-20T20:42:58.601ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_nexus_2f0b1227-85e6-4def-9a56-3028cc1a9e6b
12842024-05-20T20:42:58.606ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_nexus_baf5303b-2c5b-4e5f-aa55-2481f975633b
12852024-05-20T20:42:58.649ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4e563445-4d41-489d-ba9b-67ee7c445814") failed: Property not found. retry in 1.235902383s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4e563445-4d41-489d-ba9b-67ee7c445814
12862024-05-20T20:42:58.755ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2f0b1227-85e6-4def-9a56-3028cc1a9e6b") failed: Property not found. retry in 56.094616ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2f0b1227-85e6-4def-9a56-3028cc1a9e6b
12872024-05-20T20:42:58.762ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_baf5303b-2c5b-4e5f-aa55-2481f975633b") failed: Property not found. retry in 53.519997ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_baf5303b-2c5b-4e5f-aa55-2481f975633b
12882024-05-20T20:42:58.799ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_17d00716-dd0a-4d24-ab6e-9a5cb155744b") failed: Property not found. retry in 1.113448398s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_17d00716-dd0a-4d24-ab6e-9a5cb155744b
12892024-05-20T20:42:58.874ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2f0b1227-85e6-4def-9a56-3028cc1a9e6b") failed: Property not found. retry in 89.966631ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2f0b1227-85e6-4def-9a56-3028cc1a9e6b
12902024-05-20T20:42:58.937ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_baf5303b-2c5b-4e5f-aa55-2481f975633b") failed: Property not found. retry in 122.677789ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_baf5303b-2c5b-4e5f-aa55-2481f975633b
12912024-05-20T20:42:59.283ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6b7319ee-db54-4949-bb6e-3910882850a6") failed: Property not found. retry in 522.569893ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6b7319ee-db54-4949-bb6e-3910882850a6
12922024-05-20T20:42:59.348ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_00a5b8be-3547-4e9c-a8ff-18e0e241f74a") failed: Property not found. retry in 708.599592ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_00a5b8be-3547-4e9c-a8ff-18e0e241f74a
12932024-05-20T20:42:59.392ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_baf5303b-2c5b-4e5f-aa55-2481f975633b") failed: Property not found. retry in 251.05152ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_baf5303b-2c5b-4e5f-aa55-2481f975633b
12942024-05-20T20:42:59.409ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eac960af-0b57-4d85-a12d-2817f002da93") failed: Property not found. retry in 1.111195586s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eac960af-0b57-4d85-a12d-2817f002da93
12952024-05-20T20:42:59.425ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e84f7596-a85d-4c73-b3d4-f0329d444614") failed: Property not found. retry in 914.056979ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e84f7596-a85d-4c73-b3d4-f0329d444614
12962024-05-20T20:42:59.438ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7d929bd2-96bc-4806-b33d-98add78507f8") failed: Property not found. retry in 997.096427ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7d929bd2-96bc-4806-b33d-98add78507f8
12972024-05-20T20:42:59.448ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dde34b1a-6b49-4e8c-b9a4-a6feddc5a27e") failed: Property not found. retry in 1.371612485s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dde34b1a-6b49-4e8c-b9a4-a6feddc5a27e
12982024-05-20T20:42:59.456ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c0fd353f-5a49-444e-bc05-f198e4716be9") failed: Property not found. retry in 1.055346228s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c0fd353f-5a49-444e-bc05-f198e4716be9
12992024-05-20T20:42:59.466ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_917418e2-81ce-4591-8db5-632c4bd582f5") failed: Property not found. retry in 501.783826ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_917418e2-81ce-4591-8db5-632c4bd582f5
13002024-05-20T20:42:59.482ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3f6e3246-067c-4284-96f0-5c240c8d574f") failed: Property not found. retry in 642.917776ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3f6e3246-067c-4284-96f0-5c240c8d574f
13012024-05-20T20:42:59.493ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2f0b1227-85e6-4def-9a56-3028cc1a9e6b") failed: Property not found. retry in 294.913512ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2f0b1227-85e6-4def-9a56-3028cc1a9e6b
13022024-05-20T20:42:59.501ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6ea6981d-af75-4034-ab13-1ff89fb41fe0") failed: Property not found. retry in 1.115812656s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6ea6981d-af75-4034-ab13-1ff89fb41fe0
13032024-05-20T20:42:59.509ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_9d0d72ea-cc41-4566-a012-82f5edda1c26: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService25"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::8"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value="vopte2"/> <propval type="astring" name="gateway" value="172.30.1.1"/> <propval type="astring" name="ip" value="172.30.1.5"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value="[fd00:1122:3344:101::8]:5353"/> <propval type="astring" name="dns_address" value="172.30.1.5:53"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13042024-05-20T20:42:59.510ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_external_dns_9d0d72ea-cc41-4566-a012-82f5edda1c26
13052024-05-20T20:42:59.654ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_baf5303b-2c5b-4e5f-aa55-2481f975633b") failed: Property not found. retry in 444.325977ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_baf5303b-2c5b-4e5f-aa55-2481f975633b
13062024-05-20T20:42:59.671ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9d0d72ea-cc41-4566-a012-82f5edda1c26") failed: Property not found. retry in 30.929428ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9d0d72ea-cc41-4566-a012-82f5edda1c26
13072024-05-20T20:42:59.711ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9d0d72ea-cc41-4566-a012-82f5edda1c26") failed: Property not found. retry in 136.6703ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9d0d72ea-cc41-4566-a012-82f5edda1c26
13082024-05-20T20:42:59.779ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6f643d6c-2570-4985-a55f-74539d274616") failed: Property not found. retry in 1.372075935s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6f643d6c-2570-4985-a55f-74539d274616
13092024-05-20T20:42:59.798ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2f0b1227-85e6-4def-9a56-3028cc1a9e6b") failed: Property not found. retry in 396.729516ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2f0b1227-85e6-4def-9a56-3028cc1a9e6b
13102024-05-20T20:42:59.806ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb9ca965-4ea9-4346-a9e2-23efb7ce8f74") failed: Property not found. retry in 1.278629478s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb9ca965-4ea9-4346-a9e2-23efb7ce8f74
13112024-05-20T20:42:59.815ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6b7319ee-db54-4949-bb6e-3910882850a6") failed: Property not found. retry in 1.293157719s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6b7319ee-db54-4949-bb6e-3910882850a6
13122024-05-20T20:42:59.860ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9d0d72ea-cc41-4566-a012-82f5edda1c26") failed: Property not found. retry in 266.982532ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9d0d72ea-cc41-4566-a012-82f5edda1c26
13132024-05-20T20:42:59.895ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4e563445-4d41-489d-ba9b-67ee7c445814") failed: Property not found. retry in 1.242447642s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4e563445-4d41-489d-ba9b-67ee7c445814
13142024-05-20T20:42:59.925ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_17d00716-dd0a-4d24-ab6e-9a5cb155744b") failed: Property not found. retry in 840.076839ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_17d00716-dd0a-4d24-ab6e-9a5cb155744b
13152024-05-20T20:42:59.978ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_917418e2-81ce-4591-8db5-632c4bd582f5") failed: Property not found. retry in 1.308065474s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_917418e2-81ce-4591-8db5-632c4bd582f5
13162024-05-20T20:43:00.066ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_00a5b8be-3547-4e9c-a8ff-18e0e241f74a") failed: Property not found. retry in 725.450168ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_00a5b8be-3547-4e9c-a8ff-18e0e241f74a
13172024-05-20T20:43:00.109ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_baf5303b-2c5b-4e5f-aa55-2481f975633b") failed: Property not found. retry in 1.09895937s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_baf5303b-2c5b-4e5f-aa55-2481f975633b
13182024-05-20T20:43:00.135ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3f6e3246-067c-4284-96f0-5c240c8d574f") failed: Property not found. retry in 1.489984006s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3f6e3246-067c-4284-96f0-5c240c8d574f
13192024-05-20T20:43:00.143ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9d0d72ea-cc41-4566-a012-82f5edda1c26") failed: Property not found. retry in 290.266184ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9d0d72ea-cc41-4566-a012-82f5edda1c26
13202024-05-20T20:43:00.205ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2f0b1227-85e6-4def-9a56-3028cc1a9e6b") failed: Property not found. retry in 983.604805ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2f0b1227-85e6-4def-9a56-3028cc1a9e6b
13212024-05-20T20:43:00.240ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_14030859-ed0f-47ae-9477-941c8fd9b402: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService26"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::b"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value="vopte3"/> <propval type="astring" name="gateway" value="172.30.2.1"/> <propval type="astring" name="ip" value="172.30.2.6"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13222024-05-20T20:43:00.240ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_nexus_14030859-ed0f-47ae-9477-941c8fd9b402
13232024-05-20T20:43:00.349ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e84f7596-a85d-4c73-b3d4-f0329d444614") failed: Property not found. retry in 1.338824812s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e84f7596-a85d-4c73-b3d4-f0329d444614
13242024-05-20T20:43:00.396ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_14030859-ed0f-47ae-9477-941c8fd9b402") failed: Property not found. retry in 46.14415ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_14030859-ed0f-47ae-9477-941c8fd9b402
13252024-05-20T20:43:00.443ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9d0d72ea-cc41-4566-a012-82f5edda1c26") failed: Property not found. retry in 544.573538ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9d0d72ea-cc41-4566-a012-82f5edda1c26
13262024-05-20T20:43:00.450ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7d929bd2-96bc-4806-b33d-98add78507f8") failed: Property not found. retry in 648.445077ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7d929bd2-96bc-4806-b33d-98add78507f8
13272024-05-20T20:43:00.457ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_14030859-ed0f-47ae-9477-941c8fd9b402") failed: Property not found. retry in 89.069428ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_14030859-ed0f-47ae-9477-941c8fd9b402
13282024-05-20T20:43:00.520ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c0fd353f-5a49-444e-bc05-f198e4716be9") failed: Property not found. retry in 961.188685ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c0fd353f-5a49-444e-bc05-f198e4716be9
13292024-05-20T20:43:00.528ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eac960af-0b57-4d85-a12d-2817f002da93") failed: Property not found. retry in 576.595172ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eac960af-0b57-4d85-a12d-2817f002da93
13302024-05-20T20:43:00.556ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_14030859-ed0f-47ae-9477-941c8fd9b402") failed: Property not found. retry in 210.656689ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_14030859-ed0f-47ae-9477-941c8fd9b402
13312024-05-20T20:43:00.626ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6ea6981d-af75-4034-ab13-1ff89fb41fe0") failed: Property not found. retry in 920.524523ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6ea6981d-af75-4034-ab13-1ff89fb41fe0
13322024-05-20T20:43:00.774ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_17d00716-dd0a-4d24-ab6e-9a5cb155744b") failed: Property not found. retry in 1.110066949s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_17d00716-dd0a-4d24-ab6e-9a5cb155744b
13332024-05-20T20:43:00.781ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_14030859-ed0f-47ae-9477-941c8fd9b402") failed: Property not found. retry in 344.622916ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_14030859-ed0f-47ae-9477-941c8fd9b402
13342024-05-20T20:43:00.800ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_00a5b8be-3547-4e9c-a8ff-18e0e241f74a") failed: Property not found. retry in 692.582297ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_00a5b8be-3547-4e9c-a8ff-18e0e241f74a
13352024-05-20T20:43:00.828ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dde34b1a-6b49-4e8c-b9a4-a6feddc5a27e") failed: Property not found. retry in 1.324935562s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dde34b1a-6b49-4e8c-b9a4-a6feddc5a27e
13362024-05-20T20:43:00.998ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9d0d72ea-cc41-4566-a012-82f5edda1c26") failed: Property not found. retry in 1.452957266s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9d0d72ea-cc41-4566-a012-82f5edda1c26
13372024-05-20T20:43:01.095ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb9ca965-4ea9-4346-a9e2-23efb7ce8f74") failed: Property not found. retry in 621.742096ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb9ca965-4ea9-4346-a9e2-23efb7ce8f74
13382024-05-20T20:43:01.108ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7d929bd2-96bc-4806-b33d-98add78507f8") failed: Property not found. retry in 1.378363625s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7d929bd2-96bc-4806-b33d-98add78507f8
13392024-05-20T20:43:01.116ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eac960af-0b57-4d85-a12d-2817f002da93") failed: Property not found. retry in 765.696304ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eac960af-0b57-4d85-a12d-2817f002da93
13402024-05-20T20:43:01.124ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6b7319ee-db54-4949-bb6e-3910882850a6") failed: Property not found. retry in 1.105914554s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6b7319ee-db54-4949-bb6e-3910882850a6
13412024-05-20T20:43:01.134ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_14030859-ed0f-47ae-9477-941c8fd9b402") failed: Property not found. retry in 898.912752ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_14030859-ed0f-47ae-9477-941c8fd9b402
13422024-05-20T20:43:01.146ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4e563445-4d41-489d-ba9b-67ee7c445814") failed: Property not found. retry in 731.898309ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4e563445-4d41-489d-ba9b-67ee7c445814
13432024-05-20T20:43:01.160ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6f643d6c-2570-4985-a55f-74539d274616") failed: Property not found. retry in 795.0769ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6f643d6c-2570-4985-a55f-74539d274616
13442024-05-20T20:43:01.198ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2f0b1227-85e6-4def-9a56-3028cc1a9e6b") failed: Property not found. retry in 1.026385118s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2f0b1227-85e6-4def-9a56-3028cc1a9e6b
13452024-05-20T20:43:01.217ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_baf5303b-2c5b-4e5f-aa55-2481f975633b") failed: Property not found. retry in 1.291056731s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_baf5303b-2c5b-4e5f-aa55-2481f975633b
13462024-05-20T20:43:01.281ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_1722682a-0a76-447a-b2fd-ed2d5eb1e165: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService11"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::e"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::e"/> <propval type="astring" name="listen_port" value="8123"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> <value_node value="fd00:1122:3344:1::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13472024-05-20T20:43:01.281ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_clickhouse_1722682a-0a76-447a-b2fd-ed2d5eb1e165
13482024-05-20T20:43:01.296ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_917418e2-81ce-4591-8db5-632c4bd582f5") failed: Property not found. retry in 1.101355094s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_917418e2-81ce-4591-8db5-632c4bd582f5
13492024-05-20T20:43:01.436ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_1722682a-0a76-447a-b2fd-ed2d5eb1e165") failed: Property not found. retry in 70.85216ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_1722682a-0a76-447a-b2fd-ed2d5eb1e165
13502024-05-20T20:43:01.490ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c0fd353f-5a49-444e-bc05-f198e4716be9") failed: Property not found. retry in 770.701619ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c0fd353f-5a49-444e-bc05-f198e4716be9
13512024-05-20T20:43:01.501ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_00a5b8be-3547-4e9c-a8ff-18e0e241f74a") failed: Property not found. retry in 958.38507ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_00a5b8be-3547-4e9c-a8ff-18e0e241f74a
13522024-05-20T20:43:01.515ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_1722682a-0a76-447a-b2fd-ed2d5eb1e165") failed: Property not found. retry in 138.044208ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_1722682a-0a76-447a-b2fd-ed2d5eb1e165
13532024-05-20T20:43:01.554ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6ea6981d-af75-4034-ab13-1ff89fb41fe0") failed: Property not found. retry in 968.580955ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6ea6981d-af75-4034-ab13-1ff89fb41fe0
13542024-05-20T20:43:01.633ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3f6e3246-067c-4284-96f0-5c240c8d574f") failed: Property not found. retry in 1.441547783s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3f6e3246-067c-4284-96f0-5c240c8d574f
13552024-05-20T20:43:01.661ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_1722682a-0a76-447a-b2fd-ed2d5eb1e165") failed: Property not found. retry in 255.160012ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_1722682a-0a76-447a-b2fd-ed2d5eb1e165
13562024-05-20T20:43:01.696ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e84f7596-a85d-4c73-b3d4-f0329d444614") failed: Property not found. retry in 604.147975ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e84f7596-a85d-4c73-b3d4-f0329d444614
13572024-05-20T20:43:01.725ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb9ca965-4ea9-4346-a9e2-23efb7ce8f74") failed: Property not found. retry in 763.146656ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb9ca965-4ea9-4346-a9e2-23efb7ce8f74
13582024-05-20T20:43:01.887ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4e563445-4d41-489d-ba9b-67ee7c445814") failed: Property not found. retry in 1.262473962s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4e563445-4d41-489d-ba9b-67ee7c445814
13592024-05-20T20:43:01.895ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eac960af-0b57-4d85-a12d-2817f002da93") failed: Property not found. retry in 1.2102085s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eac960af-0b57-4d85-a12d-2817f002da93
13602024-05-20T20:43:01.902ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_17d00716-dd0a-4d24-ab6e-9a5cb155744b") failed: Property not found. retry in 1.369024184s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_17d00716-dd0a-4d24-ab6e-9a5cb155744b
13612024-05-20T20:43:01.925ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_1722682a-0a76-447a-b2fd-ed2d5eb1e165") failed: Property not found. retry in 325.93707ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_1722682a-0a76-447a-b2fd-ed2d5eb1e165
13622024-05-20T20:43:01.963ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6f643d6c-2570-4985-a55f-74539d274616") failed: Property not found. retry in 636.882168ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6f643d6c-2570-4985-a55f-74539d274616
13632024-05-20T20:43:02.044ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_14030859-ed0f-47ae-9477-941c8fd9b402") failed: Property not found. retry in 658.232682ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_14030859-ed0f-47ae-9477-941c8fd9b402
13642024-05-20T20:43:02.163ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dde34b1a-6b49-4e8c-b9a4-a6feddc5a27e") failed: Property not found. retry in 551.850677ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dde34b1a-6b49-4e8c-b9a4-a6feddc5a27e
13652024-05-20T20:43:02.235ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2f0b1227-85e6-4def-9a56-3028cc1a9e6b") failed: Property not found. retry in 1.047555522s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2f0b1227-85e6-4def-9a56-3028cc1a9e6b
13662024-05-20T20:43:02.242ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6b7319ee-db54-4949-bb6e-3910882850a6") failed: Property not found. retry in 1.402742716s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6b7319ee-db54-4949-bb6e-3910882850a6
13672024-05-20T20:43:02.260ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_1722682a-0a76-447a-b2fd-ed2d5eb1e165") failed: Property not found. retry in 1.145319232s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_1722682a-0a76-447a-b2fd-ed2d5eb1e165
13682024-05-20T20:43:02.269ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c0fd353f-5a49-444e-bc05-f198e4716be9") failed: Property not found. retry in 547.611998ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c0fd353f-5a49-444e-bc05-f198e4716be9
13692024-05-20T20:43:02.307ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e84f7596-a85d-4c73-b3d4-f0329d444614") failed: Property not found. retry in 737.905959ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e84f7596-a85d-4c73-b3d4-f0329d444614
13702024-05-20T20:43:02.407ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_917418e2-81ce-4591-8db5-632c4bd582f5") failed: Property not found. retry in 779.128794ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_917418e2-81ce-4591-8db5-632c4bd582f5
13712024-05-20T20:43:02.459ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9d0d72ea-cc41-4566-a012-82f5edda1c26") failed: Property not found. retry in 863.269507ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9d0d72ea-cc41-4566-a012-82f5edda1c26
13722024-05-20T20:43:02.467ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_00a5b8be-3547-4e9c-a8ff-18e0e241f74a") failed: Property not found. retry in 1.119772697s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_00a5b8be-3547-4e9c-a8ff-18e0e241f74a
13732024-05-20T20:43:02.495ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7d929bd2-96bc-4806-b33d-98add78507f8") failed: Property not found. retry in 1.049709051s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7d929bd2-96bc-4806-b33d-98add78507f8
13742024-05-20T20:43:02.501ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb9ca965-4ea9-4346-a9e2-23efb7ce8f74") failed: Property not found. retry in 901.523433ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb9ca965-4ea9-4346-a9e2-23efb7ce8f74
13752024-05-20T20:43:02.517ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_baf5303b-2c5b-4e5f-aa55-2481f975633b") failed: Property not found. retry in 1.475627869s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_baf5303b-2c5b-4e5f-aa55-2481f975633b
13762024-05-20T20:43:02.532ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6ea6981d-af75-4034-ab13-1ff89fb41fe0") failed: Property not found. retry in 1.136592623s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6ea6981d-af75-4034-ab13-1ff89fb41fe0
13772024-05-20T20:43:02.608ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6f643d6c-2570-4985-a55f-74539d274616") failed: Property not found. retry in 802.128253ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6f643d6c-2570-4985-a55f-74539d274616
13782024-05-20T20:43:02.711ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_14030859-ed0f-47ae-9477-941c8fd9b402") failed: Property not found. retry in 857.467603ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_14030859-ed0f-47ae-9477-941c8fd9b402
13792024-05-20T20:43:02.724ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dde34b1a-6b49-4e8c-b9a4-a6feddc5a27e") failed: Property not found. retry in 1.428071877s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dde34b1a-6b49-4e8c-b9a4-a6feddc5a27e
13802024-05-20T20:43:02.825ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c0fd353f-5a49-444e-bc05-f198e4716be9") failed: Property not found. retry in 1.272699571s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c0fd353f-5a49-444e-bc05-f198e4716be9
13812024-05-20T20:43:03.055ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e84f7596-a85d-4c73-b3d4-f0329d444614") failed: Property not found. retry in 1.22666421s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e84f7596-a85d-4c73-b3d4-f0329d444614
13822024-05-20T20:43:03.084ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3f6e3246-067c-4284-96f0-5c240c8d574f") failed: Property not found. retry in 793.925588ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3f6e3246-067c-4284-96f0-5c240c8d574f
13832024-05-20T20:43:03.114ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eac960af-0b57-4d85-a12d-2817f002da93") failed: Property not found. retry in 1.403356411s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eac960af-0b57-4d85-a12d-2817f002da93
13842024-05-20T20:43:03.158ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4e563445-4d41-489d-ba9b-67ee7c445814") failed: Property not found. retry in 1.1418327s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4e563445-4d41-489d-ba9b-67ee7c445814
13852024-05-20T20:43:03.195ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_917418e2-81ce-4591-8db5-632c4bd582f5") failed: Property not found. retry in 1.390547202s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_917418e2-81ce-4591-8db5-632c4bd582f5
13862024-05-20T20:43:03.280ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_17d00716-dd0a-4d24-ab6e-9a5cb155744b") failed: Property not found. retry in 1.084134698s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_17d00716-dd0a-4d24-ab6e-9a5cb155744b
13872024-05-20T20:43:03.292ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2f0b1227-85e6-4def-9a56-3028cc1a9e6b") failed: Property not found. retry in 1.38742992s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2f0b1227-85e6-4def-9a56-3028cc1a9e6b
13882024-05-20T20:43:03.331ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9d0d72ea-cc41-4566-a012-82f5edda1c26") failed: Property not found. retry in 1.381203921s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9d0d72ea-cc41-4566-a012-82f5edda1c26
13892024-05-20T20:43:03.412ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb9ca965-4ea9-4346-a9e2-23efb7ce8f74") failed: Property not found. retry in 503.947224ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb9ca965-4ea9-4346-a9e2-23efb7ce8f74
13902024-05-20T20:43:03.420ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_1722682a-0a76-447a-b2fd-ed2d5eb1e165") failed: Property not found. retry in 505.538671ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_1722682a-0a76-447a-b2fd-ed2d5eb1e165
13912024-05-20T20:43:03.428ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6f643d6c-2570-4985-a55f-74539d274616") failed: Property not found. retry in 510.076758ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6f643d6c-2570-4985-a55f-74539d274616
13922024-05-20T20:43:03.554ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7d929bd2-96bc-4806-b33d-98add78507f8") failed: Property not found. retry in 921.158817ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7d929bd2-96bc-4806-b33d-98add78507f8
13932024-05-20T20:43:03.577ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_14030859-ed0f-47ae-9477-941c8fd9b402") failed: Property not found. retry in 996.679358ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_14030859-ed0f-47ae-9477-941c8fd9b402
13942024-05-20T20:43:03.596ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_00a5b8be-3547-4e9c-a8ff-18e0e241f74a") failed: Property not found. retry in 1.373050111s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_00a5b8be-3547-4e9c-a8ff-18e0e241f74a
13952024-05-20T20:43:03.654ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6b7319ee-db54-4949-bb6e-3910882850a6") failed: Property not found. retry in 833.518714ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6b7319ee-db54-4949-bb6e-3910882850a6
13962024-05-20T20:43:03.680ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6ea6981d-af75-4034-ab13-1ff89fb41fe0") failed: Property not found. retry in 1.437614243s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6ea6981d-af75-4034-ab13-1ff89fb41fe0
13972024-05-20T20:43:03.887ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3f6e3246-067c-4284-96f0-5c240c8d574f") failed: Property not found. retry in 823.559374ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3f6e3246-067c-4284-96f0-5c240c8d574f
13982024-05-20T20:43:03.925ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb9ca965-4ea9-4346-a9e2-23efb7ce8f74") failed: Property not found. retry in 655.972584ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb9ca965-4ea9-4346-a9e2-23efb7ce8f74
13992024-05-20T20:43:03.935ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_1722682a-0a76-447a-b2fd-ed2d5eb1e165") failed: Property not found. retry in 1.478602536s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_1722682a-0a76-447a-b2fd-ed2d5eb1e165
14002024-05-20T20:43:03.947ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6f643d6c-2570-4985-a55f-74539d274616") failed: Property not found. retry in 1.460310555s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6f643d6c-2570-4985-a55f-74539d274616
14012024-05-20T20:43:04.001ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_baf5303b-2c5b-4e5f-aa55-2481f975633b") failed: Property not found. retry in 1.039049845s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_baf5303b-2c5b-4e5f-aa55-2481f975633b
14022024-05-20T20:43:04.109ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c0fd353f-5a49-444e-bc05-f198e4716be9") failed: Property not found. retry in 646.828843ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c0fd353f-5a49-444e-bc05-f198e4716be9
14032024-05-20T20:43:04.163ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dde34b1a-6b49-4e8c-b9a4-a6feddc5a27e") failed: Property not found. retry in 576.765469ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dde34b1a-6b49-4e8c-b9a4-a6feddc5a27e
14042024-05-20T20:43:04.294ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e84f7596-a85d-4c73-b3d4-f0329d444614") failed: Property not found. retry in 1.385873399s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e84f7596-a85d-4c73-b3d4-f0329d444614
14052024-05-20T20:43:04.309ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4e563445-4d41-489d-ba9b-67ee7c445814") failed: Property not found. retry in 1.449634384s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4e563445-4d41-489d-ba9b-67ee7c445814
14062024-05-20T20:43:04.374ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_17d00716-dd0a-4d24-ab6e-9a5cb155744b") failed: Property not found. retry in 538.462155ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_17d00716-dd0a-4d24-ab6e-9a5cb155744b
14072024-05-20T20:43:04.485ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7d929bd2-96bc-4806-b33d-98add78507f8") failed: Property not found. retry in 1.388075646s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7d929bd2-96bc-4806-b33d-98add78507f8
14082024-05-20T20:43:04.497ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6b7319ee-db54-4949-bb6e-3910882850a6") failed: Property not found. retry in 670.605913ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6b7319ee-db54-4949-bb6e-3910882850a6
14092024-05-20T20:43:04.526ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eac960af-0b57-4d85-a12d-2817f002da93") failed: Property not found. retry in 1.303083243s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eac960af-0b57-4d85-a12d-2817f002da93
14102024-05-20T20:43:04.583ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_14030859-ed0f-47ae-9477-941c8fd9b402") failed: Property not found. retry in 842.694571ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_14030859-ed0f-47ae-9477-941c8fd9b402
14112024-05-20T20:43:04.591ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb9ca965-4ea9-4346-a9e2-23efb7ce8f74") failed: Property not found. retry in 667.702778ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb9ca965-4ea9-4346-a9e2-23efb7ce8f74
14122024-05-20T20:43:04.598ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_917418e2-81ce-4591-8db5-632c4bd582f5") failed: Property not found. retry in 730.33768ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_917418e2-81ce-4591-8db5-632c4bd582f5
14132024-05-20T20:43:04.690ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2f0b1227-85e6-4def-9a56-3028cc1a9e6b") failed: Property not found. retry in 636.166288ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2f0b1227-85e6-4def-9a56-3028cc1a9e6b
14142024-05-20T20:43:04.721ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3f6e3246-067c-4284-96f0-5c240c8d574f") failed: Property not found. retry in 565.058434ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3f6e3246-067c-4284-96f0-5c240c8d574f
14152024-05-20T20:43:04.728ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9d0d72ea-cc41-4566-a012-82f5edda1c26") failed: Property not found. retry in 1.230236923s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9d0d72ea-cc41-4566-a012-82f5edda1c26
14162024-05-20T20:43:04.748ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dde34b1a-6b49-4e8c-b9a4-a6feddc5a27e") failed: Property not found. retry in 621.231995ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dde34b1a-6b49-4e8c-b9a4-a6feddc5a27e
14172024-05-20T20:43:04.765ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c0fd353f-5a49-444e-bc05-f198e4716be9") failed: Property not found. retry in 1.045939741s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c0fd353f-5a49-444e-bc05-f198e4716be9
14182024-05-20T20:43:04.921ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_17d00716-dd0a-4d24-ab6e-9a5cb155744b") failed: Property not found. retry in 1.319732056s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_17d00716-dd0a-4d24-ab6e-9a5cb155744b
14192024-05-20T20:43:04.978ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_00a5b8be-3547-4e9c-a8ff-18e0e241f74a") failed: Property not found. retry in 972.21892ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_00a5b8be-3547-4e9c-a8ff-18e0e241f74a
14202024-05-20T20:43:05.049ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_baf5303b-2c5b-4e5f-aa55-2481f975633b") failed: Property not found. retry in 543.795334ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_baf5303b-2c5b-4e5f-aa55-2481f975633b
14212024-05-20T20:43:05.126ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6ea6981d-af75-4034-ab13-1ff89fb41fe0") failed: Property not found. retry in 1.17006631s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6ea6981d-af75-4034-ab13-1ff89fb41fe0
14222024-05-20T20:43:05.178ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6b7319ee-db54-4949-bb6e-3910882850a6") failed: Property not found. retry in 1.467975339s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6b7319ee-db54-4949-bb6e-3910882850a6
14232024-05-20T20:43:05.266ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb9ca965-4ea9-4346-a9e2-23efb7ce8f74") failed: Property not found. retry in 737.803231ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb9ca965-4ea9-4346-a9e2-23efb7ce8f74
14242024-05-20T20:43:05.294ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3f6e3246-067c-4284-96f0-5c240c8d574f") failed: Property not found. retry in 665.775156ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3f6e3246-067c-4284-96f0-5c240c8d574f
14252024-05-20T20:43:05.335ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2f0b1227-85e6-4def-9a56-3028cc1a9e6b") failed: Property not found. retry in 944.043605ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2f0b1227-85e6-4def-9a56-3028cc1a9e6b
14262024-05-20T20:43:05.342ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_917418e2-81ce-4591-8db5-632c4bd582f5") failed: Property not found. retry in 1.260908544s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_917418e2-81ce-4591-8db5-632c4bd582f5
14272024-05-20T20:43:05.379ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dde34b1a-6b49-4e8c-b9a4-a6feddc5a27e") failed: Property not found. retry in 734.823431ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dde34b1a-6b49-4e8c-b9a4-a6feddc5a27e
14282024-05-20T20:43:05.415ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6f643d6c-2570-4985-a55f-74539d274616") failed: Property not found. retry in 692.332344ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6f643d6c-2570-4985-a55f-74539d274616
14292024-05-20T20:43:05.423ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_1722682a-0a76-447a-b2fd-ed2d5eb1e165") failed: Property not found. retry in 990.303707ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_1722682a-0a76-447a-b2fd-ed2d5eb1e165
14302024-05-20T20:43:05.435ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_14030859-ed0f-47ae-9477-941c8fd9b402") failed: Property not found. retry in 950.434478ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_14030859-ed0f-47ae-9477-941c8fd9b402
14312024-05-20T20:43:05.601ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_baf5303b-2c5b-4e5f-aa55-2481f975633b") failed: Property not found. retry in 832.363999ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_baf5303b-2c5b-4e5f-aa55-2481f975633b
14322024-05-20T20:43:05.690ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e84f7596-a85d-4c73-b3d4-f0329d444614") failed: Property not found. retry in 1.139942367s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e84f7596-a85d-4c73-b3d4-f0329d444614
14332024-05-20T20:43:05.767ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4e563445-4d41-489d-ba9b-67ee7c445814") failed: Property not found. retry in 700.257669ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4e563445-4d41-489d-ba9b-67ee7c445814
14342024-05-20T20:43:05.820ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c0fd353f-5a49-444e-bc05-f198e4716be9") failed: Property not found. retry in 697.260843ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c0fd353f-5a49-444e-bc05-f198e4716be9
14352024-05-20T20:43:05.839ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eac960af-0b57-4d85-a12d-2817f002da93") failed: Property not found. retry in 1.202757019s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eac960af-0b57-4d85-a12d-2817f002da93
14362024-05-20T20:43:05.883ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7d929bd2-96bc-4806-b33d-98add78507f8") failed: Property not found. retry in 557.519868ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7d929bd2-96bc-4806-b33d-98add78507f8
14372024-05-20T20:43:05.959ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_00a5b8be-3547-4e9c-a8ff-18e0e241f74a") failed: Property not found. retry in 1.470119056s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_00a5b8be-3547-4e9c-a8ff-18e0e241f74a
14382024-05-20T20:43:05.967ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9d0d72ea-cc41-4566-a012-82f5edda1c26") failed: Property not found. retry in 1.458611548s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9d0d72ea-cc41-4566-a012-82f5edda1c26
14392024-05-20T20:43:05.975ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3f6e3246-067c-4284-96f0-5c240c8d574f") failed: Property not found. retry in 1.443489821s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3f6e3246-067c-4284-96f0-5c240c8d574f
14402024-05-20T20:43:06.013ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb9ca965-4ea9-4346-a9e2-23efb7ce8f74") failed: Property not found. retry in 1.494696002s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb9ca965-4ea9-4346-a9e2-23efb7ce8f74
14412024-05-20T20:43:06.116ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6f643d6c-2570-4985-a55f-74539d274616") failed: Property not found. retry in 1.490908528s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6f643d6c-2570-4985-a55f-74539d274616
14422024-05-20T20:43:06.124ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dde34b1a-6b49-4e8c-b9a4-a6feddc5a27e") failed: Property not found. retry in 1.323050158s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dde34b1a-6b49-4e8c-b9a4-a6feddc5a27e
14432024-05-20T20:43:06.251ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_17d00716-dd0a-4d24-ab6e-9a5cb155744b") failed: Property not found. retry in 1.248460262s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_17d00716-dd0a-4d24-ab6e-9a5cb155744b
14442024-05-20T20:43:06.289ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2f0b1227-85e6-4def-9a56-3028cc1a9e6b") failed: Property not found. retry in 957.803612ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2f0b1227-85e6-4def-9a56-3028cc1a9e6b
14452024-05-20T20:43:06.305ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6ea6981d-af75-4034-ab13-1ff89fb41fe0") failed: Property not found. retry in 1.424158622s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6ea6981d-af75-4034-ab13-1ff89fb41fe0
14462024-05-20T20:43:06.395ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_14030859-ed0f-47ae-9477-941c8fd9b402") failed: Property not found. retry in 1.064306426s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_14030859-ed0f-47ae-9477-941c8fd9b402
14472024-05-20T20:43:06.422ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_1722682a-0a76-447a-b2fd-ed2d5eb1e165") failed: Property not found. retry in 1.422176737s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_1722682a-0a76-447a-b2fd-ed2d5eb1e165
14482024-05-20T20:43:06.442ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_baf5303b-2c5b-4e5f-aa55-2481f975633b") failed: Property not found. retry in 920.09504ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_baf5303b-2c5b-4e5f-aa55-2481f975633b
14492024-05-20T20:43:06.449ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7d929bd2-96bc-4806-b33d-98add78507f8") failed: Property not found. retry in 1.270476247s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7d929bd2-96bc-4806-b33d-98add78507f8
14502024-05-20T20:43:06.476ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4e563445-4d41-489d-ba9b-67ee7c445814") failed: Property not found. retry in 899.968576ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4e563445-4d41-489d-ba9b-67ee7c445814
14512024-05-20T20:43:06.526ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c0fd353f-5a49-444e-bc05-f198e4716be9") failed: Property not found. retry in 943.905892ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c0fd353f-5a49-444e-bc05-f198e4716be9
14522024-05-20T20:43:06.612ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_917418e2-81ce-4591-8db5-632c4bd582f5") failed: Property not found. retry in 1.458004467s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_917418e2-81ce-4591-8db5-632c4bd582f5
14532024-05-20T20:43:06.653ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6b7319ee-db54-4949-bb6e-3910882850a6") failed: Property not found. retry in 756.505694ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6b7319ee-db54-4949-bb6e-3910882850a6
14542024-05-20T20:43:06.837ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e84f7596-a85d-4c73-b3d4-f0329d444614") failed: Property not found. retry in 1.27921871s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e84f7596-a85d-4c73-b3d4-f0329d444614
14552024-05-20T20:43:07.051ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eac960af-0b57-4d85-a12d-2817f002da93") failed: Property not found. retry in 1.398986988s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eac960af-0b57-4d85-a12d-2817f002da93
14562024-05-20T20:43:07.260ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2f0b1227-85e6-4def-9a56-3028cc1a9e6b") failed: Property not found. retry in 1.463692082s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2f0b1227-85e6-4def-9a56-3028cc1a9e6b
14572024-05-20T20:43:07.372ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_baf5303b-2c5b-4e5f-aa55-2481f975633b") failed: Property not found. retry in 826.266049ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_baf5303b-2c5b-4e5f-aa55-2481f975633b
14582024-05-20T20:43:07.386ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4e563445-4d41-489d-ba9b-67ee7c445814") failed: Property not found. retry in 1.409784481s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4e563445-4d41-489d-ba9b-67ee7c445814
14592024-05-20T20:43:07.419ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6b7319ee-db54-4949-bb6e-3910882850a6") failed: Property not found. retry in 1.032060535s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6b7319ee-db54-4949-bb6e-3910882850a6
14602024-05-20T20:43:07.427ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3f6e3246-067c-4284-96f0-5c240c8d574f") failed: Property not found. retry in 628.622746ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3f6e3246-067c-4284-96f0-5c240c8d574f
14612024-05-20T20:43:07.434ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9d0d72ea-cc41-4566-a012-82f5edda1c26") failed: Property not found. retry in 1.256375964s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9d0d72ea-cc41-4566-a012-82f5edda1c26
14622024-05-20T20:43:07.441ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_00a5b8be-3547-4e9c-a8ff-18e0e241f74a") failed: Property not found. retry in 1.499806788s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_00a5b8be-3547-4e9c-a8ff-18e0e241f74a
14632024-05-20T20:43:07.455ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dde34b1a-6b49-4e8c-b9a4-a6feddc5a27e") failed: Property not found. retry in 1.409780976s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dde34b1a-6b49-4e8c-b9a4-a6feddc5a27e
14642024-05-20T20:43:07.468ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_14030859-ed0f-47ae-9477-941c8fd9b402") failed: Property not found. retry in 1.021165618s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_14030859-ed0f-47ae-9477-941c8fd9b402
14652024-05-20T20:43:07.478ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c0fd353f-5a49-444e-bc05-f198e4716be9") failed: Property not found. retry in 766.168523ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c0fd353f-5a49-444e-bc05-f198e4716be9
14662024-05-20T20:43:07.508ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_17d00716-dd0a-4d24-ab6e-9a5cb155744b") failed: Property not found. retry in 948.995975ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_17d00716-dd0a-4d24-ab6e-9a5cb155744b
14672024-05-20T20:43:07.516ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb9ca965-4ea9-4346-a9e2-23efb7ce8f74") failed: Property not found. retry in 1.027787097s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb9ca965-4ea9-4346-a9e2-23efb7ce8f74
14682024-05-20T20:43:07.615ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6f643d6c-2570-4985-a55f-74539d274616") failed: Property not found. retry in 815.712714ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6f643d6c-2570-4985-a55f-74539d274616
14692024-05-20T20:43:07.729ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7d929bd2-96bc-4806-b33d-98add78507f8") failed: Property not found. retry in 733.984905ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7d929bd2-96bc-4806-b33d-98add78507f8
14702024-05-20T20:43:07.739ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6ea6981d-af75-4034-ab13-1ff89fb41fe0") failed: Property not found. retry in 911.002341ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6ea6981d-af75-4034-ab13-1ff89fb41fe0
14712024-05-20T20:43:07.853ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_1722682a-0a76-447a-b2fd-ed2d5eb1e165") failed: Property not found. retry in 817.524939ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_1722682a-0a76-447a-b2fd-ed2d5eb1e165
14722024-05-20T20:43:08.065ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3f6e3246-067c-4284-96f0-5c240c8d574f") failed: Property not found. retry in 1.093833329s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3f6e3246-067c-4284-96f0-5c240c8d574f
14732024-05-20T20:43:08.078ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_917418e2-81ce-4591-8db5-632c4bd582f5") failed: Property not found. retry in 620.016632ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_917418e2-81ce-4591-8db5-632c4bd582f5
14742024-05-20T20:43:08.126ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e84f7596-a85d-4c73-b3d4-f0329d444614") failed: Property not found. retry in 698.557984ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e84f7596-a85d-4c73-b3d4-f0329d444614
14752024-05-20T20:43:08.210ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_baf5303b-2c5b-4e5f-aa55-2481f975633b") failed: Property not found. retry in 590.228327ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_baf5303b-2c5b-4e5f-aa55-2481f975633b
14762024-05-20T20:43:08.254ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c0fd353f-5a49-444e-bc05-f198e4716be9") failed: Property not found. retry in 1.176009267s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c0fd353f-5a49-444e-bc05-f198e4716be9
14772024-05-20T20:43:08.441ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6f643d6c-2570-4985-a55f-74539d274616") failed: Property not found. retry in 1.036072595s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6f643d6c-2570-4985-a55f-74539d274616
14782024-05-20T20:43:08.459ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eac960af-0b57-4d85-a12d-2817f002da93") failed: Property not found. retry in 713.191278ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eac960af-0b57-4d85-a12d-2817f002da93
14792024-05-20T20:43:08.467ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6b7319ee-db54-4949-bb6e-3910882850a6") failed: Property not found. retry in 1.335151103s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6b7319ee-db54-4949-bb6e-3910882850a6
14802024-05-20T20:43:08.477ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7d929bd2-96bc-4806-b33d-98add78507f8") failed: Property not found. retry in 841.788945ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7d929bd2-96bc-4806-b33d-98add78507f8
14812024-05-20T20:43:08.486ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_17d00716-dd0a-4d24-ab6e-9a5cb155744b") failed: Property not found. retry in 765.139986ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_17d00716-dd0a-4d24-ab6e-9a5cb155744b
14822024-05-20T20:43:08.498ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_14030859-ed0f-47ae-9477-941c8fd9b402") failed: Property not found. retry in 851.239061ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_14030859-ed0f-47ae-9477-941c8fd9b402
14832024-05-20T20:43:08.553ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb9ca965-4ea9-4346-a9e2-23efb7ce8f74") failed: Property not found. retry in 1.157527609s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb9ca965-4ea9-4346-a9e2-23efb7ce8f74
14842024-05-20T20:43:08.659ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6ea6981d-af75-4034-ab13-1ff89fb41fe0") failed: Property not found. retry in 657.259563ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6ea6981d-af75-4034-ab13-1ff89fb41fe0
14852024-05-20T20:43:08.679ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_1722682a-0a76-447a-b2fd-ed2d5eb1e165") failed: Property not found. retry in 565.897487ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_1722682a-0a76-447a-b2fd-ed2d5eb1e165
14862024-05-20T20:43:08.700ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9d0d72ea-cc41-4566-a012-82f5edda1c26") failed: Property not found. retry in 1.479541615s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9d0d72ea-cc41-4566-a012-82f5edda1c26
14872024-05-20T20:43:08.708ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_917418e2-81ce-4591-8db5-632c4bd582f5") failed: Property not found. retry in 1.486272788s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_917418e2-81ce-4591-8db5-632c4bd582f5
14882024-05-20T20:43:08.734ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2f0b1227-85e6-4def-9a56-3028cc1a9e6b") failed: Property not found. retry in 1.305842147s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2f0b1227-85e6-4def-9a56-3028cc1a9e6b
14892024-05-20T20:43:08.806ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4e563445-4d41-489d-ba9b-67ee7c445814") failed: Property not found. retry in 1.425360418s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4e563445-4d41-489d-ba9b-67ee7c445814
14902024-05-20T20:43:08.816ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_baf5303b-2c5b-4e5f-aa55-2481f975633b") failed: Property not found. retry in 981.626391ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_baf5303b-2c5b-4e5f-aa55-2481f975633b
14912024-05-20T20:43:08.835ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e84f7596-a85d-4c73-b3d4-f0329d444614") failed: Property not found. retry in 1.309521302s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e84f7596-a85d-4c73-b3d4-f0329d444614
14922024-05-20T20:43:08.876ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dde34b1a-6b49-4e8c-b9a4-a6feddc5a27e") failed: Property not found. retry in 541.75471ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dde34b1a-6b49-4e8c-b9a4-a6feddc5a27e
14932024-05-20T20:43:08.951ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_00a5b8be-3547-4e9c-a8ff-18e0e241f74a") failed: Property not found. retry in 606.151075ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_00a5b8be-3547-4e9c-a8ff-18e0e241f74a
14942024-05-20T20:43:09.170ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3f6e3246-067c-4284-96f0-5c240c8d574f") failed: Property not found. retry in 903.144698ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3f6e3246-067c-4284-96f0-5c240c8d574f
14952024-05-20T20:43:09.181ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eac960af-0b57-4d85-a12d-2817f002da93") failed: Property not found. retry in 982.247138ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eac960af-0b57-4d85-a12d-2817f002da93
14962024-05-20T20:43:09.254ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_1722682a-0a76-447a-b2fd-ed2d5eb1e165") failed: Property not found. retry in 1.0863366s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_1722682a-0a76-447a-b2fd-ed2d5eb1e165
14972024-05-20T20:43:09.262ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_17d00716-dd0a-4d24-ab6e-9a5cb155744b") failed: Property not found. retry in 1.036190532s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_17d00716-dd0a-4d24-ab6e-9a5cb155744b
14982024-05-20T20:43:09.326ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6ea6981d-af75-4034-ab13-1ff89fb41fe0") failed: Property not found. retry in 534.652991ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6ea6981d-af75-4034-ab13-1ff89fb41fe0
14992024-05-20T20:43:09.334ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7d929bd2-96bc-4806-b33d-98add78507f8") failed: Property not found. retry in 1.055785994s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7d929bd2-96bc-4806-b33d-98add78507f8
15002024-05-20T20:43:09.359ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_14030859-ed0f-47ae-9477-941c8fd9b402") failed: Property not found. retry in 1.210993047s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_14030859-ed0f-47ae-9477-941c8fd9b402
15012024-05-20T20:43:09.427ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dde34b1a-6b49-4e8c-b9a4-a6feddc5a27e") failed: Property not found. retry in 1.360871169s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dde34b1a-6b49-4e8c-b9a4-a6feddc5a27e
15022024-05-20T20:43:09.439ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c0fd353f-5a49-444e-bc05-f198e4716be9") failed: Property not found. retry in 1.114364707s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c0fd353f-5a49-444e-bc05-f198e4716be9
15032024-05-20T20:43:09.488ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6f643d6c-2570-4985-a55f-74539d274616") failed: Property not found. retry in 770.810112ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6f643d6c-2570-4985-a55f-74539d274616
15042024-05-20T20:43:09.570ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_00a5b8be-3547-4e9c-a8ff-18e0e241f74a") failed: Property not found. retry in 1.055614575s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_00a5b8be-3547-4e9c-a8ff-18e0e241f74a
15052024-05-20T20:43:09.689ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 53.982765162s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:417 sled_id = 082c2565-a0d4-4ca8-a689-9276c9a9c8af
15062024-05-20T20:43:09.723ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb9ca965-4ea9-4346-a9e2-23efb7ce8f74") failed: Property not found. retry in 1.147080158s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb9ca965-4ea9-4346-a9e2-23efb7ce8f74
15072024-05-20T20:43:09.810ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_baf5303b-2c5b-4e5f-aa55-2481f975633b") failed: Property not found. retry in 698.074244ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_baf5303b-2c5b-4e5f-aa55-2481f975633b
15082024-05-20T20:43:09.820ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6b7319ee-db54-4949-bb6e-3910882850a6") failed: Property not found. retry in 764.494135ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6b7319ee-db54-4949-bb6e-3910882850a6
15092024-05-20T20:43:09.872ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6ea6981d-af75-4034-ab13-1ff89fb41fe0") failed: Property not found. retry in 1.094279266s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6ea6981d-af75-4034-ab13-1ff89fb41fe0
15102024-05-20T20:43:10.052ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2f0b1227-85e6-4def-9a56-3028cc1a9e6b") failed: Property not found. retry in 619.795937ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2f0b1227-85e6-4def-9a56-3028cc1a9e6b
15112024-05-20T20:43:10.085ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3f6e3246-067c-4284-96f0-5c240c8d574f") failed: Property not found. retry in 1.249173688s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3f6e3246-067c-4284-96f0-5c240c8d574f
15122024-05-20T20:43:10.159ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e84f7596-a85d-4c73-b3d4-f0329d444614") failed: Property not found. retry in 778.221882ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e84f7596-a85d-4c73-b3d4-f0329d444614
15132024-05-20T20:43:10.175ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eac960af-0b57-4d85-a12d-2817f002da93") failed: Property not found. retry in 1.467240916s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eac960af-0b57-4d85-a12d-2817f002da93
15142024-05-20T20:43:10.192ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9d0d72ea-cc41-4566-a012-82f5edda1c26") failed: Property not found. retry in 879.735252ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9d0d72ea-cc41-4566-a012-82f5edda1c26
15152024-05-20T20:43:10.205ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_917418e2-81ce-4591-8db5-632c4bd582f5") failed: Property not found. retry in 746.606274ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_917418e2-81ce-4591-8db5-632c4bd582f5
15162024-05-20T20:43:10.243ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4e563445-4d41-489d-ba9b-67ee7c445814") failed: Property not found. retry in 533.585624ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4e563445-4d41-489d-ba9b-67ee7c445814
15172024-05-20T20:43:10.272ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6f643d6c-2570-4985-a55f-74539d274616") failed: Property not found. retry in 1.180721146s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6f643d6c-2570-4985-a55f-74539d274616
15182024-05-20T20:43:10.311ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_17d00716-dd0a-4d24-ab6e-9a5cb155744b") failed: Property not found. retry in 621.173603ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_17d00716-dd0a-4d24-ab6e-9a5cb155744b
15192024-05-20T20:43:10.355ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_1722682a-0a76-447a-b2fd-ed2d5eb1e165") failed: Property not found. retry in 1.382072363s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_1722682a-0a76-447a-b2fd-ed2d5eb1e165
15202024-05-20T20:43:10.400ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7d929bd2-96bc-4806-b33d-98add78507f8") failed: Property not found. retry in 1.32322537s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7d929bd2-96bc-4806-b33d-98add78507f8
15212024-05-20T20:43:10.520ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_baf5303b-2c5b-4e5f-aa55-2481f975633b") failed: Property not found. retry in 900.455364ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_baf5303b-2c5b-4e5f-aa55-2481f975633b
15222024-05-20T20:43:10.564ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c0fd353f-5a49-444e-bc05-f198e4716be9") failed: Property not found. retry in 705.782812ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c0fd353f-5a49-444e-bc05-f198e4716be9
15232024-05-20T20:43:10.582ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_14030859-ed0f-47ae-9477-941c8fd9b402") failed: Property not found. retry in 1.454866925s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_14030859-ed0f-47ae-9477-941c8fd9b402
15242024-05-20T20:43:10.594ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6b7319ee-db54-4949-bb6e-3910882850a6") failed: Property not found. retry in 1.011269486s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6b7319ee-db54-4949-bb6e-3910882850a6
15252024-05-20T20:43:10.638ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_00a5b8be-3547-4e9c-a8ff-18e0e241f74a") failed: Property not found. retry in 899.632435ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_00a5b8be-3547-4e9c-a8ff-18e0e241f74a
15262024-05-20T20:43:10.685ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2f0b1227-85e6-4def-9a56-3028cc1a9e6b") failed: Property not found. retry in 980.988057ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2f0b1227-85e6-4def-9a56-3028cc1a9e6b
15272024-05-20T20:43:10.791ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4e563445-4d41-489d-ba9b-67ee7c445814") failed: Property not found. retry in 1.415245822s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4e563445-4d41-489d-ba9b-67ee7c445814
15282024-05-20T20:43:10.804ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dde34b1a-6b49-4e8c-b9a4-a6feddc5a27e") failed: Property not found. retry in 1.111634423s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dde34b1a-6b49-4e8c-b9a4-a6feddc5a27e
15292024-05-20T20:43:10.881ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb9ca965-4ea9-4346-a9e2-23efb7ce8f74") failed: Property not found. retry in 858.951091ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb9ca965-4ea9-4346-a9e2-23efb7ce8f74
15302024-05-20T20:43:10.944ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_17d00716-dd0a-4d24-ab6e-9a5cb155744b") failed: Property not found. retry in 1.26291991s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_17d00716-dd0a-4d24-ab6e-9a5cb155744b
15312024-05-20T20:43:10.954ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e84f7596-a85d-4c73-b3d4-f0329d444614") failed: Property not found. retry in 1.391015113s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e84f7596-a85d-4c73-b3d4-f0329d444614
15322024-05-20T20:43:10.963ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_917418e2-81ce-4591-8db5-632c4bd582f5") failed: Property not found. retry in 1.090394134s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_917418e2-81ce-4591-8db5-632c4bd582f5
15332024-05-20T20:43:10.977ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6ea6981d-af75-4034-ab13-1ff89fb41fe0") failed: Property not found. retry in 574.38871ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6ea6981d-af75-4034-ab13-1ff89fb41fe0
15342024-05-20T20:43:11.011ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:35069
15352024-05-20T20:43:11.015ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 1469 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:35069 req_id = f8dc1588-8e21-400b-9ace-8abfeeb321c4 response_code = 200 uri = /baseboard
15362024-05-20T20:43:11.087ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9d0d72ea-cc41-4566-a012-82f5edda1c26") failed: Property not found. retry in 1.152323417s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9d0d72ea-cc41-4566-a012-82f5edda1c26
15372024-05-20T20:43:11.283ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c0fd353f-5a49-444e-bc05-f198e4716be9") failed: Property not found. retry in 633.859133ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c0fd353f-5a49-444e-bc05-f198e4716be9
15382024-05-20T20:43:11.348ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3f6e3246-067c-4284-96f0-5c240c8d574f") failed: Property not found. retry in 734.762877ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3f6e3246-067c-4284-96f0-5c240c8d574f
15392024-05-20T20:43:11.434ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_baf5303b-2c5b-4e5f-aa55-2481f975633b") failed: Property not found. retry in 999.215701ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_baf5303b-2c5b-4e5f-aa55-2481f975633b
15402024-05-20T20:43:11.474ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6f643d6c-2570-4985-a55f-74539d274616") failed: Property not found. retry in 589.193495ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6f643d6c-2570-4985-a55f-74539d274616
15412024-05-20T20:43:11.553ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_00a5b8be-3547-4e9c-a8ff-18e0e241f74a") failed: Property not found. retry in 1.352822526s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_00a5b8be-3547-4e9c-a8ff-18e0e241f74a
15422024-05-20T20:43:11.565ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6ea6981d-af75-4034-ab13-1ff89fb41fe0") failed: Property not found. retry in 971.326017ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6ea6981d-af75-4034-ab13-1ff89fb41fe0
15432024-05-20T20:43:11.619ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6b7319ee-db54-4949-bb6e-3910882850a6") failed: Property not found. retry in 698.90585ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6b7319ee-db54-4949-bb6e-3910882850a6
15442024-05-20T20:43:11.657ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eac960af-0b57-4d85-a12d-2817f002da93") failed: Property not found. retry in 887.921592ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eac960af-0b57-4d85-a12d-2817f002da93
15452024-05-20T20:43:11.678ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2f0b1227-85e6-4def-9a56-3028cc1a9e6b") failed: Property not found. retry in 631.485533ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2f0b1227-85e6-4def-9a56-3028cc1a9e6b
15462024-05-20T20:43:11.738ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7d929bd2-96bc-4806-b33d-98add78507f8") failed: Property not found. retry in 1.457324923s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7d929bd2-96bc-4806-b33d-98add78507f8
15472024-05-20T20:43:11.752ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_1722682a-0a76-447a-b2fd-ed2d5eb1e165") failed: Property not found. retry in 1.265405888s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_1722682a-0a76-447a-b2fd-ed2d5eb1e165
15482024-05-20T20:43:11.764ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb9ca965-4ea9-4346-a9e2-23efb7ce8f74") failed: Property not found. retry in 1.04909965s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb9ca965-4ea9-4346-a9e2-23efb7ce8f74
15492024-05-20T20:43:11.931ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dde34b1a-6b49-4e8c-b9a4-a6feddc5a27e") failed: Property not found. retry in 775.899372ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dde34b1a-6b49-4e8c-b9a4-a6feddc5a27e
15502024-05-20T20:43:11.945ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c0fd353f-5a49-444e-bc05-f198e4716be9") failed: Property not found. retry in 941.877908ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c0fd353f-5a49-444e-bc05-f198e4716be9
15512024-05-20T20:43:12.054ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_14030859-ed0f-47ae-9477-941c8fd9b402") failed: Property not found. retry in 840.707648ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_14030859-ed0f-47ae-9477-941c8fd9b402
15522024-05-20T20:43:12.068ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_917418e2-81ce-4591-8db5-632c4bd582f5") failed: Property not found. retry in 1.225130964s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_917418e2-81ce-4591-8db5-632c4bd582f5
15532024-05-20T20:43:12.080ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6f643d6c-2570-4985-a55f-74539d274616") failed: Property not found. retry in 1.349611918s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6f643d6c-2570-4985-a55f-74539d274616
15542024-05-20T20:43:12.094ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3f6e3246-067c-4284-96f0-5c240c8d574f") failed: Property not found. retry in 1.267884314s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3f6e3246-067c-4284-96f0-5c240c8d574f
15552024-05-20T20:43:12.227ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4e563445-4d41-489d-ba9b-67ee7c445814") failed: Property not found. retry in 1.219394935s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4e563445-4d41-489d-ba9b-67ee7c445814
15562024-05-20T20:43:12.238ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_17d00716-dd0a-4d24-ab6e-9a5cb155744b") failed: Property not found. retry in 560.503221ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_17d00716-dd0a-4d24-ab6e-9a5cb155744b
15572024-05-20T20:43:12.249ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9d0d72ea-cc41-4566-a012-82f5edda1c26") failed: Property not found. retry in 550.624205ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9d0d72ea-cc41-4566-a012-82f5edda1c26
15582024-05-20T20:43:12.320ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2f0b1227-85e6-4def-9a56-3028cc1a9e6b") failed: Property not found. retry in 1.299829333s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2f0b1227-85e6-4def-9a56-3028cc1a9e6b
15592024-05-20T20:43:12.329ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6b7319ee-db54-4949-bb6e-3910882850a6") failed: Property not found. retry in 1.232838353s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6b7319ee-db54-4949-bb6e-3910882850a6
15602024-05-20T20:43:12.356ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e84f7596-a85d-4c73-b3d4-f0329d444614") failed: Property not found. retry in 879.832549ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e84f7596-a85d-4c73-b3d4-f0329d444614
15612024-05-20T20:43:12.445ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_baf5303b-2c5b-4e5f-aa55-2481f975633b") failed: Property not found. retry in 1.368423071s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_baf5303b-2c5b-4e5f-aa55-2481f975633b
15622024-05-20T20:43:12.550ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6ea6981d-af75-4034-ab13-1ff89fb41fe0") failed: Property not found. retry in 1.049587899s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6ea6981d-af75-4034-ab13-1ff89fb41fe0
15632024-05-20T20:43:12.564ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eac960af-0b57-4d85-a12d-2817f002da93") failed: Property not found. retry in 1.238212246s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eac960af-0b57-4d85-a12d-2817f002da93
15642024-05-20T20:43:12.721ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dde34b1a-6b49-4e8c-b9a4-a6feddc5a27e") failed: Property not found. retry in 1.324873056s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dde34b1a-6b49-4e8c-b9a4-a6feddc5a27e
15652024-05-20T20:43:12.808ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_17d00716-dd0a-4d24-ab6e-9a5cb155744b") failed: Property not found. retry in 1.152378111s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_17d00716-dd0a-4d24-ab6e-9a5cb155744b
15662024-05-20T20:43:12.818ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9d0d72ea-cc41-4566-a012-82f5edda1c26") failed: Property not found. retry in 587.404885ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9d0d72ea-cc41-4566-a012-82f5edda1c26
15672024-05-20T20:43:12.830ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb9ca965-4ea9-4346-a9e2-23efb7ce8f74") failed: Property not found. retry in 1.169442529s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb9ca965-4ea9-4346-a9e2-23efb7ce8f74
15682024-05-20T20:43:12.898ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c0fd353f-5a49-444e-bc05-f198e4716be9") failed: Property not found. retry in 943.869652ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c0fd353f-5a49-444e-bc05-f198e4716be9
15692024-05-20T20:43:12.908ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_14030859-ed0f-47ae-9477-941c8fd9b402") failed: Property not found. retry in 1.063410874s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_14030859-ed0f-47ae-9477-941c8fd9b402
15702024-05-20T20:43:12.918ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_00a5b8be-3547-4e9c-a8ff-18e0e241f74a") failed: Property not found. retry in 717.404821ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_00a5b8be-3547-4e9c-a8ff-18e0e241f74a
15712024-05-20T20:43:13.030ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_1722682a-0a76-447a-b2fd-ed2d5eb1e165") failed: Property not found. retry in 1.223482242s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_1722682a-0a76-447a-b2fd-ed2d5eb1e165
15722024-05-20T20:43:13.208ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7d929bd2-96bc-4806-b33d-98add78507f8") failed: Property not found. retry in 687.871219ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7d929bd2-96bc-4806-b33d-98add78507f8
15732024-05-20T20:43:13.248ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e84f7596-a85d-4c73-b3d4-f0329d444614") failed: Property not found. retry in 1.436920611s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e84f7596-a85d-4c73-b3d4-f0329d444614
15742024-05-20T20:43:13.307ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_917418e2-81ce-4591-8db5-632c4bd582f5") failed: Property not found. retry in 592.618704ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_917418e2-81ce-4591-8db5-632c4bd582f5
15752024-05-20T20:43:13.375ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3f6e3246-067c-4284-96f0-5c240c8d574f") failed: Property not found. retry in 1.357588361s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3f6e3246-067c-4284-96f0-5c240c8d574f
15762024-05-20T20:43:13.422ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9d0d72ea-cc41-4566-a012-82f5edda1c26") failed: Property not found. retry in 815.748741ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9d0d72ea-cc41-4566-a012-82f5edda1c26
15772024-05-20T20:43:13.442ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6f643d6c-2570-4985-a55f-74539d274616") failed: Property not found. retry in 912.679015ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6f643d6c-2570-4985-a55f-74539d274616
15782024-05-20T20:43:13.633ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2f0b1227-85e6-4def-9a56-3028cc1a9e6b") failed: Property not found. retry in 1.377120195s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2f0b1227-85e6-4def-9a56-3028cc1a9e6b
15792024-05-20T20:43:13.648ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_00a5b8be-3547-4e9c-a8ff-18e0e241f74a") failed: Property not found. retry in 1.399330404s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_00a5b8be-3547-4e9c-a8ff-18e0e241f74a
15802024-05-20T20:43:13.815ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eac960af-0b57-4d85-a12d-2817f002da93") failed: Property not found. retry in 995.319197ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eac960af-0b57-4d85-a12d-2817f002da93
15812024-05-20T20:43:13.828ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_baf5303b-2c5b-4e5f-aa55-2481f975633b") failed: Property not found. retry in 1.317402229s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_baf5303b-2c5b-4e5f-aa55-2481f975633b
15822024-05-20T20:43:13.854ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c0fd353f-5a49-444e-bc05-f198e4716be9") failed: Property not found. retry in 508.630008ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c0fd353f-5a49-444e-bc05-f198e4716be9
15832024-05-20T20:43:13.912ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7d929bd2-96bc-4806-b33d-98add78507f8") failed: Property not found. retry in 621.459108ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7d929bd2-96bc-4806-b33d-98add78507f8
15842024-05-20T20:43:13.927ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_917418e2-81ce-4591-8db5-632c4bd582f5") failed: Property not found. retry in 1.27927913s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_917418e2-81ce-4591-8db5-632c4bd582f5
15852024-05-20T20:43:13.973ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_17d00716-dd0a-4d24-ab6e-9a5cb155744b") failed: Property not found. retry in 971.166186ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_17d00716-dd0a-4d24-ab6e-9a5cb155744b
15862024-05-20T20:43:13.987ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_14030859-ed0f-47ae-9477-941c8fd9b402") failed: Property not found. retry in 1.276721767s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_14030859-ed0f-47ae-9477-941c8fd9b402
15872024-05-20T20:43:14.058ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dde34b1a-6b49-4e8c-b9a4-a6feddc5a27e") failed: Property not found. retry in 1.420987341s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dde34b1a-6b49-4e8c-b9a4-a6feddc5a27e
15882024-05-20T20:43:14.250ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9d0d72ea-cc41-4566-a012-82f5edda1c26") failed: Property not found. retry in 1.421287441s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9d0d72ea-cc41-4566-a012-82f5edda1c26
15892024-05-20T20:43:14.266ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_1722682a-0a76-447a-b2fd-ed2d5eb1e165") failed: Property not found. retry in 570.444709ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_1722682a-0a76-447a-b2fd-ed2d5eb1e165
15902024-05-20T20:43:14.368ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6f643d6c-2570-4985-a55f-74539d274616") failed: Property not found. retry in 581.618802ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6f643d6c-2570-4985-a55f-74539d274616
15912024-05-20T20:43:14.381ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c0fd353f-5a49-444e-bc05-f198e4716be9") failed: Property not found. retry in 810.525287ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c0fd353f-5a49-444e-bc05-f198e4716be9
15922024-05-20T20:43:14.551ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7d929bd2-96bc-4806-b33d-98add78507f8") failed: Property not found. retry in 672.196276ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7d929bd2-96bc-4806-b33d-98add78507f8
15932024-05-20T20:43:14.746ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3f6e3246-067c-4284-96f0-5c240c8d574f") failed: Property not found. retry in 728.649892ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3f6e3246-067c-4284-96f0-5c240c8d574f
15942024-05-20T20:43:14.850ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_1722682a-0a76-447a-b2fd-ed2d5eb1e165") failed: Property not found. retry in 1.102552204s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_1722682a-0a76-447a-b2fd-ed2d5eb1e165
15952024-05-20T20:43:15.025ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2f0b1227-85e6-4def-9a56-3028cc1a9e6b") failed: Property not found. retry in 773.735791ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2f0b1227-85e6-4def-9a56-3028cc1a9e6b
15962024-05-20T20:43:15.061ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_00a5b8be-3547-4e9c-a8ff-18e0e241f74a") failed: Property not found. retry in 961.26197ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_00a5b8be-3547-4e9c-a8ff-18e0e241f74a
15972024-05-20T20:43:15.162ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_baf5303b-2c5b-4e5f-aa55-2481f975633b") failed: Property not found. retry in 673.189286ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_baf5303b-2c5b-4e5f-aa55-2481f975633b
15982024-05-20T20:43:15.207ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c0fd353f-5a49-444e-bc05-f198e4716be9") failed: Property not found. retry in 939.281624ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c0fd353f-5a49-444e-bc05-f198e4716be9
15992024-05-20T20:43:15.243ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7d929bd2-96bc-4806-b33d-98add78507f8") failed: Property not found. retry in 907.369327ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7d929bd2-96bc-4806-b33d-98add78507f8
16002024-05-20T20:43:15.278ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_14030859-ed0f-47ae-9477-941c8fd9b402") failed: Property not found. retry in 1.41892024s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_14030859-ed0f-47ae-9477-941c8fd9b402
16012024-05-20T20:43:15.687ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9d0d72ea-cc41-4566-a012-82f5edda1c26") failed: Property not found. retry in 731.331983ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9d0d72ea-cc41-4566-a012-82f5edda1c26
16022024-05-20T20:43:15.816ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2f0b1227-85e6-4def-9a56-3028cc1a9e6b") failed: Property not found. retry in 586.846643ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2f0b1227-85e6-4def-9a56-3028cc1a9e6b
16032024-05-20T20:43:15.852ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_baf5303b-2c5b-4e5f-aa55-2481f975633b") failed: Property not found. retry in 825.700425ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_baf5303b-2c5b-4e5f-aa55-2481f975633b
16042024-05-20T20:43:15.969ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_1722682a-0a76-447a-b2fd-ed2d5eb1e165") failed: Property not found. retry in 1.404754468s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_1722682a-0a76-447a-b2fd-ed2d5eb1e165
16052024-05-20T20:43:16.042ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_00a5b8be-3547-4e9c-a8ff-18e0e241f74a") failed: Property not found. retry in 791.063988ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_00a5b8be-3547-4e9c-a8ff-18e0e241f74a
16062024-05-20T20:43:16.418ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2f0b1227-85e6-4def-9a56-3028cc1a9e6b") failed: Property not found. retry in 1.353144034s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2f0b1227-85e6-4def-9a56-3028cc1a9e6b
16072024-05-20T20:43:16.432ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9d0d72ea-cc41-4566-a012-82f5edda1c26") failed: Property not found. retry in 577.862496ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9d0d72ea-cc41-4566-a012-82f5edda1c26
16082024-05-20T20:43:16.698ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_baf5303b-2c5b-4e5f-aa55-2481f975633b") failed: Property not found. retry in 1.187044559s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_baf5303b-2c5b-4e5f-aa55-2481f975633b
16092024-05-20T20:43:16.712ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_14030859-ed0f-47ae-9477-941c8fd9b402") failed: Property not found. retry in 1.116208395s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_14030859-ed0f-47ae-9477-941c8fd9b402
16102024-05-20T20:43:16.846ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_00a5b8be-3547-4e9c-a8ff-18e0e241f74a") failed: Property not found. retry in 1.441970963s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_00a5b8be-3547-4e9c-a8ff-18e0e241f74a
16112024-05-20T20:43:17.023ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9d0d72ea-cc41-4566-a012-82f5edda1c26") failed: Property not found. retry in 665.087664ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9d0d72ea-cc41-4566-a012-82f5edda1c26
16122024-05-20T20:43:17.782ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2f0b1227-85e6-4def-9a56-3028cc1a9e6b") failed: Property not found. retry in 744.758766ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2f0b1227-85e6-4def-9a56-3028cc1a9e6b
16132024-05-20T20:43:17.840ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_14030859-ed0f-47ae-9477-941c8fd9b402") failed: Property not found. retry in 1.020970664s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_14030859-ed0f-47ae-9477-941c8fd9b402
16142024-05-20T20:43:18.890ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_nexus_baf5303b-2c5b-4e5f-aa55-2481f975633b
16152024-05-20T20:43:18.891ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_oximeter_eac960af-0b57-4d85-a12d-2817f002da93
16162024-05-20T20:43:18.891ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_external_dns_9d0d72ea-cc41-4566-a012-82f5edda1c26
16172024-05-20T20:43:18.891ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_clickhouse_1722682a-0a76-447a-b2fd-ed2d5eb1e165
16182024-05-20T20:43:18.891ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_crucible_fb9ca965-4ea9-4346-a9e2-23efb7ce8f74
16192024-05-20T20:43:18.891ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_crucible_6ea6981d-af75-4034-ab13-1ff89fb41fe0
16202024-05-20T20:43:18.891ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_crucible_e84f7596-a85d-4c73-b3d4-f0329d444614
16212024-05-20T20:43:18.891ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_crucible_6b7319ee-db54-4949-bb6e-3910882850a6
16222024-05-20T20:43:18.891ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_crucible_7d929bd2-96bc-4806-b33d-98add78507f8
16232024-05-20T20:43:18.891ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_crucible_dde34b1a-6b49-4e8c-b9a4-a6feddc5a27e
16242024-05-20T20:43:18.891ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_crucible_pantry_17d00716-dd0a-4d24-ab6e-9a5cb155744b
16252024-05-20T20:43:18.891ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_crucible_pantry_c0fd353f-5a49-444e-bc05-f198e4716be9
16262024-05-20T20:43:18.891ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_nexus_14030859-ed0f-47ae-9477-941c8fd9b402
16272024-05-20T20:43:18.891ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_crucible_917418e2-81ce-4591-8db5-632c4bd582f5
16282024-05-20T20:43:18.891ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_crucible_pantry_6f643d6c-2570-4985-a55f-74539d274616
16292024-05-20T20:43:18.891ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_external_dns_00a5b8be-3547-4e9c-a8ff-18e0e241f74a
16302024-05-20T20:43:18.891ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_crucible_3f6e3246-067c-4284-96f0-5c240c8d574f
16312024-05-20T20:43:18.891ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_nexus_2f0b1227-85e6-4def-9a56-3028cc1a9e6b
16322024-05-20T20:43:18.891ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_crucible_4e563445-4d41-489d-ba9b-67ee7c445814
16332024-05-20T20:43:18.891ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/86226832-0042-47df-b114-06085792be9d/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
16342024-05-20T20:43:18.893ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/0cb7111d-dee5-4c65-91df-8aa68aeee77e/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
16352024-05-20T20:43:18.898ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 40434887 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:58986 req_id = f2bb34a4-61c5-49ae-bf07-5dfaf35ae9a1 response_code = 204 uri = /omicron-zones
16362024-05-20T20:43:18.911ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1236
16372024-05-20T20:43:18.911ZINFOSledAgent (RSS): Writing ledger to /pool/int/86226832-0042-47df-b114-06085792be9d/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
16382024-05-20T20:43:18.912ZINFOSledAgent (RSS): Writing ledger to /pool/int/0cb7111d-dee5-4c65-91df-8aa68aeee77e/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
16392024-05-20T20:43:18.916ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:680
16402024-05-20T20:43:18.921ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::b]:12221 file = sled-agent/src/rack_setup/service.rs:693
16412024-05-20T20:43:18.951ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV1 { bfd: [], bgp: [], infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV1 { addresses: [ V4( Ipv4Network { addr: 10.151.2.174, prefix: 24, }, ), ], autoneg: false, bgp_peers: [], port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Network { addr: 0.0.0.0, prefix: 0, }, ), nexthop: 10.151.2.100, vlan_id: None, }, ], switch: Switch0, uplink_port_fec: None, uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56, }, } file = sled-agent/src/rack_setup/service.rs:817
16422024-05-20T20:43:19.316ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/940f6265-ca66-4637-a62c-d9c129ad3367/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:879
16432024-05-20T20:43:19.458ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/940f6265-ca66-4637-a62c-d9c129ad3367/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:879
16442024-05-20T20:43:19.557ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/940f6265-ca66-4637-a62c-d9c129ad3367/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:879
16452024-05-20T20:43:19.693ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/940f6265-ca66-4637-a62c-d9c129ad3367/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:879
16462024-05-20T20:43:19.807ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/940f6265-ca66-4637-a62c-d9c129ad3367/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:879
16472024-05-20T20:43:20.107ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/940f6265-ca66-4637-a62c-d9c129ad3367/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:879
16482024-05-20T20:43:20.388ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/940f6265-ca66-4637-a62c-d9c129ad3367/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:879
16492024-05-20T20:43:20.441ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/082c2565-a0d4-4ca8-a689-9276c9a9c8af): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/probe_manager.rs:169 sled_id = 082c2565-a0d4-4ca8-a689-9276c9a9c8af
16502024-05-20T20:43:20.797ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/940f6265-ca66-4637-a62c-d9c129ad3367/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:879
16512024-05-20T20:43:20.980ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/940f6265-ca66-4637-a62c-d9c129ad3367/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:879
16522024-05-20T20:43:21.444ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/082c2565-a0d4-4ca8-a689-9276c9a9c8af): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/probe_manager.rs:169 sled_id = 082c2565-a0d4-4ca8-a689-9276c9a9c8af
16532024-05-20T20:43:21.470ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/082c2565-a0d4-4ca8-a689-9276c9a9c8af): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/nexus.rs:619 sled_id = 082c2565-a0d4-4ca8-a689-9276c9a9c8af
16542024-05-20T20:43:21.592ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/940f6265-ca66-4637-a62c-d9c129ad3367/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:879
16552024-05-20T20:43:21.949ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/940f6265-ca66-4637-a62c-d9c129ad3367/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:879
16562024-05-20T20:43:22.394ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/940f6265-ca66-4637-a62c-d9c129ad3367/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:879
16572024-05-20T20:43:22.448ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/082c2565-a0d4-4ca8-a689-9276c9a9c8af): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/probe_manager.rs:169 sled_id = 082c2565-a0d4-4ca8-a689-9276c9a9c8af
16582024-05-20T20:43:22.499ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/082c2565-a0d4-4ca8-a689-9276c9a9c8af): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/nexus.rs:619 sled_id = 082c2565-a0d4-4ca8-a689-9276c9a9c8af
16592024-05-20T20:43:23.111ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/940f6265-ca66-4637-a62c-d9c129ad3367/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:879
16602024-05-20T20:43:23.451ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/082c2565-a0d4-4ca8-a689-9276c9a9c8af): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/probe_manager.rs:169 sled_id = 082c2565-a0d4-4ca8-a689-9276c9a9c8af
16612024-05-20T20:43:23.764ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/940f6265-ca66-4637-a62c-d9c129ad3367/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:879
16622024-05-20T20:43:24.455ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/082c2565-a0d4-4ca8-a689-9276c9a9c8af): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/probe_manager.rs:169 sled_id = 082c2565-a0d4-4ca8-a689-9276c9a9c8af
16632024-05-20T20:43:24.500ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/082c2565-a0d4-4ca8-a689-9276c9a9c8af): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/nexus.rs:619 sled_id = 082c2565-a0d4-4ca8-a689-9276c9a9c8af
16642024-05-20T20:43:24.906ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/940f6265-ca66-4637-a62c-d9c129ad3367/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:879
16652024-05-20T20:43:25.458ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/082c2565-a0d4-4ca8-a689-9276c9a9c8af): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/probe_manager.rs:169 sled_id = 082c2565-a0d4-4ca8-a689-9276c9a9c8af
16662024-05-20T20:43:26.302ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/940f6265-ca66-4637-a62c-d9c129ad3367/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:879
16672024-05-20T20:43:26.461ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/082c2565-a0d4-4ca8-a689-9276c9a9c8af): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/probe_manager.rs:169 sled_id = 082c2565-a0d4-4ca8-a689-9276c9a9c8af
16682024-05-20T20:43:26.499ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/082c2565-a0d4-4ca8-a689-9276c9a9c8af): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/nexus.rs:619 sled_id = 082c2565-a0d4-4ca8-a689-9276c9a9c8af
16692024-05-20T20:43:27.463ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/082c2565-a0d4-4ca8-a689-9276c9a9c8af): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/probe_manager.rs:169 sled_id = 082c2565-a0d4-4ca8-a689-9276c9a9c8af
16702024-05-20T20:43:27.714ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/940f6265-ca66-4637-a62c-d9c129ad3367/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:879
16712024-05-20T20:43:29.850ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "0bdc3571-1f3f-4b07-a851-8d2c281a2dd4", "content-length": "173", "date": "Mon, 20 May 2024 20:43:29 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"082c2565-a0d4-4ca8-a689-9276c9a9c8af\"", request_id: "0bdc3571-1f3f-4b07-a851-8d2c281a2dd4" } file = sled-agent/src/rack_setup/service.rs:879
16722024-05-20T20:43:30.563ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:592 new_generation = 1 old_generation = 1 sled_id = 082c2565-a0d4-4ca8-a689-9276c9a9c8af
16732024-05-20T20:43:30.693ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58962
16742024-05-20T20:43:30.694ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
16752024-05-20T20:43:30.773ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 79716 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58962 req_id = 4d7397ef-4dd7-4ab1-9a63-1b30aac881be response_code = 200 uri = /inventory
16762024-05-20T20:43:30.774ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
16772024-05-20T20:43:30.774ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/86226832-0042-47df-b114-06085792be9d/config/omicron-zones.json file = common/src/ledger.rs:177
16782024-05-20T20:43:30.774ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/0cb7111d-dee5-4c65-91df-8aa68aeee77e/config/omicron-zones.json file = common/src/ledger.rs:177
16792024-05-20T20:43:30.775ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 1358 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58962 req_id = ac1409d2-da4a-4ab7-be45-9ea9380d9b22 response_code = 200 uri = /omicron-zones
16802024-05-20T20:43:32.476ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60760
16812024-05-20T20:43:32.480ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:525 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 981f5b38-f83e-40a7-9cf1-d0896f922726, kind: Service { id: 00a5b8be-3547-4e9c-a8ff-18e0e241f74a }, name: Name("external-dns-00a5b8be-3547-4e9c-a8ff-18e0e241f74a"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 162, 221])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.1.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: dfb110e8-e16f-4231-86dd-b23805b0877a, kind: Service { id: 9d0d72ea-cc41-4566-a012-82f5edda1c26 }, name: Name("external-dns-9d0d72ea-cc41-4566-a012-82f5edda1c26"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 207, 102])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.1.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1815df3d-95ec-4321-bea5-d3e0f5b97de4, kind: Service { id: 2f0b1227-85e6-4def-9a56-3028cc1a9e6b }, name: Name("nexus-2f0b1227-85e6-4def-9a56-3028cc1a9e6b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 226, 143])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 991eba9a-7b5f-4507-b76d-809d413181e4, kind: Service { id: 14030859-ed0f-47ae-9477-941c8fd9b402 }, name: Name("nexus-14030859-ed0f-47ae-9477-941c8fd9b402"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 157, 245])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: c941a686-cef2-46f1-998f-92fc74d8d410, kind: Service { id: baf5303b-2c5b-4e5f-aa55-2481f975633b }, name: Name("nexus-baf5303b-2c5b-4e5f-aa55-2481f975633b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 193, 155])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16822024-05-20T20:43:32.480ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16832024-05-20T20:43:32.480ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte0" rules = []
16842024-05-20T20:43:32.480ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16852024-05-20T20:43:32.480ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16862024-05-20T20:43:32.480ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16872024-05-20T20:43:32.480ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16882024-05-20T20:43:32.480ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 3718 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60760 req_id = 5ffc9853-247f-4c74-8f25-64fec8e17a0f response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16892024-05-20T20:43:32.482ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:889
16902024-05-20T20:43:32.688ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47322
16912024-05-20T20:43:32.688ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
16922024-05-20T20:43:32.766ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 78116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47322 req_id = 5397f57c-0f5a-4672-b7c8-b1d3bf01c86c response_code = 200 uri = /inventory
16932024-05-20T20:43:32.767ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
16942024-05-20T20:43:32.767ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/86226832-0042-47df-b114-06085792be9d/config/omicron-zones.json file = common/src/ledger.rs:177
16952024-05-20T20:43:32.767ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/0cb7111d-dee5-4c65-91df-8aa68aeee77e/config/omicron-zones.json file = common/src/ledger.rs:177
16962024-05-20T20:43:32.767ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 876 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47322 req_id = 062f2c86-f938-4c9c-b01b-791bc3d648b2 response_code = 200 uri = /omicron-zones
16972024-05-20T20:43:34.292ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55778
16982024-05-20T20:43:34.292ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:525 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 981f5b38-f83e-40a7-9cf1-d0896f922726, kind: Service { id: 00a5b8be-3547-4e9c-a8ff-18e0e241f74a }, name: Name("external-dns-00a5b8be-3547-4e9c-a8ff-18e0e241f74a"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 162, 221])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.1.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: dfb110e8-e16f-4231-86dd-b23805b0877a, kind: Service { id: 9d0d72ea-cc41-4566-a012-82f5edda1c26 }, name: Name("external-dns-9d0d72ea-cc41-4566-a012-82f5edda1c26"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 207, 102])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.1.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1815df3d-95ec-4321-bea5-d3e0f5b97de4, kind: Service { id: 2f0b1227-85e6-4def-9a56-3028cc1a9e6b }, name: Name("nexus-2f0b1227-85e6-4def-9a56-3028cc1a9e6b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 226, 143])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 991eba9a-7b5f-4507-b76d-809d413181e4, kind: Service { id: 14030859-ed0f-47ae-9477-941c8fd9b402 }, name: Name("nexus-14030859-ed0f-47ae-9477-941c8fd9b402"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 157, 245])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: c941a686-cef2-46f1-998f-92fc74d8d410, kind: Service { id: baf5303b-2c5b-4e5f-aa55-2481f975633b }, name: Name("nexus-baf5303b-2c5b-4e5f-aa55-2481f975633b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 193, 155])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16992024-05-20T20:43:34.292ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17002024-05-20T20:43:34.292ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte0" rules = []
17012024-05-20T20:43:34.292ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17022024-05-20T20:43:34.292ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17032024-05-20T20:43:34.292ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17042024-05-20T20:43:34.292ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17052024-05-20T20:43:34.292ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 320 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55778 req_id = ba99f651-5b46-4824-858e-2a80f570c3a7 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17062024-05-20T20:43:34.333ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52905
17072024-05-20T20:43:34.333ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:525 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 981f5b38-f83e-40a7-9cf1-d0896f922726, kind: Service { id: 00a5b8be-3547-4e9c-a8ff-18e0e241f74a }, name: Name("external-dns-00a5b8be-3547-4e9c-a8ff-18e0e241f74a"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 162, 221])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.1.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: dfb110e8-e16f-4231-86dd-b23805b0877a, kind: Service { id: 9d0d72ea-cc41-4566-a012-82f5edda1c26 }, name: Name("external-dns-9d0d72ea-cc41-4566-a012-82f5edda1c26"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 207, 102])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.1.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1815df3d-95ec-4321-bea5-d3e0f5b97de4, kind: Service { id: 2f0b1227-85e6-4def-9a56-3028cc1a9e6b }, name: Name("nexus-2f0b1227-85e6-4def-9a56-3028cc1a9e6b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 226, 143])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 991eba9a-7b5f-4507-b76d-809d413181e4, kind: Service { id: 14030859-ed0f-47ae-9477-941c8fd9b402 }, name: Name("nexus-14030859-ed0f-47ae-9477-941c8fd9b402"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 157, 245])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: c941a686-cef2-46f1-998f-92fc74d8d410, kind: Service { id: baf5303b-2c5b-4e5f-aa55-2481f975633b }, name: Name("nexus-baf5303b-2c5b-4e5f-aa55-2481f975633b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 193, 155])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17082024-05-20T20:43:34.333ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17092024-05-20T20:43:34.333ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte0" rules = []
17102024-05-20T20:43:34.333ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17112024-05-20T20:43:34.333ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17122024-05-20T20:43:34.333ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17132024-05-20T20:43:34.333ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17142024-05-20T20:43:34.333ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 298 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52905 req_id = f3fe21e2-99b2-4bd2-a745-9ea79fe99290 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17152024-05-20T20:43:34.335ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33554
17162024-05-20T20:43:34.335ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:525 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 981f5b38-f83e-40a7-9cf1-d0896f922726, kind: Service { id: 00a5b8be-3547-4e9c-a8ff-18e0e241f74a }, name: Name("external-dns-00a5b8be-3547-4e9c-a8ff-18e0e241f74a"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 162, 221])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.1.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: dfb110e8-e16f-4231-86dd-b23805b0877a, kind: Service { id: 9d0d72ea-cc41-4566-a012-82f5edda1c26 }, name: Name("external-dns-9d0d72ea-cc41-4566-a012-82f5edda1c26"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 207, 102])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.1.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1815df3d-95ec-4321-bea5-d3e0f5b97de4, kind: Service { id: 2f0b1227-85e6-4def-9a56-3028cc1a9e6b }, name: Name("nexus-2f0b1227-85e6-4def-9a56-3028cc1a9e6b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 226, 143])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 991eba9a-7b5f-4507-b76d-809d413181e4, kind: Service { id: 14030859-ed0f-47ae-9477-941c8fd9b402 }, name: Name("nexus-14030859-ed0f-47ae-9477-941c8fd9b402"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 157, 245])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: c941a686-cef2-46f1-998f-92fc74d8d410, kind: Service { id: baf5303b-2c5b-4e5f-aa55-2481f975633b }, name: Name("nexus-baf5303b-2c5b-4e5f-aa55-2481f975633b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 193, 155])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17172024-05-20T20:43:34.335ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17182024-05-20T20:43:34.335ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte0" rules = []
17192024-05-20T20:43:34.335ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17202024-05-20T20:43:34.335ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17212024-05-20T20:43:34.336ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17222024-05-20T20:43:34.336ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17232024-05-20T20:43:34.336ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 354 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33554 req_id = 4fe359fd-3a49-4510-93f4-06104e69f03a response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17242024-05-20T20:43:41.047ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:54837
17252024-05-20T20:43:41.047ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 87 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:54837 req_id = d790fc11-96e5-49cf-ade5-8487df762b5d response_code = 200 uri = /baseboard
17262024-05-20T20:43:58.308ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52527
17272024-05-20T20:43:58.396ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 87980 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:52527 req_id = 4596e586-ea9a-49d2-90d2-e1fe32ddac23 response_code = 204 uri = /switch-ports
17282024-05-20T20:43:58.396ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59815
17292024-05-20T20:43:58.396ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48070
17302024-05-20T20:43:58.400ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 4041 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52527 req_id = a8a8d8a7-3a55-46be-b041-47c24e8bd280 response_code = 200 uri = /network-bootstore-config
17312024-05-20T20:43:58.421ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
17322024-05-20T20:43:58.421ZINFOSledAgent (bootstore): Writing ledger to /pool/int/86226832-0042-47df-b114-06085792be9d/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
17332024-05-20T20:43:58.422ZINFOSledAgent (bootstore): Writing ledger to /pool/int/0cb7111d-dee5-4c65-91df-8aa68aeee77e/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
17342024-05-20T20:43:58.423ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
17352024-05-20T20:43:58.423ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 2747 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52527 req_id = c33e67e0-47b0-4a1a-a5df-d5a8f9390244 response_code = 204 uri = /network-bootstore-config
17362024-05-20T20:43:58.451ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 54762 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:59815 req_id = ad91d7ec-684a-4d0e-ae03-94297a74f5a6 response_code = 204 uri = /switch-ports
17372024-05-20T20:43:58.454ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 576 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59815 req_id = cb94a3e7-4cbe-4327-8470-a64a645fb1ad response_code = 200 uri = /network-bootstore-config
17382024-05-20T20:43:58.498ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 101869 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48070 req_id = fc80620d-1897-43b4-8484-5126562161bb response_code = 204 uri = /switch-ports
17392024-05-20T20:43:58.499ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48070 req_id = 9a3cf3ef-ed5d-4259-be0a-0094a1d15cf9 response_code = 200 uri = /network-bootstore-config
17402024-05-20T20:44:11.081ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:35157
17412024-05-20T20:44:11.081ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 85 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:35157 req_id = bc77f871-7f0d-4bb1-bc75-c28d07fce148 response_code = 200 uri = /baseboard
17422024-05-20T20:44:28.381ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
17432024-05-20T20:44:28.522ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59615
17442024-05-20T20:44:28.565ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 43373 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:59615 req_id = c31fc1d5-56e0-49f6-9095-4653f06b82a0 response_code = 204 uri = /switch-ports
17452024-05-20T20:44:28.565ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56692
17462024-05-20T20:44:28.610ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 44799 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:56692 req_id = 9110439a-b1f3-42d4-8709-f9c4ec12b615 response_code = 204 uri = /switch-ports
17472024-05-20T20:44:28.611ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59615 req_id = d1d50394-7ae0-4d4f-9e5f-11b600168a0c response_code = 200 uri = /network-bootstore-config
17482024-05-20T20:44:28.611ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56692 req_id = 24771641-58a3-4e49-9522-a6d0ef1bbf33 response_code = 200 uri = /network-bootstore-config
17492024-05-20T20:44:28.636ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53070
17502024-05-20T20:44:28.681ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 44590 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:53070 req_id = 46cb7da1-f1d4-4d35-8ddd-4606a527170b response_code = 204 uri = /switch-ports
17512024-05-20T20:44:28.681ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 178 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53070 req_id = feaccdd2-b280-405f-b823-05b4800fabad response_code = 200 uri = /network-bootstore-config
17522024-05-20T20:44:33.769ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:36587 remote_addr = [fd00:1122:3344:101::d]:36568 sled_id = 082c2565-a0d4-4ca8-a689-9276c9a9c8af
17532024-05-20T20:44:33.779ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 9610 local_addr = [fd00:1122:3344:101::1]:36587 method = GET remote_addr = [fd00:1122:3344:101::d]:36568 req_id = e5f91369-7d36-4ac8-aede-eeebd03e2bb5 response_code = 200 sled_id = 082c2565-a0d4-4ca8-a689-9276c9a9c8af uri = /082c2565-a0d4-4ca8-a689-9276c9a9c8af
17542024-05-20T20:44:41.127ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:37593
17552024-05-20T20:44:41.128ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 55 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:37593 req_id = 38da3a8b-5c00-4901-9b3d-10ec6f7d6199 response_code = 200 uri = /baseboard
17562024-05-20T20:44:58.256ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51847
17572024-05-20T20:44:58.300ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 44022 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:51847 req_id = 10824341-7c07-48b2-b897-3f027b858112 response_code = 204 uri = /switch-ports
17582024-05-20T20:44:58.300ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59738
17592024-05-20T20:44:58.301ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59708
17602024-05-20T20:44:58.301ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 324 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51847 req_id = e21f058c-d5dc-4677-adec-8e653dcdfc3c response_code = 200 uri = /network-bootstore-config
17612024-05-20T20:44:58.346ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 45714 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:59738 req_id = 343b64e7-0cbc-4d09-97d7-9903875c8e2f response_code = 204 uri = /switch-ports
17622024-05-20T20:44:58.350ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 660 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59738 req_id = a856f213-4f78-452f-a9f8-d6be7f19e74d response_code = 200 uri = /network-bootstore-config
17632024-05-20T20:44:58.389ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 88142 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:59708 req_id = e3040cd9-39a0-4e75-97cf-e58e5d7bc432 response_code = 204 uri = /switch-ports
17642024-05-20T20:44:58.389ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59708 req_id = 618f4dbd-1bc6-49ce-aa4e-0dfbeb7467a3 response_code = 200 uri = /network-bootstore-config
17652024-05-20T20:45:03.773ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 513 local_addr = [fd00:1122:3344:101::1]:36587 method = GET remote_addr = [fd00:1122:3344:101::d]:36568 req_id = 7db58a5d-b3ec-495b-b7d9-d602151406d6 response_code = 200 sled_id = 082c2565-a0d4-4ca8-a689-9276c9a9c8af uri = /082c2565-a0d4-4ca8-a689-9276c9a9c8af
17662024-05-20T20:45:11.161ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:60691
17672024-05-20T20:45:11.161ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 68 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:60691 req_id = bd4c0660-5f5f-42a0-bbd2-ebc06c771920 response_code = 200 uri = /baseboard
17682024-05-20T20:45:28.418ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52513
17692024-05-20T20:45:28.465ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 47285 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:52513 req_id = 9544f1ba-6920-4c8c-ae3e-06eec5377a7e response_code = 204 uri = /switch-ports
17702024-05-20T20:45:28.465ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52513 req_id = a9503ec7-8314-477e-baf1-e66f1925d618 response_code = 200 uri = /network-bootstore-config
17712024-05-20T20:45:28.579ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48558
17722024-05-20T20:45:28.627ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 47373 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48558 req_id = 3e27bc4b-8efa-48ed-927f-2194cbc18ad9 response_code = 204 uri = /switch-ports
17732024-05-20T20:45:28.627ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48558 req_id = 49d42f82-2c5f-4f1b-8365-e3e94e68bc6c response_code = 200 uri = /network-bootstore-config
17742024-05-20T20:45:28.631ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35054
17752024-05-20T20:45:28.677ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 45604 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:35054 req_id = cf1936dd-bee8-4d29-8378-0f124b9ea25c response_code = 204 uri = /switch-ports
17762024-05-20T20:45:28.677ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35054 req_id = 3c420ef7-d278-46f2-afea-94661691a778 response_code = 200 uri = /network-bootstore-config
17772024-05-20T20:45:33.769ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 506 local_addr = [fd00:1122:3344:101::1]:36587 method = GET remote_addr = [fd00:1122:3344:101::d]:36568 req_id = 4d5a6681-6376-4485-952c-3490feea68ba response_code = 200 sled_id = 082c2565-a0d4-4ca8-a689-9276c9a9c8af uri = /082c2565-a0d4-4ca8-a689-9276c9a9c8af
17782024-05-20T20:45:41.194ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:38682
17792024-05-20T20:45:41.195ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 585 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:38682 req_id = f7c25692-3117-417d-99fa-e0866aceab46 response_code = 200 uri = /baseboard
17802024-05-20T20:45:58.236ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49431
17812024-05-20T20:45:58.283ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 46512 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:49431 req_id = 5c169794-6e5d-46f4-b728-851c47645248 response_code = 204 uri = /switch-ports
17822024-05-20T20:45:58.283ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35094
17832024-05-20T20:45:58.287ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 3688 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49431 req_id = 93dd1f16-99b5-4492-9916-fba430cb231b response_code = 200 uri = /network-bootstore-config
17842024-05-20T20:45:58.317ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54154
17852024-05-20T20:45:58.328ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 44506 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:35094 req_id = 369358d0-fc16-45b4-9c5f-7b60ed9fb029 response_code = 204 uri = /switch-ports
17862024-05-20T20:45:58.332ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 673 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35094 req_id = 55abc8e9-6263-4b5c-b5e9-c105e07aed16 response_code = 200 uri = /network-bootstore-config
17872024-05-20T20:45:58.373ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 56399 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:54154 req_id = 502db4b3-0c49-4096-adf0-0b5949e7cd96 response_code = 204 uri = /switch-ports
17882024-05-20T20:45:58.374ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54154 req_id = b9696687-0119-4614-9910-9c8c28a6064a response_code = 200 uri = /network-bootstore-config
17892024-05-20T20:46:03.770ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 1015 local_addr = [fd00:1122:3344:101::1]:36587 method = GET remote_addr = [fd00:1122:3344:101::d]:36568 req_id = 90f685a3-13aa-4ece-87db-7ec8ad821b3b response_code = 200 sled_id = 082c2565-a0d4-4ca8-a689-9276c9a9c8af uri = /082c2565-a0d4-4ca8-a689-9276c9a9c8af
17902024-05-20T20:46:11.237ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:50719
17912024-05-20T20:46:11.237ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 109 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:50719 req_id = 51e63832-ade9-47b3-ac57-66d1b0442de5 response_code = 200 uri = /baseboard
17922024-05-20T20:46:28.412ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64464
17932024-05-20T20:46:28.458ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 45469 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:64464 req_id = 3c4e249e-65bd-4195-ab79-de125a1f982f response_code = 204 uri = /switch-ports
17942024-05-20T20:46:28.459ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 896 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64464 req_id = 29fcc670-1f84-4cb3-80f0-cd62e63bee80 response_code = 200 uri = /network-bootstore-config
17952024-05-20T20:46:28.508ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44447
17962024-05-20T20:46:28.553ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 45030 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:44447 req_id = 707eb297-a460-41b3-a8de-b4b1e6a0b895 response_code = 204 uri = /switch-ports
17972024-05-20T20:46:28.553ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63809
17982024-05-20T20:46:28.556ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 2790 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44447 req_id = 76a6361b-f202-4f85-a80f-c9b4b0b870ee response_code = 200 uri = /network-bootstore-config
17992024-05-20T20:46:28.595ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 41472 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:63809 req_id = 16c089a1-3c97-4810-a98e-6b43cd42a7dc response_code = 204 uri = /switch-ports
18002024-05-20T20:46:28.595ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 741 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63809 req_id = f81348ad-e230-4a37-9d29-ec182a5a5f55 response_code = 200 uri = /network-bootstore-config
18012024-05-20T20:46:33.779ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 394 local_addr = [fd00:1122:3344:101::1]:36587 method = GET remote_addr = [fd00:1122:3344:101::d]:36568 req_id = 3fb77572-107d-43fd-a040-97a30b6f29cc response_code = 200 sled_id = 082c2565-a0d4-4ca8-a689-9276c9a9c8af uri = /082c2565-a0d4-4ca8-a689-9276c9a9c8af
18022024-05-20T20:46:41.270ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:39296
18032024-05-20T20:46:41.270ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 114 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:39296 req_id = dec97879-890a-4bb1-9e32-450ab08a9e42 response_code = 200 uri = /baseboard
18042024-05-20T20:46:58.238ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57916
18052024-05-20T20:46:58.286ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 47924 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:57916 req_id = 43d1b2e9-3c78-4c8e-b6cb-eab2891d489d response_code = 204 uri = /switch-ports
18062024-05-20T20:46:58.286ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35592
18072024-05-20T20:46:58.289ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 3312 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57916 req_id = 2bc7e147-6ddd-4248-8321-4fad4e9e72e7 response_code = 200 uri = /network-bootstore-config
18082024-05-20T20:46:58.289ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46338
18092024-05-20T20:46:58.331ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 45430 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:35592 req_id = 29873a34-21b0-4fe7-bd58-384abc869f0f response_code = 204 uri = /switch-ports
18102024-05-20T20:46:58.335ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 650 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35592 req_id = df620a34-6d4e-431f-bab5-050bc08645b7 response_code = 200 uri = /network-bootstore-config
18112024-05-20T20:46:58.375ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 85297 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:46338 req_id = 02860345-5b1c-4f39-96f1-9c4b1cc793b4 response_code = 204 uri = /switch-ports
18122024-05-20T20:46:58.376ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 1024 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46338 req_id = 4d19f035-f061-4d68-a4af-13811068d418 response_code = 200 uri = /network-bootstore-config
18132024-05-20T20:47:03.818ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 803 local_addr = [fd00:1122:3344:101::1]:36587 method = GET remote_addr = [fd00:1122:3344:101::d]:36568 req_id = 6edf2bad-848d-4518-8776-1eabc56905e7 response_code = 200 sled_id = 082c2565-a0d4-4ca8-a689-9276c9a9c8af uri = /082c2565-a0d4-4ca8-a689-9276c9a9c8af
18142024-05-20T20:47:11.302ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:35929
18152024-05-20T20:47:11.303ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 89 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:35929 req_id = 3520d19a-5d54-40b6-8289-3973dddb877a response_code = 200 uri = /baseboard
18162024-05-20T20:47:28.383ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42274
18172024-05-20T20:47:28.427ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 43726 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:42274 req_id = 5c62309f-a7cc-44b0-a185-fc34ec2e8ed8 response_code = 204 uri = /switch-ports
18182024-05-20T20:47:28.427ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54947
18192024-05-20T20:47:28.470ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 42501 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:54947 req_id = 190664d1-0662-47f1-aa13-d624c5f785cc response_code = 204 uri = /switch-ports
18202024-05-20T20:47:28.470ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57407
18212024-05-20T20:47:28.470ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 252 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42274 req_id = a94f763f-dc2b-4298-b522-ae81b83ac0fd response_code = 200 uri = /network-bootstore-config
18222024-05-20T20:47:28.474ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 4189 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54947 req_id = d8810680-1097-4139-9bec-3b6cc484fca8 response_code = 200 uri = /network-bootstore-config
18232024-05-20T20:47:28.514ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 43872 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:57407 req_id = 7f999f5b-a36a-42f6-9277-eb993f2ab910 response_code = 204 uri = /switch-ports
18242024-05-20T20:47:28.514ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57407 req_id = 006b6707-eea6-42be-9b88-53c78d7649f3 response_code = 200 uri = /network-bootstore-config
18252024-05-20T20:47:33.819ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 491 local_addr = [fd00:1122:3344:101::1]:36587 method = GET remote_addr = [fd00:1122:3344:101::d]:36568 req_id = 7f26ec79-4b87-4cfe-941f-1263fe87aa2a response_code = 200 sled_id = 082c2565-a0d4-4ca8-a689-9276c9a9c8af uri = /082c2565-a0d4-4ca8-a689-9276c9a9c8af
18262024-05-20T20:47:41.336ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:51127
18272024-05-20T20:47:41.337ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 968 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:51127 req_id = c5f3c516-838b-4b42-81f7-ea1d8bbe42a2 response_code = 200 uri = /baseboard
18282024-05-20T20:47:58.237ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40769
18292024-05-20T20:47:58.237ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44444
18302024-05-20T20:47:58.280ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 43455 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:44444 req_id = 10c58d43-84fe-4734-8abc-941821d6a7dc response_code = 204 uri = /switch-ports
18312024-05-20T20:47:58.284ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 469 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44444 req_id = a8569a56-ee36-40b9-8309-f30929480e72 response_code = 200 uri = /network-bootstore-config
18322024-05-20T20:47:58.324ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 87000 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:40769 req_id = b3c2b4c4-e31e-4681-a037-e2be0eb0c6cd response_code = 204 uri = /switch-ports
18332024-05-20T20:47:58.324ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40769 req_id = cf654295-783d-4ffb-a0f6-0f3c7a76e8c8 response_code = 200 uri = /network-bootstore-config
18342024-05-20T20:47:58.334ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62910
18352024-05-20T20:47:58.377ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 42677 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:62910 req_id = 7e69b904-fb52-42af-bd1d-3d333c282cae response_code = 204 uri = /switch-ports
18362024-05-20T20:47:58.377ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62910 req_id = 9a1dec4e-c745-4644-a0aa-7977caa22fa5 response_code = 200 uri = /network-bootstore-config
18372024-05-20T20:48:03.819ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 574 local_addr = [fd00:1122:3344:101::1]:36587 method = GET remote_addr = [fd00:1122:3344:101::d]:36568 req_id = fba1fda0-64d2-451a-b05d-ec348ab648b1 response_code = 200 sled_id = 082c2565-a0d4-4ca8-a689-9276c9a9c8af uri = /082c2565-a0d4-4ca8-a689-9276c9a9c8af
18382024-05-20T20:48:11.368ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:56463
18392024-05-20T20:48:11.368ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 103 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:56463 req_id = 43acfd8e-daa8-4aa3-ab9f-f3ab2c200f71 response_code = 200 uri = /baseboard
18402024-05-20T20:48:28.346ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52895
18412024-05-20T20:48:28.347ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:525 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 981f5b38-f83e-40a7-9cf1-d0896f922726, kind: Service { id: 00a5b8be-3547-4e9c-a8ff-18e0e241f74a }, name: Name("external-dns-00a5b8be-3547-4e9c-a8ff-18e0e241f74a"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 162, 221])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.1.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: dfb110e8-e16f-4231-86dd-b23805b0877a, kind: Service { id: 9d0d72ea-cc41-4566-a012-82f5edda1c26 }, name: Name("external-dns-9d0d72ea-cc41-4566-a012-82f5edda1c26"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 207, 102])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.1.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1815df3d-95ec-4321-bea5-d3e0f5b97de4, kind: Service { id: 2f0b1227-85e6-4def-9a56-3028cc1a9e6b }, name: Name("nexus-2f0b1227-85e6-4def-9a56-3028cc1a9e6b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 226, 143])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 991eba9a-7b5f-4507-b76d-809d413181e4, kind: Service { id: 14030859-ed0f-47ae-9477-941c8fd9b402 }, name: Name("nexus-14030859-ed0f-47ae-9477-941c8fd9b402"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 157, 245])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: c941a686-cef2-46f1-998f-92fc74d8d410, kind: Service { id: baf5303b-2c5b-4e5f-aa55-2481f975633b }, name: Name("nexus-baf5303b-2c5b-4e5f-aa55-2481f975633b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 193, 155])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18422024-05-20T20:48:28.347ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18432024-05-20T20:48:28.347ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte0" rules = []
18442024-05-20T20:48:28.347ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18452024-05-20T20:48:28.347ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18462024-05-20T20:48:28.347ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18472024-05-20T20:48:28.347ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18482024-05-20T20:48:28.347ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 642 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52895 req_id = 0649258b-687e-4478-a7de-f82d5f56f3da response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18492024-05-20T20:48:28.442ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60154
18502024-05-20T20:48:28.442ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:525 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 981f5b38-f83e-40a7-9cf1-d0896f922726, kind: Service { id: 00a5b8be-3547-4e9c-a8ff-18e0e241f74a }, name: Name("external-dns-00a5b8be-3547-4e9c-a8ff-18e0e241f74a"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 162, 221])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.1.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: dfb110e8-e16f-4231-86dd-b23805b0877a, kind: Service { id: 9d0d72ea-cc41-4566-a012-82f5edda1c26 }, name: Name("external-dns-9d0d72ea-cc41-4566-a012-82f5edda1c26"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 207, 102])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.1.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1815df3d-95ec-4321-bea5-d3e0f5b97de4, kind: Service { id: 2f0b1227-85e6-4def-9a56-3028cc1a9e6b }, name: Name("nexus-2f0b1227-85e6-4def-9a56-3028cc1a9e6b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 226, 143])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 991eba9a-7b5f-4507-b76d-809d413181e4, kind: Service { id: 14030859-ed0f-47ae-9477-941c8fd9b402 }, name: Name("nexus-14030859-ed0f-47ae-9477-941c8fd9b402"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 157, 245])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: c941a686-cef2-46f1-998f-92fc74d8d410, kind: Service { id: baf5303b-2c5b-4e5f-aa55-2481f975633b }, name: Name("nexus-baf5303b-2c5b-4e5f-aa55-2481f975633b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 193, 155])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18512024-05-20T20:48:28.442ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18522024-05-20T20:48:28.442ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte0" rules = []
18532024-05-20T20:48:28.442ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18542024-05-20T20:48:28.442ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18552024-05-20T20:48:28.442ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18562024-05-20T20:48:28.442ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18572024-05-20T20:48:28.442ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 331 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60154 req_id = 2caa624e-b225-4a01-a63d-d0b9129d4295 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18582024-05-20T20:48:28.487ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46059
18592024-05-20T20:48:28.487ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:525 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 981f5b38-f83e-40a7-9cf1-d0896f922726, kind: Service { id: 00a5b8be-3547-4e9c-a8ff-18e0e241f74a }, name: Name("external-dns-00a5b8be-3547-4e9c-a8ff-18e0e241f74a"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 162, 221])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.1.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: dfb110e8-e16f-4231-86dd-b23805b0877a, kind: Service { id: 9d0d72ea-cc41-4566-a012-82f5edda1c26 }, name: Name("external-dns-9d0d72ea-cc41-4566-a012-82f5edda1c26"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 207, 102])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.1.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1815df3d-95ec-4321-bea5-d3e0f5b97de4, kind: Service { id: 2f0b1227-85e6-4def-9a56-3028cc1a9e6b }, name: Name("nexus-2f0b1227-85e6-4def-9a56-3028cc1a9e6b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 226, 143])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 991eba9a-7b5f-4507-b76d-809d413181e4, kind: Service { id: 14030859-ed0f-47ae-9477-941c8fd9b402 }, name: Name("nexus-14030859-ed0f-47ae-9477-941c8fd9b402"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 157, 245])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: c941a686-cef2-46f1-998f-92fc74d8d410, kind: Service { id: baf5303b-2c5b-4e5f-aa55-2481f975633b }, name: Name("nexus-baf5303b-2c5b-4e5f-aa55-2481f975633b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 193, 155])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18602024-05-20T20:48:28.487ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18612024-05-20T20:48:28.487ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte0" rules = []
18622024-05-20T20:48:28.487ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18632024-05-20T20:48:28.487ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18642024-05-20T20:48:28.487ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18652024-05-20T20:48:28.487ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18662024-05-20T20:48:28.487ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 189 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46059 req_id = e37fe9e6-9ece-4eb2-867f-eb829a791d3d response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18672024-05-20T20:48:28.518ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38955
18682024-05-20T20:48:28.563ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 45099 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:38955 req_id = 5a2dae0c-8cd3-488d-bfb8-6d316dde7e1f response_code = 204 uri = /switch-ports
18692024-05-20T20:48:28.563ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62583
18702024-05-20T20:48:28.567ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 3594 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38955 req_id = 6ffa2cfd-0d3d-48df-b136-57e0aff5ed5b response_code = 200 uri = /network-bootstore-config
18712024-05-20T20:48:28.603ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45313
18722024-05-20T20:48:28.610ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 46186 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:62583 req_id = c5c9686f-604c-42a9-9495-f4e91a9b5955 response_code = 204 uri = /switch-ports
18732024-05-20T20:48:28.614ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 670 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62583 req_id = fbe9efb8-9478-408a-a08e-29a3f57273d7 response_code = 200 uri = /network-bootstore-config
18742024-05-20T20:48:28.657ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 54163 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:45313 req_id = 359c375f-d5c8-458a-945d-10f7b9814ed4 response_code = 204 uri = /switch-ports
18752024-05-20T20:48:28.658ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 767 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45313 req_id = 1eb181e3-6508-4402-8c5d-8a0250545a1f response_code = 200 uri = /network-bootstore-config
18762024-05-20T20:48:33.819ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 557 local_addr = [fd00:1122:3344:101::1]:36587 method = GET remote_addr = [fd00:1122:3344:101::d]:36568 req_id = 060ae321-9389-44f2-9368-5b94003e1b09 response_code = 200 sled_id = 082c2565-a0d4-4ca8-a689-9276c9a9c8af uri = /082c2565-a0d4-4ca8-a689-9276c9a9c8af
18772024-05-20T20:48:41.410ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:37218
18782024-05-20T20:48:41.411ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 84 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:37218 req_id = 83ddc0c9-7388-46cd-a028-afbc0704eb59 response_code = 200 uri = /baseboard
18792024-05-20T20:48:58.214ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54671
18802024-05-20T20:48:58.257ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 43339 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:54671 req_id = ad5669aa-d74c-49cf-90ac-a4fc66cfcdce response_code = 204 uri = /switch-ports
18812024-05-20T20:48:58.257ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54671 req_id = bec6591a-5e5f-42ac-aad8-19323242217c response_code = 200 uri = /network-bootstore-config
18822024-05-20T20:48:58.280ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44716
18832024-05-20T20:48:58.325ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 44743 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:44716 req_id = 372bc6ee-e60a-43d3-ad3a-f54849da8b41 response_code = 204 uri = /switch-ports
18842024-05-20T20:48:58.325ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44716 req_id = d3d622e8-18d6-4221-8602-44b86b416ad4 response_code = 200 uri = /network-bootstore-config
18852024-05-20T20:48:58.375ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34147
18862024-05-20T20:48:58.419ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 44393 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:34147 req_id = 3b858ec6-c30b-4fc2-9fec-de36270dd9f2 response_code = 204 uri = /switch-ports
18872024-05-20T20:48:58.420ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 586 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34147 req_id = e9ae2ca1-e04c-47b6-8490-d8f7847c2a81 response_code = 200 uri = /network-bootstore-config
18882024-05-20T20:49:03.819ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 617 local_addr = [fd00:1122:3344:101::1]:36587 method = GET remote_addr = [fd00:1122:3344:101::d]:36568 req_id = 793b43d1-bb02-4c31-ae16-dd093ab824c6 response_code = 200 sled_id = 082c2565-a0d4-4ca8-a689-9276c9a9c8af uri = /082c2565-a0d4-4ca8-a689-9276c9a9c8af
18892024-05-20T20:49:11.443ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:33990
18902024-05-20T20:49:11.443ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 88 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:33990 req_id = ce70cf94-35b8-4dde-84a5-af09d92ecd34 response_code = 200 uri = /baseboard
18912024-05-20T20:49:14.902ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:300
18922024-05-20T20:49:14.903ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
18932024-05-20T20:49:14.938ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:289 next_cleanup = Instant { tv_sec: 1922, tv_nsec: 670202864 } time_to_next_cleanup = 599.99999623s
18942024-05-20T20:49:28.384ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
18952024-05-20T20:49:28.475ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50532
18962024-05-20T20:49:28.518ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 42870 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:50532 req_id = a3e90142-5155-4b4e-a68c-e155eaa238d0 response_code = 204 uri = /switch-ports
18972024-05-20T20:49:28.519ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48467
18982024-05-20T20:49:28.522ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 3360 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50532 req_id = 077ece27-8006-4830-94bc-ed3ffa95bd04 response_code = 200 uri = /network-bootstore-config
18992024-05-20T20:49:28.560ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 41537 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48467 req_id = 0d173603-908c-44a2-93ad-dfdecd415c90 response_code = 204 uri = /switch-ports
19002024-05-20T20:49:28.561ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48467 req_id = d3eb9ec2-2db4-4fa8-be4e-df3d96dd9dfb response_code = 200 uri = /network-bootstore-config
19012024-05-20T20:49:28.573ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57265
19022024-05-20T20:49:28.614ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 40544 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:57265 req_id = bf0bb8c6-8e60-4966-8616-7505c0815e72 response_code = 204 uri = /switch-ports
19032024-05-20T20:49:28.635ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57265 req_id = 11f95c97-978c-4ba1-bceb-1f5cf71a85ec response_code = 200 uri = /network-bootstore-config
19042024-05-20T20:49:33.897ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 548 local_addr = [fd00:1122:3344:101::1]:36587 method = GET remote_addr = [fd00:1122:3344:101::d]:36568 req_id = f5690093-58e2-4b2c-a9e9-d6ce40063453 response_code = 200 sled_id = 082c2565-a0d4-4ca8-a689-9276c9a9c8af uri = /082c2565-a0d4-4ca8-a689-9276c9a9c8af
19052024-05-20T20:49:41.475ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:51591
19062024-05-20T20:49:41.475ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 115 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:51591 req_id = 0a459a8d-1ed2-4667-a17f-b9d5cf18fc92 response_code = 200 uri = /baseboard
19072024-05-20T20:49:46.513ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49893
19082024-05-20T20:49:46.522ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:546 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: efe15faf-8084-41f7-8636-0f955534cb21, kind: Instance { id: c2cd6410-9c17-42bc-ab70-6691f84f60eb }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 251, 78, 130])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.0.0, prefix: 22 })), vni: Vni(4834229), primary: true, slot: 0 }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: efe15faf-8084-41f7-8636-0f955534cb21, kind: Instance { id: c2cd6410-9c17-42bc-ab70-6691f84f60eb }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 251, 78, 130])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.0.0, prefix: 22 })), vni: Vni(4834229), primary: true, slot: 0 }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: efe15faf-8084-41f7-8636-0f955534cb21, kind: Instance { id: c2cd6410-9c17-42bc-ab70-6691f84f60eb }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 251, 78, 130])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.0.0, prefix: 22 })), vni: Vni(4834229), primary: true, slot: 0 }], filter_hosts: Some([Vpc(Vni(4834229))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: efe15faf-8084-41f7-8636-0f955534cb21, kind: Instance { id: c2cd6410-9c17-42bc-ab70-6691f84f60eb }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 251, 78, 130])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.0.0, prefix: 22 })), vni: Vni(4834229), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-2b59507fff8", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 68ef0fec-8e36-4373-ba32-26d967ec0041, read_only_parent: Some(Volume { block_size: 512, id: 5603dda6-fa54-4301-85c3-18dc2574e97d, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 6bbbfd29-8381-4230-9ea1-235e97a9b566, key: Some("8HjZOQgC722ztgEIHaOYwgsdLi1/ccP4geGuSzJq6WE="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::18]:19002", "[fd00:1122:3344:101::12]:19001", "[fd00:1122:3344:101::17]:19002"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 68ef0fec-8e36-4373-ba32-26d967ec0041, key: Some("Ddu7HqY2t4lb9yX5YBhchc5xCP60Z7KJAYn00H3o6zg="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::16]:19000", "[fd00:1122:3344:101::1a]:19000", "[fd00:1122:3344:101::19]:19000"] } }] } }], cloud_init_bytes: Some("6zyQTVNXSU40LjEAAgEBAAIAAioA+AEAKgBAAAAAAAAAAAAAAAApeFY0EmNpZGF0YSAgICAgRkFUMTIgICAOH75bfKwiwHQLVrQOuwcAzRBe6/Ay5M0WzRnr/lRoaXMgaXMgbm90IGEgYm9vdGFibGUgZGlzay4gIFBsZWFzZSBpbnNlcnQgYSBib290YWJsZSBmbG9wcHkgYW5kDQpwcmVzcyBhbnkga2V5IHRvIHRyeSBhZ2FpbiAuLi4gDQoAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAVar4////DwAAAAAAAAAA8P//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////D/j///8PAAAAAAAAAADw//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////8PY2lkYXRhICAgICAIAAAAAAAAAAAAAAAAAAAAAAAAAABBbQBlAHQAYQAtAA8A1GQAYQB0AGEAAAD//wAA/////01FVEEtRH4xICAgAAAvN6a0WLRYAAA3prRYAgC3AAAAQXUAcwBlAHIALQAPALBkAGEAdABhAAAA//8AAP////9VU0VSLUR+MSAgIAAALzemtFi0WAAAN6a0WAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAHsiaW5zdGFuY2UtaWQiOiJjMmNkNjQxMC05YzE3LTQyYmMtYWI3MC02NjkxZjg0ZjYwZWIiLCJsb2NhbC1ob3N0bmFtZSI6ImxvY2Fsc2hhcmsiLCJwdWJsaWMta2V5cyI6WyJzc2gtZWQyNTUxOSBBQUFBQzNOemFDMWxaREkxTlRFNUFBQUFJTkdPVEFMWU9nSHF6RlBkOXRjN2pOVU1ObVduVGRNekpsSU9hNlU4cFFSSCJdfQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA") } instance_id = c2cd6410-9c17-42bc-ab70-6691f84f60eb instance_runtime = InstanceRuntimeState { propolis_id: Some(a68e82da-de4a-4b28-99f0-ff193d281f01), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-05-20T20:49:46.052248647Z } metadata = InstanceMetadata { silo_id: 9533160b-2474-4053-b5dc-1ecdc31db022, project_id: 0b27f8d6-1b9d-4b4f-8e58-f352d7e0c654 } propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = a68e82da-de4a-4b28-99f0-ff193d281f01 vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(1), time_updated: 2024-05-20T20:49:46.025013Z }
19092024-05-20T20:49:46.522ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:580 instance_id = c2cd6410-9c17-42bc-ab70-6691f84f60eb
19102024-05-20T20:49:46.523ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:938 instance_id = c2cd6410-9c17-42bc-ab70-6691f84f60eb propolis_id = a68e82da-de4a-4b28-99f0-ff193d281f01 state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: efe15faf-8084-41f7-8636-0f955534cb21, kind: Instance { id: c2cd6410-9c17-42bc-ab70-6691f84f60eb }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 251, 78, 130])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.0.0, prefix: 22 })), vni: Vni(4834229), primary: true, slot: 0 }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: efe15faf-8084-41f7-8636-0f955534cb21, kind: Instance { id: c2cd6410-9c17-42bc-ab70-6691f84f60eb }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 251, 78, 130])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.0.0, prefix: 22 })), vni: Vni(4834229), primary: true, slot: 0 }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: efe15faf-8084-41f7-8636-0f955534cb21, kind: Instance { id: c2cd6410-9c17-42bc-ab70-6691f84f60eb }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 251, 78, 130])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.0.0, prefix: 22 })), vni: Vni(4834229), primary: true, slot: 0 }], filter_hosts: Some([Vpc(Vni(4834229))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: efe15faf-8084-41f7-8636-0f955534cb21, kind: Instance { id: c2cd6410-9c17-42bc-ab70-6691f84f60eb }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 251, 78, 130])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.0.0, prefix: 22 })), vni: Vni(4834229), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-2b59507fff8", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 68ef0fec-8e36-4373-ba32-26d967ec0041, read_only_parent: Some(Volume { block_size: 512, id: 5603dda6-fa54-4301-85c3-18dc2574e97d, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 6bbbfd29-8381-4230-9ea1-235e97a9b566, key: Some("8HjZOQgC722ztgEIHaOYwgsdLi1/ccP4geGuSzJq6WE="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::18]:19002", "[fd00:1122:3344:101::12]:19001", "[fd00:1122:3344:101::17]:19002"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 68ef0fec-8e36-4373-ba32-26d967ec0041, key: Some("Ddu7HqY2t4lb9yX5YBhchc5xCP60Z7KJAYn00H3o6zg="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::16]:19000", "[fd00:1122:3344:101::1a]:19000", "[fd00:1122:3344:101::19]:19000"] } }] } }], cloud_init_bytes: Some("6zyQTVNXSU40LjEAAgEBAAIAAioA+AEAKgBAAAAAAAAAAAAAAAApeFY0EmNpZGF0YSAgICAgRkFUMTIgICAOH75bfKwiwHQLVrQOuwcAzRBe6/Ay5M0WzRnr/lRoaXMgaXMgbm90IGEgYm9vdGFibGUgZGlzay4gIFBsZWFzZSBpbnNlcnQgYSBib290YWJsZSBmbG9wcHkgYW5kDQpwcmVzcyBhbnkga2V5IHRvIHRyeSBhZ2FpbiAuLi4gDQoAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAVar4////DwAAAAAAAAAA8P//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////D/j///8PAAAAAAAAAADw//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////8PY2lkYXRhICAgICAIAAAAAAAAAAAAAAAAAAAAAAAAAABBbQBlAHQAYQAtAA8A1GQAYQB0AGEAAAD//wAA/////01FVEEtRH4xICAgAAAvN6a0WLRYAAA3prRYAgC3AAAAQXUAcwBlAHIALQAPALBkAGEAdABhAAAA//8AAP////9VU0VSLUR+MSAgIAAALzemtFi0WAAAN6a0WAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAHsiaW5zdGFuY2UtaWQiOiJjMmNkNjQxMC05YzE3LTQyYmMtYWI3MC02NjkxZjg0ZjYwZWIiLCJsb2NhbC1ob3N0bmFtZSI6ImxvY2Fsc2hhcmsiLCJwdWJsaWMta2V5cyI6WyJzc2gtZWQyNTUxOSBBQUFBQzNOemFDMWxaREkxTlRFNUFBQUFJTkdPVEFMWU9nSHF6RlBkOXRjN2pOVU1ObVduVGRNekpsSU9hNlU4cFFSSCJdfQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA") }, instance_runtime: InstanceRuntimeState { propolis_id: Some(a68e82da-de4a-4b28-99f0-ff193d281f01), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-05-20T20:49:46.052248647Z }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(1), time_updated: 2024-05-20T20:49:46.025013Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400 }
19112024-05-20T20:49:46.526ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 12146 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49893 req_id = e668c4ff-4fa7-433d-8745-b855788723a3 response_code = 200 uri = /instances/c2cd6410-9c17-42bc-ab70-6691f84f60eb
19122024-05-20T20:49:46.650ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54419
19132024-05-20T20:49:46.651ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 1542 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54419 req_id = 5226bc53-6d6d-4524-b266-a083804d9004 response_code = 200 uri = /instances/c2cd6410-9c17-42bc-ab70-6691f84f60eb/state
19142024-05-20T20:49:46.672ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:394 port = Port { inner: PortInner { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 251, 78, 130]), slot: 0, vni: Vni { inner: 4834229 }, gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 }, vnic: "vopte6" } }
19152024-05-20T20:49:46.672ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
19162024-05-20T20:49:46.705ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_a68e82da-de4a-4b28-99f0-ff193d281f01 file = illumos-utils/src/zone.rs:315 instance_id = c2cd6410-9c17-42bc-ab70-6691f84f60eb
19172024-05-20T20:49:46.725ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_a68e82da-de4a-4b28-99f0-ff193d281f01 file = illumos-utils/src/zone.rs:354 instance_id = c2cd6410-9c17-42bc-ab70-6691f84f60eb
19182024-05-20T20:49:47.887ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_a68e82da-de4a-4b28-99f0-ff193d281f01: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlInstance0"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::1:0"/> <propval type="astring" name="listen_port" value="12400"/> <propval type="astring" name="metric_addr" value="[fd00:1122:3344:101::c]:12221"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = c2cd6410-9c17-42bc-ab70-6691f84f60eb
19192024-05-20T20:49:47.887ZINFOSledAgent (InstanceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 instance_id = c2cd6410-9c17-42bc-ab70-6691f84f60eb zone = oxz_propolis-server_a68e82da-de4a-4b28-99f0-ff193d281f01
19202024-05-20T20:49:48.055ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_a68e82da-de4a-4b28-99f0-ff193d281f01") failed: Property not found. retry in 64.894783ms file = illumos-utils/src/svc.rs:36 instance_id = c2cd6410-9c17-42bc-ab70-6691f84f60eb zone = oxz_propolis-server_a68e82da-de4a-4b28-99f0-ff193d281f01
19212024-05-20T20:49:48.145ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_a68e82da-de4a-4b28-99f0-ff193d281f01") failed: Property not found. retry in 114.265665ms file = illumos-utils/src/svc.rs:36 instance_id = c2cd6410-9c17-42bc-ab70-6691f84f60eb zone = oxz_propolis-server_a68e82da-de4a-4b28-99f0-ff193d281f01
19222024-05-20T20:49:48.278ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_a68e82da-de4a-4b28-99f0-ff193d281f01") failed: Property not found. retry in 201.475861ms file = illumos-utils/src/svc.rs:36 instance_id = c2cd6410-9c17-42bc-ab70-6691f84f60eb zone = oxz_propolis-server_a68e82da-de4a-4b28-99f0-ff193d281f01
19232024-05-20T20:49:48.494ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_a68e82da-de4a-4b28-99f0-ff193d281f01") failed: Property not found. retry in 436.272663ms file = illumos-utils/src/svc.rs:36 instance_id = c2cd6410-9c17-42bc-ab70-6691f84f60eb zone = oxz_propolis-server_a68e82da-de4a-4b28-99f0-ff193d281f01
19242024-05-20T20:49:48.940ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_a68e82da-de4a-4b28-99f0-ff193d281f01") failed: Property not found. retry in 788.14449ms file = illumos-utils/src/svc.rs:36 instance_id = c2cd6410-9c17-42bc-ab70-6691f84f60eb zone = oxz_propolis-server_a68e82da-de4a-4b28-99f0-ff193d281f01
19252024-05-20T20:49:49.741ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_a68e82da-de4a-4b28-99f0-ff193d281f01") failed: Property not found. retry in 598.629283ms file = illumos-utils/src/svc.rs:36 instance_id = c2cd6410-9c17-42bc-ab70-6691f84f60eb zone = oxz_propolis-server_a68e82da-de4a-4b28-99f0-ff193d281f01
19262024-05-20T20:49:50.349ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_a68e82da-de4a-4b28-99f0-ff193d281f01") failed: Property not found. retry in 1.379189253s file = illumos-utils/src/svc.rs:36 instance_id = c2cd6410-9c17-42bc-ab70-6691f84f60eb zone = oxz_propolis-server_a68e82da-de4a-4b28-99f0-ff193d281f01
19272024-05-20T20:49:51.738ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_a68e82da-de4a-4b28-99f0-ff193d281f01") failed: Property not found. retry in 1.015734961s file = illumos-utils/src/svc.rs:36 instance_id = c2cd6410-9c17-42bc-ab70-6691f84f60eb zone = oxz_propolis-server_a68e82da-de4a-4b28-99f0-ff193d281f01
19282024-05-20T20:49:52.782ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_a68e82da-de4a-4b28-99f0-ff193d281f01 file = sled-agent/src/instance.rs:1423 instance_id = c2cd6410-9c17-42bc-ab70-6691f84f60eb
19292024-05-20T20:49:52.790ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_a68e82da-de4a-4b28-99f0-ff193d281f01") failed: Property not found. retry in 36.688269ms file = illumos-utils/src/svc.rs:36 instance_id = c2cd6410-9c17-42bc-ab70-6691f84f60eb
19302024-05-20T20:49:52.837ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_a68e82da-de4a-4b28-99f0-ff193d281f01") failed: Property not found. retry in 129.165229ms file = illumos-utils/src/svc.rs:36 instance_id = c2cd6410-9c17-42bc-ab70-6691f84f60eb
19312024-05-20T20:49:52.976ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_a68e82da-de4a-4b28-99f0-ff193d281f01") failed: Property not found. retry in 287.984034ms file = illumos-utils/src/svc.rs:36 instance_id = c2cd6410-9c17-42bc-ab70-6691f84f60eb
19322024-05-20T20:49:53.274ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_a68e82da-de4a-4b28-99f0-ff193d281f01") failed: Property not found. retry in 236.616026ms file = illumos-utils/src/svc.rs:36 instance_id = c2cd6410-9c17-42bc-ab70-6691f84f60eb
19332024-05-20T20:49:53.521ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_a68e82da-de4a-4b28-99f0-ff193d281f01") failed: Property not found. retry in 741.797855ms file = illumos-utils/src/svc.rs:36 instance_id = c2cd6410-9c17-42bc-ab70-6691f84f60eb
19342024-05-20T20:49:54.274ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:1432 instance_id = c2cd6410-9c17-42bc-ab70-6691f84f60eb
19352024-05-20T20:49:54.311ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:1446 instance_id = c2cd6410-9c17-42bc-ab70-6691f84f60eb
19362024-05-20T20:49:54.316ZINFOSledAgent (InstanceManager): Sending ensure request to propolis: InstanceEnsureRequest { cloud_init_bytes: Some("6zyQTVNXSU40LjEAAgEBAAIAAioA+AEAKgBAAAAAAAAAAAAAAAApeFY0EmNpZGF0YSAgICAgRkFUMTIgICAOH75bfKwiwHQLVrQOuwcAzRBe6/Ay5M0WzRnr/lRoaXMgaXMgbm90IGEgYm9vdGFibGUgZGlzay4gIFBsZWFzZSBpbnNlcnQgYSBib290YWJsZSBmbG9wcHkgYW5kDQpwcmVzcyBhbnkga2V5IHRvIHRyeSBhZ2FpbiAuLi4gDQoAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAVar4////DwAAAAAAAAAA8P//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////D/j///8PAAAAAAAAAADw//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////8PY2lkYXRhICAgICAIAAAAAAAAAAAAAAAAAAAAAAAAAABBbQBlAHQAYQAtAA8A1GQAYQB0AGEAAAD//wAA/////01FVEEtRH4xICAgAAAvN6a0WLRYAAA3prRYAgC3AAAAQXUAcwBlAHIALQAPALBkAGEAdABhAAAA//8AAP////9VU0VSLUR+MSAgIAAALzemtFi0WAAAN6a0WAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAHsiaW5zdGFuY2UtaWQiOiJjMmNkNjQxMC05YzE3LTQyYmMtYWI3MC02NjkxZjg0ZjYwZWIiLCJsb2NhbC1ob3N0bmFtZSI6ImxvY2Fsc2hhcmsiLCJwdWJsaWMta2V5cyI6WyJzc2gtZWQyNTUxOSBBQUFBQzNOemFDMWxaREkxTlRFNUFBQUFJTkdPVEFMWU9nSHF6RlBkOXRjN2pOVU1ObVduVGRNekpsSU9hNlU4cFFSSCJdfQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA"), disks: [DiskRequest { device: "nvme", name: "disk-2b59507fff8", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 68ef0fec-8e36-4373-ba32-26d967ec0041, read_only_parent: Some(Volume { block_size: 512, id: 5603dda6-fa54-4301-85c3-18dc2574e97d, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 6bbbfd29-8381-4230-9ea1-235e97a9b566, key: Some("8HjZOQgC722ztgEIHaOYwgsdLi1/ccP4geGuSzJq6WE="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::18]:19002", "[fd00:1122:3344:101::12]:19001", "[fd00:1122:3344:101::17]:19002"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 68ef0fec-8e36-4373-ba32-26d967ec0041, key: Some("Ddu7HqY2t4lb9yX5YBhchc5xCP60Z7KJAYn00H3o6zg="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::16]:19000", "[fd00:1122:3344:101::1a]:19000", "[fd00:1122:3344:101::19]:19000"] } }] } }], migrate: None, nics: [NetworkInterfaceRequest { name: "vopte6", slot: Slot(0) }], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Test description", id: c2cd6410-9c17-42bc-ab70-6691f84f60eb, image_id: 00000000-0000-0000-0000-000000000000, memory: 1024, metadata: InstanceMetadata { project_id: 0b27f8d6-1b9d-4b4f-8e58-f352d7e0c654, silo_id: 9533160b-2474-4053-b5dc-1ecdc31db022 }, name: "localshark", vcpus: 2 } } file = sled-agent/src/instance.rs:685 instance_id = c2cd6410-9c17-42bc-ab70-6691f84f60eb
19372024-05-20T20:49:54.472ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:687 instance_id = c2cd6410-9c17-42bc-ab70-6691f84f60eb
19382024-05-20T20:49:54.472ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Starting), migration_status: NoMigration, time: 2024-05-20T20:49:54.472846219Z } file = sled-agent/src/instance.rs:569 instance_id = c2cd6410-9c17-42bc-ab70-6691f84f60eb
19392024-05-20T20:49:54.472ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:591 instance_id = c2cd6410-9c17-42bc-ab70-6691f84f60eb new_instance_state = InstanceRuntimeState { propolis_id: Some(a68e82da-de4a-4b28-99f0-ff193d281f01), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-05-20T20:49:46.052248647Z } new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-05-20T20:49:54.472846219Z } propolis_id = a68e82da-de4a-4b28-99f0-ff193d281f01
19402024-05-20T20:49:54.472ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:491 instance_id = c2cd6410-9c17-42bc-ab70-6691f84f60eb state = SledInstanceState { instance_state: InstanceRuntimeState { propolis_id: Some(a68e82da-de4a-4b28-99f0-ff193d281f01), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-05-20T20:49:46.052248647Z }, propolis_id: a68e82da-de4a-4b28-99f0-ff193d281f01, vmm_state: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-05-20T20:49:54.472846219Z } }
19412024-05-20T20:49:54.537ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_status: NoMigration, time: 2024-05-20T20:49:54.537857266Z } file = sled-agent/src/instance.rs:569 instance_id = c2cd6410-9c17-42bc-ab70-6691f84f60eb
19422024-05-20T20:49:54.537ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:591 instance_id = c2cd6410-9c17-42bc-ab70-6691f84f60eb new_instance_state = InstanceRuntimeState { propolis_id: Some(a68e82da-de4a-4b28-99f0-ff193d281f01), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-05-20T20:49:46.052248647Z } new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(3), time_updated: 2024-05-20T20:49:54.537857266Z } propolis_id = a68e82da-de4a-4b28-99f0-ff193d281f01
19432024-05-20T20:49:54.537ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:491 instance_id = c2cd6410-9c17-42bc-ab70-6691f84f60eb state = SledInstanceState { instance_state: InstanceRuntimeState { propolis_id: Some(a68e82da-de4a-4b28-99f0-ff193d281f01), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-05-20T20:49:46.052248647Z }, propolis_id: a68e82da-de4a-4b28-99f0-ff193d281f01, vmm_state: VmmRuntimeState { state: Running, gen: Generation(3), time_updated: 2024-05-20T20:49:54.537857266Z } }
19442024-05-20T20:49:58.131ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65078
19452024-05-20T20:49:58.131ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65078 req_id = a18f3743-3174-4d7a-ac51-fbca739741d8 response_code = 200 uri = /instances/c2cd6410-9c17-42bc-ab70-6691f84f60eb/state
19462024-05-20T20:49:58.179ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36432
19472024-05-20T20:49:58.179ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 184 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36432 req_id = 1557578e-7705-4a67-8bd9-13e804dce533 response_code = 200 uri = /instances/c2cd6410-9c17-42bc-ab70-6691f84f60eb/state
19482024-05-20T20:49:58.225ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44594
19492024-05-20T20:49:58.225ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44594 req_id = b62b7a19-53a1-4e32-8518-316620100d57 response_code = 200 uri = /instances/c2cd6410-9c17-42bc-ab70-6691f84f60eb/state
19502024-05-20T20:49:58.301ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38507
19512024-05-20T20:49:58.354ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 52546 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:38507 req_id = 8e55ea4e-6dab-4554-ab8a-d396a3fc11eb response_code = 204 uri = /switch-ports
19522024-05-20T20:49:58.354ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38507 req_id = f7dd9780-05f4-448b-ab48-d8a1b6f9405d response_code = 200 uri = /network-bootstore-config
19532024-05-20T20:49:58.367ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33434
19542024-05-20T20:49:58.412ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 45209 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:33434 req_id = 0786facb-0f2e-4784-b282-5c54d7a7f12f response_code = 204 uri = /switch-ports
19552024-05-20T20:49:58.413ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54424
19562024-05-20T20:49:58.413ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 294 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33434 req_id = bb1478a1-7232-42d9-839f-c4acc4b17d53 response_code = 200 uri = /network-bootstore-config
19572024-05-20T20:49:58.457ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 44455 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:54424 req_id = 1c1deb53-849e-448e-b8d9-4a5d9ce06d28 response_code = 204 uri = /switch-ports
19582024-05-20T20:49:58.458ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 664 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54424 req_id = bb5059b7-8ad2-4b84-9765-7dbb5a8e6059 response_code = 200 uri = /network-bootstore-config
19592024-05-20T20:50:03.898ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 665 local_addr = [fd00:1122:3344:101::1]:36587 method = GET remote_addr = [fd00:1122:3344:101::d]:36568 req_id = 35b60adc-9e18-4105-90b3-100e2276ccb4 response_code = 200 sled_id = 082c2565-a0d4-4ca8-a689-9276c9a9c8af uri = /082c2565-a0d4-4ca8-a689-9276c9a9c8af
19602024-05-20T20:50:04.073ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39812
19612024-05-20T20:50:04.073ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 541 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39812 req_id = cf724cd7-b88b-4e86-9654-febf53e09e4a response_code = 200 uri = /instances/c2cd6410-9c17-42bc-ab70-6691f84f60eb/state
19622024-05-20T20:50:04.073ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_status: NoMigration, time: 2024-05-20T20:50:04.073841646Z } file = sled-agent/src/instance.rs:569 instance_id = c2cd6410-9c17-42bc-ab70-6691f84f60eb
19632024-05-20T20:50:04.073ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:591 instance_id = c2cd6410-9c17-42bc-ab70-6691f84f60eb new_instance_state = InstanceRuntimeState { propolis_id: Some(a68e82da-de4a-4b28-99f0-ff193d281f01), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-05-20T20:49:46.052248647Z } new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(5), time_updated: 2024-05-20T20:50:04.073841646Z } propolis_id = a68e82da-de4a-4b28-99f0-ff193d281f01
19642024-05-20T20:50:04.073ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:491 instance_id = c2cd6410-9c17-42bc-ab70-6691f84f60eb state = SledInstanceState { instance_state: InstanceRuntimeState { propolis_id: Some(a68e82da-de4a-4b28-99f0-ff193d281f01), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-05-20T20:49:46.052248647Z }, propolis_id: a68e82da-de4a-4b28-99f0-ff193d281f01, vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(5), time_updated: 2024-05-20T20:50:04.073841646Z } }
19652024-05-20T20:50:04.092ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_status: NoMigration, time: 2024-05-20T20:50:04.092212616Z } file = sled-agent/src/instance.rs:569 instance_id = c2cd6410-9c17-42bc-ab70-6691f84f60eb
19662024-05-20T20:50:04.092ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:591 instance_id = c2cd6410-9c17-42bc-ab70-6691f84f60eb new_instance_state = InstanceRuntimeState { propolis_id: None, dst_propolis_id: None, migration_id: None, gen: Generation(5), time_updated: 2024-05-20T20:50:04.092212616Z } new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(6), time_updated: 2024-05-20T20:50:04.092212616Z } propolis_id = a68e82da-de4a-4b28-99f0-ff193d281f01
19672024-05-20T20:50:04.092ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:606 instance_id = c2cd6410-9c17-42bc-ab70-6691f84f60eb
19682024-05-20T20:50:04.092ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
19692024-05-20T20:50:04.092ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
19702024-05-20T20:50:04.092ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/0cb7111d-dee5-4c65-91df-8aa68aeee77e/debug/bundle/zone", "/pool/int/86226832-0042-47df-b114-06085792be9d/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/96419ba3-f12e-4ccd-8f37-b0d3a3725e86/crypt/debug", "/pool/ext/28bf1422-8de2-4580-b168-1e653c2d0ea3/crypt/debug", "/pool/ext/040cf7d2-26fc-4968-9626-951fc09450b4/crypt/debug", "/pool/ext/e9a2b279-e51b-488d-83ef-f697a65badba/crypt/debug", "/pool/ext/bdfd1b72-3c3a-4f33-9b7a-f64e90e24f6a/crypt/debug", "/pool/ext/63a0c9f9-e34d-401c-a2ae-4888bfc580e3/crypt/debug", "/pool/ext/b1ad2e3e-e2af-4c2a-94f1-4865bf8462a0/crypt/debug", "/pool/ext/7f578f7a-8926-4b69-864d-4c8b71340b47/crypt/debug", "/pool/ext/e3e91ef4-fcde-43ae-a5a9-a2d6e1fd7046/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:437 zone_name = oxz_propolis-server_a68e82da-de4a-4b28-99f0-ff193d281f01
19712024-05-20T20:50:04.703ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1230 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_a68e82da-de4a-4b28-99f0-ff193d281f01", bundle_id: 779c1546-b282-4014-b438-0f8c7605f98f }, time_created: 2024-05-20T20:50:04.092689521Z, version: 0, cause: TerminatedInstance }
19722024-05-20T20:50:04.703ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_a68e82da-de4a-4b28-99f0-ff193d281f01 file = sled-agent/src/instance.rs:780 instance_id = c2cd6410-9c17-42bc-ab70-6691f84f60eb
19732024-05-20T20:50:06.455ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:269 instance_id = c2cd6410-9c17-42bc-ab70-6691f84f60eb
19742024-05-20T20:50:06.479ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:491 instance_id = c2cd6410-9c17-42bc-ab70-6691f84f60eb state = SledInstanceState { instance_state: InstanceRuntimeState { propolis_id: None, dst_propolis_id: None, migration_id: None, gen: Generation(5), time_updated: 2024-05-20T20:50:04.092212616Z }, propolis_id: a68e82da-de4a-4b28-99f0-ff193d281f01, vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-05-20T20:50:06.479052554Z } }
19752024-05-20T20:50:06.579ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45917
19762024-05-20T20:50:06.579ZWARNSledAgent (PortManager): unset_virtual_nic_host unimplmented file = illumos-utils/src/opte/port_manager.rs:620
19772024-05-20T20:50:06.580ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 794 local_addr = [fd00:1122:3344:101::1]:12345 method = DELETE remote_addr = [fd00:1122:3344:101::b]:45917 req_id = 1522b964-50d7-453d-81d4-2179c7627f4b response_code = 204 uri = /v2p/efe15faf-8084-41f7-8636-0f955534cb21
19782024-05-20T20:50:06.848ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:491 instance_id = c2cd6410-9c17-42bc-ab70-6691f84f60eb state = SledInstanceState { instance_state: InstanceRuntimeState { propolis_id: None, dst_propolis_id: None, migration_id: None, gen: Generation(5), time_updated: 2024-05-20T20:50:04.092212616Z }, propolis_id: a68e82da-de4a-4b28-99f0-ff193d281f01, vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-05-20T20:50:06.479052554Z } }
19792024-05-20T20:50:06.852ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:723 instance_id = c2cd6410-9c17-42bc-ab70-6691f84f60eb