Max level shown:
1 [ Jun 22 01:28:19 Enabled. ]
2 [ Jun 22 01:28:19 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Jun 22 01:28:19 Method "start" exited with status 0. ]
4 [ Jun 22 01:28:19 Rereading configuration. ]
5 [ Jun 22 01:28:19 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72024-06-22T01:28:19.496ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:163
82024-06-22T01:28:19.496ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92024-06-22T01:28:19.549ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102024-06-22T01:28:19.549ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112024-06-22T01:28:19.664ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122024-06-22T01:28:19.673ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132024-06-22T01:28:19.681ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142024-06-22T01:28:20.285ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:87 prefix = Ipv6Prefix { addr: fdb0:18c0:4d0d:a02a::, len: 64 }
152024-06-22T01:28:20.427ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:119
162024-06-22T01:28:20.427ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:131
172024-06-22T01:28:20.427ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:141
182024-06-22T01:28:20.427ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:162 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192024-06-22T01:28:20.427ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:506
202024-06-22T01:28:20.427ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:625
212024-06-22T01:28:20.430ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "sock", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:535
222024-06-22T01:28:20.430ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:674
232024-06-22T01:28:20.430ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:176
242024-06-22T01:28:20.430ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:733
252024-06-22T01:28:20.430ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/m2_0.vdev
262024-06-22T01:28:20.430ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:262 underlay_network_info = None
272024-06-22T01:28:20.430ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024 }), tx: ... } file = sled-storage/src/manager.rs:381
282024-06-22T01:28:20.430ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292024-06-22T01:28:20.430ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:121 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302024-06-22T01:28:20.442ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:304
312024-06-22T01:28:20.442ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:315 id = 9b2f2513-2520-480a-aa3a-397437db476d (zpool)
322024-06-22T01:28:20.541ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: 9b2f2513-2520-480a-aa3a-397437db476d (zpool), kind: Internal }
332024-06-22T01:28:20.747ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:381
342024-06-22T01:28:20.747ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/m2_1.vdev
352024-06-22T01:28:20.747ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362024-06-22T01:28:20.747ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372024-06-22T01:28:20.747ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025 }), tx: ... } file = sled-storage/src/manager.rs:381
382024-06-22T01:28:20.747ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392024-06-22T01:28:20.747ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:121 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402024-06-22T01:28:20.756ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:304
412024-06-22T01:28:20.756ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:315 id = 3e31f9bf-741c-4ad6-aa69-e523a333a2d2 (zpool)
422024-06-22T01:28:20.843ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: 3e31f9bf-741c-4ad6-aa69-e523a333a2d2 (zpool), kind: Internal }
432024-06-22T01:28:21.050ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_0.vdev
442024-06-22T01:28:21.050ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 9b2f2513-2520-480a-aa3a-397437db476d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: 3e31f9bf-741c-4ad6-aa69-e523a333a2d2 (zpool), kind: Internal } }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
452024-06-22T01:28:21.050ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
462024-06-22T01:28:21.050ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
472024-06-22T01:28:21.050ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026 }), tx: ... } file = sled-storage/src/manager.rs:381
482024-06-22T01:28:21.050ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
492024-06-22T01:28:21.050ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_1.vdev
502024-06-22T01:28:21.050ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 9b2f2513-2520-480a-aa3a-397437db476d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: 3e31f9bf-741c-4ad6-aa69-e523a333a2d2 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
512024-06-22T01:28:21.050ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
522024-06-22T01:28:21.050ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
532024-06-22T01:28:21.050ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027 }), tx: ... } file = sled-storage/src/manager.rs:381
542024-06-22T01:28:21.050ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
552024-06-22T01:28:21.050ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_2.vdev
562024-06-22T01:28:21.050ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028 }), tx: ... } file = sled-storage/src/manager.rs:381
572024-06-22T01:28:21.050ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 9b2f2513-2520-480a-aa3a-397437db476d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: 3e31f9bf-741c-4ad6-aa69-e523a333a2d2 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
582024-06-22T01:28:21.050ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
592024-06-22T01:28:21.050ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
602024-06-22T01:28:21.050ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
612024-06-22T01:28:21.050ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_3.vdev
622024-06-22T01:28:21.050ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 9b2f2513-2520-480a-aa3a-397437db476d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: 3e31f9bf-741c-4ad6-aa69-e523a333a2d2 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
632024-06-22T01:28:21.050ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
642024-06-22T01:28:21.050ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
652024-06-22T01:28:21.050ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029 }), tx: ... } file = sled-storage/src/manager.rs:381
662024-06-22T01:28:21.050ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
672024-06-22T01:28:21.050ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_4.vdev
682024-06-22T01:28:21.050ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030 }), tx: ... } file = sled-storage/src/manager.rs:381
692024-06-22T01:28:21.050ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 9b2f2513-2520-480a-aa3a-397437db476d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: 3e31f9bf-741c-4ad6-aa69-e523a333a2d2 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
702024-06-22T01:28:21.051ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
712024-06-22T01:28:21.051ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
722024-06-22T01:28:21.051ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
732024-06-22T01:28:21.051ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_5.vdev
742024-06-22T01:28:21.051ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031 }), tx: ... } file = sled-storage/src/manager.rs:381
752024-06-22T01:28:21.051ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
762024-06-22T01:28:21.051ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 9b2f2513-2520-480a-aa3a-397437db476d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: 3e31f9bf-741c-4ad6-aa69-e523a333a2d2 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
772024-06-22T01:28:21.051ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
782024-06-22T01:28:21.051ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
792024-06-22T01:28:21.051ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_6.vdev
802024-06-22T01:28:21.051ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032 }), tx: ... } file = sled-storage/src/manager.rs:381
812024-06-22T01:28:21.051ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 9b2f2513-2520-480a-aa3a-397437db476d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: 3e31f9bf-741c-4ad6-aa69-e523a333a2d2 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
822024-06-22T01:28:21.051ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
832024-06-22T01:28:21.051ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
842024-06-22T01:28:21.051ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
852024-06-22T01:28:21.051ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_7.vdev
862024-06-22T01:28:21.051ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033 }), tx: ... } file = sled-storage/src/manager.rs:381
872024-06-22T01:28:21.051ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
882024-06-22T01:28:21.051ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 9b2f2513-2520-480a-aa3a-397437db476d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: 3e31f9bf-741c-4ad6-aa69-e523a333a2d2 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
892024-06-22T01:28:21.051ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
902024-06-22T01:28:21.051ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
912024-06-22T01:28:21.051ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_8.vdev
922024-06-22T01:28:21.051ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034 }), tx: ... } file = sled-storage/src/manager.rs:381
932024-06-22T01:28:21.051ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 9b2f2513-2520-480a-aa3a-397437db476d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: 3e31f9bf-741c-4ad6-aa69-e523a333a2d2 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
942024-06-22T01:28:21.051ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
952024-06-22T01:28:21.051ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
962024-06-22T01:28:21.051ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
972024-06-22T01:28:21.051ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:91
982024-06-22T01:28:21.051ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:93
992024-06-22T01:28:21.051ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 9b2f2513-2520-480a-aa3a-397437db476d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: 3e31f9bf-741c-4ad6-aa69-e523a333a2d2 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
1002024-06-22T01:28:21.051ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
1012024-06-22T01:28:21.051ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
1022024-06-22T01:28:21.051ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
1032024-06-22T01:28:21.051ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:200
1042024-06-22T01:28:21.051ZINFOSledAgent (bootstore): No ledger in /pool/int/9b2f2513-2520-480a-aa3a-397437db476d/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1052024-06-22T01:28:21.051ZINFOSledAgent (bootstore): No ledger in /pool/int/3e31f9bf-741c-4ad6-aa69-e523a333a2d2/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1062024-06-22T01:28:21.051ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-sock-i86pc
1072024-06-22T01:28:21.051ZINFOSledAgent (bootstore): No ledger in /pool/int/9b2f2513-2520-480a-aa3a-397437db476d/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1082024-06-22T01:28:21.051ZINFOSledAgent (bootstore): No ledger in /pool/int/3e31f9bf-741c-4ad6-aa69-e523a333a2d2/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1092024-06-22T01:28:21.051ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-sock-i86pc
1102024-06-22T01:28:21.051ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:205
1112024-06-22T01:28:21.051ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:220
1122024-06-22T01:28:21.062ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:710
1132024-06-22T01:28:21.062ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:289 next_cleanup = Instant { tv_sec: 2475, tv_nsec: 462756112 } time_to_next_cleanup = 599.99993649s
1142024-06-22T01:28:21.062ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3547
1152024-06-22T01:28:21.062ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
1162024-06-22T01:28:21.063ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/9b2f2513-2520-480a-aa3a-397437db476d/config/sled-agent-request.json file = common/src/ledger.rs:188
1172024-06-22T01:28:21.063ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/3e31f9bf-741c-4ad6-aa69-e523a333a2d2/config/sled-agent-request.json file = common/src/ledger.rs:188
1182024-06-22T01:28:21.065ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:196 local_addr = [fdb0:18c0:4d0d:a02a::1]:80
1192024-06-22T01:28:21.065ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:44 local_addr = [fdb0:18c0:4d0d:a02a::1]:12346
1202024-06-22T01:28:21.066ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.2.164, last: 10.151.2.173, }, ), ], external_dns_ips: [ 10.151.2.164, 10.151.2.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, vlan_id: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: None, bgp_peers: [], autoneg: false, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1011
1212024-06-22T01:28:21.066ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:60
1222024-06-22T01:28:21.066ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
1232024-06-22T01:28:21.066ZINFOSledAgent (RSS): No ledger in /pool/int/9b2f2513-2520-480a-aa3a-397437db476d/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1242024-06-22T01:28:21.066ZINFOSledAgent (RSS): No ledger in /pool/int/3e31f9bf-741c-4ad6-aa69-e523a333a2d2/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1252024-06-22T01:28:21.066ZINFOSledAgent (RSS): RSS configuration has not been fully applied yet file = sled-agent/src/rack_setup/service.rs:1071
1262024-06-22T01:28:21.066ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
1272024-06-22T01:28:21.066ZINFOSledAgent (RSS): No ledger in /pool/int/9b2f2513-2520-480a-aa3a-397437db476d/config/rss-sled-plan.json file = common/src/ledger.rs:188
1282024-06-22T01:28:21.066ZINFOSledAgent (RSS): No ledger in /pool/int/3e31f9bf-741c-4ad6-aa69-e523a333a2d2/config/rss-sled-plan.json file = common/src/ledger.rs:188
1292024-06-22T01:28:21.066ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1112
1302024-06-22T01:28:21.066ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:156
1312024-06-22T01:28:21.066ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:a02a::1 file = sled-agent/src/rack_setup/plan/sled.rs:129
1322024-06-22T01:28:21.066ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
1332024-06-22T01:28:21.066ZINFOSledAgent (RSS): Writing ledger to /pool/int/9b2f2513-2520-480a-aa3a-397437db476d/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:199
1342024-06-22T01:28:21.066ZINFOSledAgent (RSS): Writing ledger to /pool/int/3e31f9bf-741c-4ad6-aa69-e523a333a2d2/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:199
1352024-06-22T01:28:21.066ZINFOSledAgent (RSS): Sled plan written to storage file = sled-agent/src/rack_setup/plan/sled.rs:176
1362024-06-22T01:28:21.066ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1145
1372024-06-22T01:28:21.066ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
1382024-06-22T01:28:21.066ZINFOSledAgent (bootstore): Writing ledger to /pool/int/9b2f2513-2520-480a-aa3a-397437db476d/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1392024-06-22T01:28:21.067ZINFOSledAgent (bootstore): Writing ledger to /pool/int/3e31f9bf-741c-4ad6-aa69-e523a333a2d2/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1402024-06-22T01:28:21.067ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
1412024-06-22T01:28:21.067ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:217 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 9f7cbf52-de0d-48c8-9e7d-2958552743a4, rack_id: 43e686a5-5e84-4578-a9f9-dc715322753f, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
1422024-06-22T01:28:21.067ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:66 remote_addr = [fdb0:18c0:4d0d:a02a::1]:52727
1432024-06-22T01:28:21.067ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 9f7cbf52-de0d-48c8-9e7d-2958552743a4, rack_id: 43e686a5-5e84-4578-a9f9-dc715322753f, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:360
1442024-06-22T01:28:21.067ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:375
1452024-06-22T01:28:21.067ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1462024-06-22T01:28:21.067ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:60
1472024-06-22T01:28:21.067ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:87 prefix = Ipv6Prefix { addr: fd00:1122:3344:101::, len: 64 }
1482024-06-22T01:28:21.067ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:381
1492024-06-22T01:28:21.067ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:530
1502024-06-22T01:28:21.067ZINFOSledAgent (StorageManager): No ledger in /pool/int/9b2f2513-2520-480a-aa3a-397437db476d/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_ledger
1512024-06-22T01:28:21.067ZINFOSledAgent (StorageManager): No ledger in /pool/int/3e31f9bf-741c-4ad6-aa69-e523a333a2d2/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_ledger
1522024-06-22T01:28:21.067ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:519
1532024-06-22T01:28:21.067ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:547
1542024-06-22T01:28:21.070ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:3779
1552024-06-22T01:28:21.080ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
1562024-06-22T01:28:21.090ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
1572024-06-22T01:28:21.099ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
1582024-06-22T01:28:21.108ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
1592024-06-22T01:28:21.116ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
1602024-06-22T01:28:21.125ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
1612024-06-22T01:28:21.133ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
1622024-06-22T01:28:21.142ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
1632024-06-22T01:28:21.151ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
1642024-06-22T01:28:21.151ZINFOSledAgent (StorageManager): No disks to be automatically managed file = sled-storage/src/manager.rs:558
1652024-06-22T01:28:21.151ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:370
1662024-06-22T01:28:21.151ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:339
1672024-06-22T01:28:21.151ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:449 result = DisksManagementResult { status: [] }
1682024-06-22T01:28:21.151ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
1692024-06-22T01:28:21.156ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:354 sled_id = 9f7cbf52-de0d-48c8-9e7d-2958552743a4
1702024-06-22T01:28:21.156ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
1712024-06-22T01:28:21.156ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:164
1722024-06-22T01:28:21.156ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:366 sled_id = 9f7cbf52-de0d-48c8-9e7d-2958552743a4
1732024-06-22T01:28:21.161ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 105.084057ms DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "36850079-937f-4576-838b-e04b6c22bc05", "content-length": "124", "date": "Sat, 22 Jun 2024 01:28:20 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "36850079-937f-4576-838b-e04b6c22bc05" } file = clients/ddm-admin-client/src/lib.rs:178
1742024-06-22T01:28:21.169ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_9b2f2513-2520-480a-aa3a-397437db476d/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1752024-06-22T01:28:21.173ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:315
1762024-06-22T01:28:21.190ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:354
1772024-06-22T01:28:21.192ZINFOSledAgent: successfully created encrypted zvol: name="oxi_9b2f2513-2520-480a-aa3a-397437db476d/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1782024-06-22T01:28:21.192ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_9b2f2513-2520-480a-aa3a-397437db476d/swap" file = sled-agent/src/swap_device.rs:96
1792024-06-22T01:28:21.197ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:381 sled_id = 9f7cbf52-de0d-48c8-9e7d-2958552743a4
1802024-06-22T01:28:21.197ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:126
1812024-06-22T01:28:21.197ZINFOSledAgent (BackingFs): Ensuring dataset oxi_9b2f2513-2520-480a-aa3a-397437db476d/backing/fmd file = sled-agent/src/backing_fs.rs:136
1822024-06-22T01:28:21.268ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:164
1832024-06-22T01:28:21.268ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 161.587913ms DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "1339148f-55b3-453d-8e67-f4eb80d7f402", "content-length": "124", "date": "Sat, 22 Jun 2024 01:28:20 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "1339148f-55b3-453d-8e67-f4eb80d7f402" } file = clients/ddm-admin-client/src/lib.rs:178
1842024-06-22T01:28:21.272ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:170
1852024-06-22T01:28:21.431ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:164
1862024-06-22T01:28:21.432ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 73.766752ms DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "304801b5-e9c7-4066-9e5a-74aa6d0b21ea", "content-length": "124", "date": "Sat, 22 Jun 2024 01:28:21 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "304801b5-e9c7-4066-9e5a-74aa6d0b21ea" } file = clients/ddm-admin-client/src/lib.rs:178
1872024-06-22T01:28:21.492ZINFOSledAgent (BackingFs): Mounting oxi_9b2f2513-2520-480a-aa3a-397437db476d/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:178
1882024-06-22T01:28:21.505ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:186
1892024-06-22T01:28:21.505ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:186
1902024-06-22T01:28:21.505ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:186
1912024-06-22T01:28:21.505ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:192
1922024-06-22T01:28:21.507ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:164
1932024-06-22T01:28:21.508ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 172.316124ms DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "dce266dc-db7a-4b95-b0de-a9639a784073", "content-length": "124", "date": "Sat, 22 Jun 2024 01:28:21 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "dce266dc-db7a-4b95-b0de-a9639a784073" } file = clients/ddm-admin-client/src/lib.rs:178
1942024-06-22T01:28:21.683ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:164
1952024-06-22T01:28:21.684ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 308.235363ms DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "beaab6c0-a1d7-4198-a050-7293b27621ad", "content-length": "124", "date": "Sat, 22 Jun 2024 01:28:21 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "beaab6c0-a1d7-4198-a050-7293b27621ad" } file = clients/ddm-admin-client/src/lib.rs:178
1962024-06-22T01:28:21.994ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:164
1972024-06-22T01:28:21.994ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 275.745805ms DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "8a86d481-2327-4823-87d0-25f1cd6d1a67", "content-length": "124", "date": "Sat, 22 Jun 2024 01:28:21 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "8a86d481-2327-4823-87d0-25f1cd6d1a67" } file = clients/ddm-admin-client/src/lib.rs:178
1982024-06-22T01:28:22.202ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:90 sled_id = 9f7cbf52-de0d-48c8-9e7d-2958552743a4
1992024-06-22T01:28:22.203ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:196 local_addr = [fd00:1122:3344:101::1]:65146 sled_id = 9f7cbf52-de0d-48c8-9e7d-2958552743a4
2002024-06-22T01:28:22.203ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:60 sled_id = 9f7cbf52-de0d-48c8-9e7d-2958552743a4
2012024-06-22T01:28:22.203ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:65146 file = oximeter/producer/src/lib.rs:276 interval = 30s producer_id = 9f7cbf52-de0d-48c8-9e7d-2958552743a4 sled_id = 9f7cbf52-de0d-48c8-9e7d-2958552743a4
2022024-06-22T01:28:22.209ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 201.131115ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:384 sled_id = 9f7cbf52-de0d-48c8-9e7d-2958552743a4
2032024-06-22T01:28:22.250ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = 9f7cbf52-de0d-48c8-9e7d-2958552743a4
2042024-06-22T01:28:22.250ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = 9f7cbf52-de0d-48c8-9e7d-2958552743a4
2052024-06-22T01:28:22.250ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:893 underlay_address = fd00:1122:3344:101::1
2062024-06-22T01:28:22.250ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:60
2072024-06-22T01:28:22.251ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:196 local_addr = [fd00:1122:3344:101::1]:12345
2082024-06-22T01:28:22.251ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:430
2092024-06-22T01:28:22.251ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
2102024-06-22T01:28:22.251ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/9b2f2513-2520-480a-aa3a-397437db476d/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2112024-06-22T01:28:22.251ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/3e31f9bf-741c-4ad6-aa69-e523a333a2d2/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2122024-06-22T01:28:22.252ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2132024-06-22T01:28:22.252ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:262 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.2.100, vlan_id: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: None, bgp_peers: [], autoneg: false }], bgp: [], bfd: [] })))
2142024-06-22T01:28:22.252ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3547
2152024-06-22T01:28:22.252ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:73 remote_addr = [fdb0:18c0:4d0d:a02a::1]:52727
2162024-06-22T01:28:22.425ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:108 peer = [fdb0:18c0:4d0d:a02a::1]:12346
2172024-06-22T01:28:22.425ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:232 target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
2182024-06-22T01:28:22.426ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
2192024-06-22T01:28:22.426ZINFOSledAgent (RSS): No ledger in /pool/int/9b2f2513-2520-480a-aa3a-397437db476d/config/rss-service-plan-v3.json file = common/src/ledger.rs:188
2202024-06-22T01:28:22.426ZINFOSledAgent (RSS): No ledger in /pool/int/3e31f9bf-741c-4ad6-aa69-e523a333a2d2/config/rss-service-plan-v3.json file = common/src/ledger.rs:188
2212024-06-22T01:28:22.426ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
2222024-06-22T01:28:22.426ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
2232024-06-22T01:28:22.426ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:164
2242024-06-22T01:28:22.427ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 482.338993ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:384 sled_id = 9f7cbf52-de0d-48c8-9e7d-2958552743a4
2252024-06-22T01:28:22.432ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/9f7cbf52-de0d-48c8-9e7d-2958552743a4): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:619 sled_id = 9f7cbf52-de0d-48c8-9e7d-2958552743a4
2262024-06-22T01:28:22.458ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42699
2272024-06-22T01:28:22.458ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
2282024-06-22T01:28:22.458ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42699 req_id = 4a66400a-150b-42c5-9993-630335862912 response_code = 200 uri = /inventory
2292024-06-22T01:28:22.486ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50229
2302024-06-22T01:28:22.486ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:50229 req_id = 8ad81c4f-e936-45d2-bfd1-a903d2e36545 response_code = 200 uri = /sled-role
2312024-06-22T01:28:22.487ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
2322024-06-22T01:28:22.487ZINFOSledAgent (RSS): Writing ledger to /pool/int/9b2f2513-2520-480a-aa3a-397437db476d/config/.rss-service-plan-v3.json.tmp file = common/src/ledger.rs:199
2332024-06-22T01:28:22.487ZINFOSledAgent (RSS): Writing ledger to /pool/int/3e31f9bf-741c-4ad6-aa69-e523a333a2d2/config/.rss-service-plan-v3.json.tmp file = common/src/ledger.rs:199
2342024-06-22T01:28:22.488ZINFOSledAgent (RSS): Service plan written to storage file = sled-agent/src/rack_setup/plan/service.rs:812
2352024-06-22T01:28:22.518ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { disks: [OmicronPhysicalDiskConfig { id: 9aace9e8-7121-4f1a-9718-009dfee31dd4, identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, pool_id: fd49fe38-f2ec-424b-a36d-fe54014bb3a5 (zpool) }, OmicronPhysicalDiskConfig { id: 905dadf1-5019-4037-8bfe-8ca2a25dd837, identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, pool_id: c9d3163d-8113-4008-b362-43292ae5be54 (zpool) }, OmicronPhysicalDiskConfig { id: f3d6a433-53a0-4137-96fa-37f03e532438, identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, pool_id: 8c04dded-f22c-49d5-9c59-b5b4be2cf536 (zpool) }, OmicronPhysicalDiskConfig { id: 46eb3cba-7625-4ade-b6d8-cd99c2944ca4, identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, pool_id: a9e6c25d-f1e0-4d21-b66f-63e2ac90bcb3 (zpool) }, OmicronPhysicalDiskConfig { id: f8e2e242-eb80-4283-b17f-5e99ef7cfca9, identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, pool_id: b14a31e4-ac90-49a4-967f-505e8d513a31 (zpool) }, OmicronPhysicalDiskConfig { id: 227eddd4-5ac9-433c-b8b1-3170e68b335a, identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, pool_id: 12d1cb28-982b-440a-a40d-fd94d1ea8903 (zpool) }, OmicronPhysicalDiskConfig { id: 184e7ab8-87df-458c-8050-47167761a93b, identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, pool_id: f6ed7191-8358-44ad-bdc5-56e8c623c8b8 (zpool) }, OmicronPhysicalDiskConfig { id: e507f1cc-e8e1-4eb8-8c80-435c76dcc08f, identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, pool_id: 870c10b7-1cc9-4791-bad3-d7dbfc885d9d (zpool) }, OmicronPhysicalDiskConfig { id: 745cfed3-d72e-4b3d-bbbb-ed18e560e4ff, identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, pool_id: 4deb6b88-4ed5-4c48-8332-5170c17d8ee2 (zpool) }], generation: Generation(1) } file = sled-agent/src/rack_setup/service.rs:348 sled_address = [fd00:1122:3344:101::1]:12345
2362024-06-22T01:28:22.518ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47463
2372024-06-22T01:28:22.518ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(1), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 9aace9e8-7121-4f1a-9718-009dfee31dd4, pool_id: fd49fe38-f2ec-424b-a36d-fe54014bb3a5 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 905dadf1-5019-4037-8bfe-8ca2a25dd837, pool_id: c9d3163d-8113-4008-b362-43292ae5be54 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: f3d6a433-53a0-4137-96fa-37f03e532438, pool_id: 8c04dded-f22c-49d5-9c59-b5b4be2cf536 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 46eb3cba-7625-4ade-b6d8-cd99c2944ca4, pool_id: a9e6c25d-f1e0-4d21-b66f-63e2ac90bcb3 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: f8e2e242-eb80-4283-b17f-5e99ef7cfca9, pool_id: b14a31e4-ac90-49a4-967f-505e8d513a31 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 227eddd4-5ac9-433c-b8b1-3170e68b335a, pool_id: 12d1cb28-982b-440a-a40d-fd94d1ea8903 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 184e7ab8-87df-458c-8050-47167761a93b, pool_id: f6ed7191-8358-44ad-bdc5-56e8c623c8b8 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: e507f1cc-e8e1-4eb8-8c80-435c76dcc08f, pool_id: 870c10b7-1cc9-4791-bad3-d7dbfc885d9d (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 745cfed3-d72e-4b3d-bbbb-ed18e560e4ff, pool_id: 4deb6b88-4ed5-4c48-8332-5170c17d8ee2 (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:381
2382024-06-22T01:28:22.518ZINFOSledAgent (StorageManager): No ledger in /pool/int/9b2f2513-2520-480a-aa3a-397437db476d/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2392024-06-22T01:28:22.519ZINFOSledAgent (StorageManager): No ledger in /pool/int/3e31f9bf-741c-4ad6-aa69-e523a333a2d2/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2402024-06-22T01:28:22.519ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:681 request = omicron_physical_disks_ensure
2412024-06-22T01:28:22.519ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:339
2422024-06-22T01:28:22.519ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:379
2432024-06-22T01:28:22.519ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
2442024-06-22T01:28:22.519ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:121 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2452024-06-22T01:28:22.616ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:304
2462024-06-22T01:28:22.616ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:310 id = fd49fe38-f2ec-424b-a36d-fe54014bb3a5 (zpool)
2472024-06-22T01:28:22.977ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 966.835909ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:384 sled_id = 9f7cbf52-de0d-48c8-9e7d-2958552743a4
2482024-06-22T01:28:23.399ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/9f7cbf52-de0d-48c8-9e7d-2958552743a4): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = 9f7cbf52-de0d-48c8-9e7d-2958552743a4
2492024-06-22T01:28:23.586ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: fd49fe38-f2ec-424b-a36d-fe54014bb3a5 (zpool), kind: External }
2502024-06-22T01:28:23.749ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:332
2512024-06-22T01:28:23.749ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:334
2522024-06-22T01:28:23.749ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:338
2532024-06-22T01:28:23.749ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:340
2542024-06-22T01:28:23.749ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2552024-06-22T01:28:23.749ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2562024-06-22T01:28:23.749ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
2572024-06-22T01:28:24.106ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.367668158s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:384 sled_id = 9f7cbf52-de0d-48c8-9e7d-2958552743a4
2582024-06-22T01:28:24.291ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2592024-06-22T01:28:24.477ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_switch
2602024-06-22T01:28:24.645ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_fd49fe38-f2ec-424b-a36d-fe54014bb3a5/crypt/zone file = sled-storage/src/dataset.rs:395
2612024-06-22T01:28:24.847ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/9f7cbf52-de0d-48c8-9e7d-2958552743a4): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:619 sled_id = 9f7cbf52-de0d-48c8-9e7d-2958552743a4
2622024-06-22T01:28:24.847ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/9f7cbf52-de0d-48c8-9e7d-2958552743a4): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = 9f7cbf52-de0d-48c8-9e7d-2958552743a4
2632024-06-22T01:28:25.248ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 37.333742ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2642024-06-22T01:28:25.656ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 2.134015227s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:384 sled_id = 9f7cbf52-de0d-48c8-9e7d-2958552743a4
2652024-06-22T01:28:25.838ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 53.47128ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2662024-06-22T01:28:26.257ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 257.737834ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2672024-06-22T01:28:26.258ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/9f7cbf52-de0d-48c8-9e7d-2958552743a4): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = 9f7cbf52-de0d-48c8-9e7d-2958552743a4
2682024-06-22T01:28:26.489ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/9f7cbf52-de0d-48c8-9e7d-2958552743a4): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:619 sled_id = 9f7cbf52-de0d-48c8-9e7d-2958552743a4
2692024-06-22T01:28:27.011ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 391.361182ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2702024-06-22T01:28:27.671ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_fd49fe38-f2ec-424b-a36d-fe54014bb3a5 file = sled-storage/src/dataset.rs:480
2712024-06-22T01:28:27.904ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 9.063905105s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:384 sled_id = 9f7cbf52-de0d-48c8-9e7d-2958552743a4
2722024-06-22T01:28:27.904ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 483.695151ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2732024-06-22T01:28:27.904ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/9f7cbf52-de0d-48c8-9e7d-2958552743a4): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = 9f7cbf52-de0d-48c8-9e7d-2958552743a4
2742024-06-22T01:28:27.910ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:477
2752024-06-22T01:28:27.910ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:394
2762024-06-22T01:28:27.910ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:379
2772024-06-22T01:28:27.910ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
2782024-06-22T01:28:27.910ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:121 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2792024-06-22T01:28:28.128ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:304
2802024-06-22T01:28:28.128ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:310 id = c9d3163d-8113-4008-b362-43292ae5be54 (zpool)
2812024-06-22T01:28:29.299ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: c9d3163d-8113-4008-b362-43292ae5be54 (zpool), kind: External }
2822024-06-22T01:28:29.537ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:332
2832024-06-22T01:28:29.537ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:334
2842024-06-22T01:28:29.537ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:338
2852024-06-22T01:28:29.537ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:340
2862024-06-22T01:28:29.537ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2872024-06-22T01:28:29.537ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2882024-06-22T01:28:29.537ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
2892024-06-22T01:28:30.043ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/9f7cbf52-de0d-48c8-9e7d-2958552743a4): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = 9f7cbf52-de0d-48c8-9e7d-2958552743a4
2902024-06-22T01:28:30.044ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/9f7cbf52-de0d-48c8-9e7d-2958552743a4): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:619 sled_id = 9f7cbf52-de0d-48c8-9e7d-2958552743a4
2912024-06-22T01:28:31.000ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2922024-06-22T01:28:31.237ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/9f7cbf52-de0d-48c8-9e7d-2958552743a4): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = 9f7cbf52-de0d-48c8-9e7d-2958552743a4
2932024-06-22T01:28:31.495ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_c9d3163d-8113-4008-b362-43292ae5be54/crypt/zone file = sled-storage/src/dataset.rs:395
2942024-06-22T01:28:32.215ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/9f7cbf52-de0d-48c8-9e7d-2958552743a4): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:619 sled_id = 9f7cbf52-de0d-48c8-9e7d-2958552743a4
2952024-06-22T01:28:32.216ZINFOSledAgent (ServiceManager): Ensuring tfportrear0_0/ll exists in zone file = sled-agent/src/services.rs:2233
2962024-06-22T01:28:32.438ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = 9f7cbf52-de0d-48c8-9e7d-2958552743a4
2972024-06-22T01:28:32.451ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/9f7cbf52-de0d-48c8-9e7d-2958552743a4): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = 9f7cbf52-de0d-48c8-9e7d-2958552743a4
2982024-06-22T01:28:32.550ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_c9d3163d-8113-4008-b362-43292ae5be54 file = sled-storage/src/dataset.rs:480
2992024-06-22T01:28:32.558ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:477
3002024-06-22T01:28:32.558ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:394
3012024-06-22T01:28:32.558ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:379
3022024-06-22T01:28:32.558ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
3032024-06-22T01:28:32.558ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:121 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3042024-06-22T01:28:32.568ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:304
3052024-06-22T01:28:32.568ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:310 id = 8c04dded-f22c-49d5-9c59-b5b4be2cf536 (zpool)
3062024-06-22T01:28:32.663ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: 8c04dded-f22c-49d5-9c59-b5b4be2cf536 (zpool), kind: External }
3072024-06-22T01:28:32.671ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:332
3082024-06-22T01:28:32.671ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:334
3092024-06-22T01:28:32.671ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:338
3102024-06-22T01:28:32.671ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:340
3112024-06-22T01:28:32.671ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3122024-06-22T01:28:32.671ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3132024-06-22T01:28:32.671ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
3142024-06-22T01:28:32.706ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3152024-06-22T01:28:32.714ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_8c04dded-f22c-49d5-9c59-b5b4be2cf536/crypt/zone file = sled-storage/src/dataset.rs:395
3162024-06-22T01:28:32.834ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_8c04dded-f22c-49d5-9c59-b5b4be2cf536 file = sled-storage/src/dataset.rs:480
3172024-06-22T01:28:32.841ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:477
3182024-06-22T01:28:32.842ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:394
3192024-06-22T01:28:32.842ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:379
3202024-06-22T01:28:32.842ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
3212024-06-22T01:28:32.842ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:121 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3222024-06-22T01:28:32.852ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:304
3232024-06-22T01:28:32.852ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:310 id = a9e6c25d-f1e0-4d21-b66f-63e2ac90bcb3 (zpool)
3242024-06-22T01:28:32.944ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: a9e6c25d-f1e0-4d21-b66f-63e2ac90bcb3 (zpool), kind: External }
3252024-06-22T01:28:32.952ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:332
3262024-06-22T01:28:32.952ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:334
3272024-06-22T01:28:32.952ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:338
3282024-06-22T01:28:32.952ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:340
3292024-06-22T01:28:32.952ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3302024-06-22T01:28:32.952ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3312024-06-22T01:28:32.952ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
3322024-06-22T01:28:32.987ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3332024-06-22T01:28:32.995ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_a9e6c25d-f1e0-4d21-b66f-63e2ac90bcb3/crypt/zone file = sled-storage/src/dataset.rs:395
3342024-06-22T01:28:33.123ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_a9e6c25d-f1e0-4d21-b66f-63e2ac90bcb3 file = sled-storage/src/dataset.rs:480
3352024-06-22T01:28:33.131ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:477
3362024-06-22T01:28:33.131ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:394
3372024-06-22T01:28:33.131ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:379
3382024-06-22T01:28:33.131ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
3392024-06-22T01:28:33.131ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:121 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3402024-06-22T01:28:33.141ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:304
3412024-06-22T01:28:33.141ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:310 id = b14a31e4-ac90-49a4-967f-505e8d513a31 (zpool)
3422024-06-22T01:28:33.233ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: b14a31e4-ac90-49a4-967f-505e8d513a31 (zpool), kind: External }
3432024-06-22T01:28:33.240ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:332
3442024-06-22T01:28:33.240ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:334
3452024-06-22T01:28:33.240ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:338
3462024-06-22T01:28:33.240ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:340
3472024-06-22T01:28:33.240ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3482024-06-22T01:28:33.240ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3492024-06-22T01:28:33.240ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
3502024-06-22T01:28:33.278ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3512024-06-22T01:28:33.286ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_b14a31e4-ac90-49a4-967f-505e8d513a31/crypt/zone file = sled-storage/src/dataset.rs:395
3522024-06-22T01:28:33.409ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_b14a31e4-ac90-49a4-967f-505e8d513a31 file = sled-storage/src/dataset.rs:480
3532024-06-22T01:28:33.417ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:477
3542024-06-22T01:28:33.417ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:394
3552024-06-22T01:28:33.417ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:379
3562024-06-22T01:28:33.417ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
3572024-06-22T01:28:33.417ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:121 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3582024-06-22T01:28:33.428ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:304
3592024-06-22T01:28:33.428ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:310 id = 12d1cb28-982b-440a-a40d-fd94d1ea8903 (zpool)
3602024-06-22T01:28:33.518ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: 12d1cb28-982b-440a-a40d-fd94d1ea8903 (zpool), kind: External }
3612024-06-22T01:28:33.525ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:332
3622024-06-22T01:28:33.526ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:334
3632024-06-22T01:28:33.526ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:338
3642024-06-22T01:28:33.526ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:340
3652024-06-22T01:28:33.526ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3662024-06-22T01:28:33.526ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3672024-06-22T01:28:33.526ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
3682024-06-22T01:28:33.560ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3692024-06-22T01:28:33.565ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/9f7cbf52-de0d-48c8-9e7d-2958552743a4): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = 9f7cbf52-de0d-48c8-9e7d-2958552743a4
3702024-06-22T01:28:33.568ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_12d1cb28-982b-440a-a40d-fd94d1ea8903/crypt/zone file = sled-storage/src/dataset.rs:395
3712024-06-22T01:28:33.678ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_12d1cb28-982b-440a-a40d-fd94d1ea8903 file = sled-storage/src/dataset.rs:480
3722024-06-22T01:28:33.685ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:477
3732024-06-22T01:28:33.685ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:394
3742024-06-22T01:28:33.685ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:379
3752024-06-22T01:28:33.685ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
3762024-06-22T01:28:33.685ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:121 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3772024-06-22T01:28:33.695ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:304
3782024-06-22T01:28:33.695ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:310 id = f6ed7191-8358-44ad-bdc5-56e8c623c8b8 (zpool)
3792024-06-22T01:28:33.792ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: f6ed7191-8358-44ad-bdc5-56e8c623c8b8 (zpool), kind: External }
3802024-06-22T01:28:33.800ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:332
3812024-06-22T01:28:33.800ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:334
3822024-06-22T01:28:33.800ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:338
3832024-06-22T01:28:33.800ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:340
3842024-06-22T01:28:33.800ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3852024-06-22T01:28:33.800ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3862024-06-22T01:28:33.800ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
3872024-06-22T01:28:33.804ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/9f7cbf52-de0d-48c8-9e7d-2958552743a4): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:619 sled_id = 9f7cbf52-de0d-48c8-9e7d-2958552743a4
3882024-06-22T01:28:33.838ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3892024-06-22T01:28:33.846ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_f6ed7191-8358-44ad-bdc5-56e8c623c8b8/crypt/zone file = sled-storage/src/dataset.rs:395
3902024-06-22T01:28:33.966ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_f6ed7191-8358-44ad-bdc5-56e8c623c8b8 file = sled-storage/src/dataset.rs:480
3912024-06-22T01:28:33.974ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:477
3922024-06-22T01:28:33.974ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:394
3932024-06-22T01:28:33.974ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:379
3942024-06-22T01:28:33.974ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
3952024-06-22T01:28:33.974ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:121 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
3962024-06-22T01:28:33.984ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:304
3972024-06-22T01:28:33.984ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:310 id = 870c10b7-1cc9-4791-bad3-d7dbfc885d9d (zpool)
3982024-06-22T01:28:34.075ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: 870c10b7-1cc9-4791-bad3-d7dbfc885d9d (zpool), kind: External }
3992024-06-22T01:28:34.083ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:332
4002024-06-22T01:28:34.083ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:334
4012024-06-22T01:28:34.083ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:338
4022024-06-22T01:28:34.083ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:340
4032024-06-22T01:28:34.083ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4042024-06-22T01:28:34.083ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4052024-06-22T01:28:34.083ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
4062024-06-22T01:28:34.118ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4072024-06-22T01:28:34.126ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_870c10b7-1cc9-4791-bad3-d7dbfc885d9d/crypt/zone file = sled-storage/src/dataset.rs:395
4082024-06-22T01:28:34.254ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_870c10b7-1cc9-4791-bad3-d7dbfc885d9d file = sled-storage/src/dataset.rs:480
4092024-06-22T01:28:34.263ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:477
4102024-06-22T01:28:34.263ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:394
4112024-06-22T01:28:34.263ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:379
4122024-06-22T01:28:34.263ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
4132024-06-22T01:28:34.263ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:121 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4142024-06-22T01:28:34.273ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:304
4152024-06-22T01:28:34.273ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:310 id = 4deb6b88-4ed5-4c48-8332-5170c17d8ee2 (zpool)
4162024-06-22T01:28:34.366ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: 4deb6b88-4ed5-4c48-8332-5170c17d8ee2 (zpool), kind: External }
4172024-06-22T01:28:34.374ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:332
4182024-06-22T01:28:34.374ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:334
4192024-06-22T01:28:34.374ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:338
4202024-06-22T01:28:34.374ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:340
4212024-06-22T01:28:34.374ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4222024-06-22T01:28:34.374ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4232024-06-22T01:28:34.374ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
4242024-06-22T01:28:34.411ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4252024-06-22T01:28:34.419ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_4deb6b88-4ed5-4c48-8332-5170c17d8ee2/crypt/zone file = sled-storage/src/dataset.rs:395
4262024-06-22T01:28:34.543ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_4deb6b88-4ed5-4c48-8332-5170c17d8ee2 file = sled-storage/src/dataset.rs:480
4272024-06-22T01:28:34.551ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:477
4282024-06-22T01:28:34.551ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:394
4292024-06-22T01:28:34.551ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/9b2f2513-2520-480a-aa3a-397437db476d/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4302024-06-22T01:28:34.551ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 9b2f2513-2520-480a-aa3a-397437db476d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: 3e31f9bf-741c-4ad6-aa69-e523a333a2d2 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026 }, zpool_name: ZpoolName { id: fd49fe38-f2ec-424b-a36d-fe54014bb3a5 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027 }, zpool_name: ZpoolName { id: c9d3163d-8113-4008-b362-43292ae5be54 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028 }, zpool_name: ZpoolName { id: 8c04dded-f22c-49d5-9c59-b5b4be2cf536 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029 }, zpool_name: ZpoolName { id: a9e6c25d-f1e0-4d21-b66f-63e2ac90bcb3 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030 }, zpool_name: ZpoolName { id: b14a31e4-ac90-49a4-967f-505e8d513a31 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031 }, zpool_name: ZpoolName { id: 12d1cb28-982b-440a-a40d-fd94d1ea8903 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032 }, zpool_name: ZpoolName { id: f6ed7191-8358-44ad-bdc5-56e8c623c8b8 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033 }, zpool_name: ZpoolName { id: 870c10b7-1cc9-4791-bad3-d7dbfc885d9d (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034 }, zpool_name: ZpoolName { id: 4deb6b88-4ed5-4c48-8332-5170c17d8ee2 (zpool), kind: External } }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
4312024-06-22T01:28:34.551ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
4322024-06-22T01:28:34.551ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
4332024-06-22T01:28:34.551ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/3e31f9bf-741c-4ad6-aa69-e523a333a2d2/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4342024-06-22T01:28:34.552ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 12033227 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:47463 req_id = 225aca5e-4fad-43b4-ba37-ce08275f861b response_code = 200 uri = /omicron-physical-disks
4352024-06-22T01:28:34.566ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/9f7cbf52-de0d-48c8-9e7d-2958552743a4): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = 9f7cbf52-de0d-48c8-9e7d-2958552743a4
4362024-06-22T01:28:34.582ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: 16c270c1-86b1-4539-8ef1-755ae423741a, underlay_address: fd00:1122:3344:1::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fd49fe38-f2ec-424b-a36d-fe54014bb3a5 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 369f0bed-8434-484e-b9e8-c1ffc7a84eb2, underlay_address: fd00:1122:3344:2::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c9d3163d-8113-4008-b362-43292ae5be54 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 511145a8-e42e-4796-b335-b2401f9e65a1, underlay_address: fd00:1122:3344:3::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8c04dded-f22c-49d5-9c59-b5b4be2cf536 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:431 sled_address = [fd00:1122:3344:101::1]:12345
4372024-06-22T01:28:34.582ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54021
4382024-06-22T01:28:34.582ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 16c270c1-86b1-4539-8ef1-755ae423741a, dataset_name: DatasetName { pool_name: ZpoolName { id: fd49fe38-f2ec-424b-a36d-fe54014bb3a5 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
4392024-06-22T01:28:34.582ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 16c270c1-86b1-4539-8ef1-755ae423741a, dataset_name: DatasetName { pool_name: ZpoolName { id: fd49fe38-f2ec-424b-a36d-fe54014bb3a5 (zpool), kind: External }, kind: InternalDns }, responder: ... }
4402024-06-22T01:28:34.633ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 369f0bed-8434-484e-b9e8-c1ffc7a84eb2, dataset_name: DatasetName { pool_name: ZpoolName { id: c9d3163d-8113-4008-b362-43292ae5be54 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
4412024-06-22T01:28:34.633ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 369f0bed-8434-484e-b9e8-c1ffc7a84eb2, dataset_name: DatasetName { pool_name: ZpoolName { id: c9d3163d-8113-4008-b362-43292ae5be54 (zpool), kind: External }, kind: InternalDns }, responder: ... }
4422024-06-22T01:28:34.683ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 511145a8-e42e-4796-b335-b2401f9e65a1, dataset_name: DatasetName { pool_name: ZpoolName { id: 8c04dded-f22c-49d5-9c59-b5b4be2cf536 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
4432024-06-22T01:28:34.683ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 511145a8-e42e-4796-b335-b2401f9e65a1, dataset_name: DatasetName { pool_name: ZpoolName { id: 8c04dded-f22c-49d5-9c59-b5b4be2cf536 (zpool), kind: External }, kind: InternalDns }, responder: ... }
4442024-06-22T01:28:34.733ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
4452024-06-22T01:28:34.733ZINFOSledAgent (ServiceManager): No ledger in /pool/int/9b2f2513-2520-480a-aa3a-397437db476d/config/omicron-zones.json file = common/src/ledger.rs:188
4462024-06-22T01:28:34.733ZINFOSledAgent (ServiceManager): No ledger in /pool/int/3e31f9bf-741c-4ad6-aa69-e523a333a2d2/config/omicron-zones.json file = common/src/ledger.rs:188
4472024-06-22T01:28:34.733ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
4482024-06-22T01:28:34.778ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
4492024-06-22T01:28:34.779ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
4502024-06-22T01:28:34.779ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
4512024-06-22T01:28:34.832ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_16c270c1-86b1-4539-8ef1-755ae423741a file = illumos-utils/src/zone.rs:315
4522024-06-22T01:28:34.836ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_369f0bed-8434-484e-b9e8-c1ffc7a84eb2 file = illumos-utils/src/zone.rs:315
4532024-06-22T01:28:34.839ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_511145a8-e42e-4796-b335-b2401f9e65a1 file = illumos-utils/src/zone.rs:315
4542024-06-22T01:28:34.853ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_16c270c1-86b1-4539-8ef1-755ae423741a file = illumos-utils/src/zone.rs:354
4552024-06-22T01:28:34.857ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_369f0bed-8434-484e-b9e8-c1ffc7a84eb2 file = illumos-utils/src/zone.rs:354
4562024-06-22T01:28:34.861ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_511145a8-e42e-4796-b335-b2401f9e65a1 file = illumos-utils/src/zone.rs:354
4572024-06-22T01:28:35.569ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/9f7cbf52-de0d-48c8-9e7d-2958552743a4): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = 9f7cbf52-de0d-48c8-9e7d-2958552743a4
4582024-06-22T01:28:35.802ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/9f7cbf52-de0d-48c8-9e7d-2958552743a4): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:619 sled_id = 9f7cbf52-de0d-48c8-9e7d-2958552743a4
4592024-06-22T01:28:36.419ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_511145a8-e42e-4796-b335-b2401f9e65a1: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService3"/> <propval type="astring" name="gateway" value="fd00:1122:3344:3::2"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:3::1"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value="[fd00:1122:3344:3::1]:5353"/> <propval type="astring" name="dns_address" value="[fd00:1122:3344:3::1]:53"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
4602024-06-22T01:28:36.419ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:87 prefix = Ipv6Prefix { addr: fd00:1122:3344:3::, len: 64 }
4612024-06-22T01:28:36.419ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_internal_dns_511145a8-e42e-4796-b335-b2401f9e65a1
4622024-06-22T01:28:36.907ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_16c270c1-86b1-4539-8ef1-755ae423741a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService1"/> <propval type="astring" name="gateway" value="fd00:1122:3344:1::2"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:1::1"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value="[fd00:1122:3344:1::1]:5353"/> <propval type="astring" name="dns_address" value="[fd00:1122:3344:1::1]:53"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
4632024-06-22T01:28:37.387ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:87 prefix = Ipv6Prefix { addr: fd00:1122:3344:1::, len: 64 }
4642024-06-22T01:28:37.387ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_369f0bed-8434-484e-b9e8-c1ffc7a84eb2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService2"/> <propval type="astring" name="gateway" value="fd00:1122:3344:2::2"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:2::1"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value="[fd00:1122:3344:2::1]:5353"/> <propval type="astring" name="dns_address" value="[fd00:1122:3344:2::1]:53"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
4652024-06-22T01:28:37.394ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_511145a8-e42e-4796-b335-b2401f9e65a1") failed: Property not found. retry in 67.194585ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_511145a8-e42e-4796-b335-b2401f9e65a1
4662024-06-22T01:28:37.394ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:87 prefix = Ipv6Prefix { addr: fd00:1122:3344:2::, len: 64 }
4672024-06-22T01:28:37.394ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_internal_dns_16c270c1-86b1-4539-8ef1-755ae423741a
4682024-06-22T01:28:37.399ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_internal_dns_369f0bed-8434-484e-b9e8-c1ffc7a84eb2
4692024-06-22T01:28:37.472ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_511145a8-e42e-4796-b335-b2401f9e65a1") failed: Property not found. retry in 82.369301ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_511145a8-e42e-4796-b335-b2401f9e65a1
4702024-06-22T01:28:37.523ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_16c270c1-86b1-4539-8ef1-755ae423741a") failed: Property not found. retry in 72.867113ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_16c270c1-86b1-4539-8ef1-755ae423741a
4712024-06-22T01:28:37.529ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_369f0bed-8434-484e-b9e8-c1ffc7a84eb2") failed: Property not found. retry in 53.927345ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_369f0bed-8434-484e-b9e8-c1ffc7a84eb2
4722024-06-22T01:28:37.563ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_511145a8-e42e-4796-b335-b2401f9e65a1") failed: Property not found. retry in 246.90959ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_511145a8-e42e-4796-b335-b2401f9e65a1
4732024-06-22T01:28:37.592ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_369f0bed-8434-484e-b9e8-c1ffc7a84eb2") failed: Property not found. retry in 143.19807ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_369f0bed-8434-484e-b9e8-c1ffc7a84eb2
4742024-06-22T01:28:37.688ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_16c270c1-86b1-4539-8ef1-755ae423741a") failed: Property not found. retry in 58.647175ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_16c270c1-86b1-4539-8ef1-755ae423741a
4752024-06-22T01:28:37.863ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_369f0bed-8434-484e-b9e8-c1ffc7a84eb2") failed: Property not found. retry in 237.337178ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_369f0bed-8434-484e-b9e8-c1ffc7a84eb2
4762024-06-22T01:28:37.881ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_16c270c1-86b1-4539-8ef1-755ae423741a") failed: Property not found. retry in 142.423906ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_16c270c1-86b1-4539-8ef1-755ae423741a
4772024-06-22T01:28:37.892ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_511145a8-e42e-4796-b335-b2401f9e65a1") failed: Property not found. retry in 327.005975ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_511145a8-e42e-4796-b335-b2401f9e65a1
4782024-06-22T01:28:38.049ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_16c270c1-86b1-4539-8ef1-755ae423741a") failed: Property not found. retry in 229.382609ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_16c270c1-86b1-4539-8ef1-755ae423741a
4792024-06-22T01:28:38.112ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_369f0bed-8434-484e-b9e8-c1ffc7a84eb2") failed: Property not found. retry in 516.553287ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_369f0bed-8434-484e-b9e8-c1ffc7a84eb2
4802024-06-22T01:28:38.230ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_511145a8-e42e-4796-b335-b2401f9e65a1") failed: Property not found. retry in 661.803183ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_511145a8-e42e-4796-b335-b2401f9e65a1
4812024-06-22T01:28:38.289ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_16c270c1-86b1-4539-8ef1-755ae423741a") failed: Property not found. retry in 664.835822ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_16c270c1-86b1-4539-8ef1-755ae423741a
4822024-06-22T01:28:38.637ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_369f0bed-8434-484e-b9e8-c1ffc7a84eb2") failed: Property not found. retry in 963.897065ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_369f0bed-8434-484e-b9e8-c1ffc7a84eb2
4832024-06-22T01:28:38.902ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_511145a8-e42e-4796-b335-b2401f9e65a1") failed: Property not found. retry in 1.048985711s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_511145a8-e42e-4796-b335-b2401f9e65a1
4842024-06-22T01:28:38.963ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_16c270c1-86b1-4539-8ef1-755ae423741a") failed: Property not found. retry in 625.933465ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_16c270c1-86b1-4539-8ef1-755ae423741a
4852024-06-22T01:28:39.599ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_16c270c1-86b1-4539-8ef1-755ae423741a") failed: Property not found. retry in 1.099540973s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_16c270c1-86b1-4539-8ef1-755ae423741a
4862024-06-22T01:28:39.610ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_369f0bed-8434-484e-b9e8-c1ffc7a84eb2") failed: Property not found. retry in 1.291299879s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_369f0bed-8434-484e-b9e8-c1ffc7a84eb2
4872024-06-22T01:28:39.961ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_511145a8-e42e-4796-b335-b2401f9e65a1") failed: Property not found. retry in 1.138751051s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_511145a8-e42e-4796-b335-b2401f9e65a1
4882024-06-22T01:28:40.160ZINFOSledAgent (ServiceManager): Ensuring bootstrap address fdb0:18c0:4d0d:a02a::2 exists in switch zone file = sled-agent/src/services.rs:2250
4892024-06-22T01:28:40.160ZINFOSledAgent (ServiceManager): Adding bootstrap address file = illumos-utils/src/running_zone.rs:626 zone = oxz_switch
4902024-06-22T01:28:40.709ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_16c270c1-86b1-4539-8ef1-755ae423741a") failed: Property not found. retry in 1.261999128s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_16c270c1-86b1-4539-8ef1-755ae423741a
4912024-06-22T01:28:40.710ZINFOSledAgent (ServiceManager): Forwarding bootstrap traffic via oxBootstrap0 to fe80::8:20ff:fee0:4e79 file = sled-agent/src/services.rs:2257
4922024-06-22T01:28:40.715ZINFOSledAgent (ServiceManager): Zone not using gateway (even though underlay is up) file = sled-agent/src/services.rs:2318
4932024-06-22T01:28:40.836ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2503
4942024-06-22T01:28:40.911ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_369f0bed-8434-484e-b9e8-c1ffc7a84eb2") failed: Property not found. retry in 623.051817ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_369f0bed-8434-484e-b9e8-c1ffc7a84eb2
4952024-06-22T01:28:41.075ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2667
4962024-06-22T01:28:41.109ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_511145a8-e42e-4796-b335-b2401f9e65a1") failed: Property not found. retry in 937.893683ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_511145a8-e42e-4796-b335-b2401f9e65a1
4972024-06-22T01:28:41.262ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2382
4982024-06-22T01:28:41.543ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_369f0bed-8434-484e-b9e8-c1ffc7a84eb2") failed: Property not found. retry in 561.79683ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_369f0bed-8434-484e-b9e8-c1ffc7a84eb2
4992024-06-22T01:28:41.558ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2417
5002024-06-22T01:28:41.762ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:2717
5012024-06-22T01:28:41.936ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:2744
5022024-06-22T01:28:41.983ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_16c270c1-86b1-4539-8ef1-755ae423741a") failed: Property not found. retry in 799.542311ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_16c270c1-86b1-4539-8ef1-755ae423741a
5032024-06-22T01:28:42.056ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_511145a8-e42e-4796-b335-b2401f9e65a1") failed: Property not found. retry in 1.340362395s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_511145a8-e42e-4796-b335-b2401f9e65a1
5042024-06-22T01:28:42.114ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_369f0bed-8434-484e-b9e8-c1ffc7a84eb2") failed: Property not found. retry in 799.445715ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_369f0bed-8434-484e-b9e8-c1ffc7a84eb2
5052024-06-22T01:28:42.154ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2611
5062024-06-22T01:28:42.329ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2411
5072024-06-22T01:28:42.339ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:3803 new = [fd00:1122:3344:101::2, ::1] old = [::1]
5082024-06-22T01:28:42.339ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:3819
5092024-06-22T01:28:42.339ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:609 zone = oxz_switch
5102024-06-22T01:28:42.792ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_16c270c1-86b1-4539-8ef1-755ae423741a") failed: Property not found. retry in 596.741165ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_16c270c1-86b1-4539-8ef1-755ae423741a
5112024-06-22T01:28:42.895ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:3827
5122024-06-22T01:28:42.901ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:3883
5132024-06-22T01:28:42.923ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_369f0bed-8434-484e-b9e8-c1ffc7a84eb2") failed: Property not found. retry in 1.003185047s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_369f0bed-8434-484e-b9e8-c1ffc7a84eb2
5142024-06-22T01:28:43.032ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:3945
5152024-06-22T01:28:43.132ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:3926 rack_subnet = fd00:1122:3344::
5162024-06-22T01:28:43.155ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:3973
5172024-06-22T01:28:43.255ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4000
5182024-06-22T01:28:43.380ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:369
5192024-06-22T01:28:43.425ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:417
5202024-06-22T01:28:43.460ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:656
5212024-06-22T01:28:43.460ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:694
5222024-06-22T01:28:43.461ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:697 uptime = 3
5232024-06-22T01:28:43.461ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.2.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: None,\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:439
5242024-06-22T01:28:43.543ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:381
5252024-06-22T01:28:43.543ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
5262024-06-22T01:28:43.543ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
5272024-06-22T01:28:43.543ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
5282024-06-22T01:28:43.543ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
5292024-06-22T01:28:43.543ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
5302024-06-22T01:28:43.543ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
5312024-06-22T01:28:43.543ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
5322024-06-22T01:28:43.543ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
5332024-06-22T01:28:43.543ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
5342024-06-22T01:28:43.543ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
5352024-06-22T01:28:43.543ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
5362024-06-22T01:28:43.543ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
5372024-06-22T01:28:43.543ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
5382024-06-22T01:28:43.543ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
5392024-06-22T01:28:43.543ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
5402024-06-22T01:28:43.543ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
5412024-06-22T01:28:43.543ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
5422024-06-22T01:28:43.543ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
5432024-06-22T01:28:43.543ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
5442024-06-22T01:28:43.543ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
5452024-06-22T01:28:43.543ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
5462024-06-22T01:28:43.543ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
5472024-06-22T01:28:43.948ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2956 zone = oxz_internal_dns_16c270c1-86b1-4539-8ef1-755ae423741a
5482024-06-22T01:28:43.948ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2956 zone = oxz_internal_dns_369f0bed-8434-484e-b9e8-c1ffc7a84eb2
5492024-06-22T01:28:43.948ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2956 zone = oxz_internal_dns_511145a8-e42e-4796-b335-b2401f9e65a1
5502024-06-22T01:28:43.948ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/9b2f2513-2520-480a-aa3a-397437db476d/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
5512024-06-22T01:28:43.948ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/3e31f9bf-741c-4ad6-aa69-e523a333a2d2/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
5522024-06-22T01:28:43.949ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 9366512 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:54021 req_id = bcfb7d37-8007-4a87-bb8d-3c20e5df1e9f response_code = 204 uri = /omicron-zones
5532024-06-22T01:28:43.951ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:549
5542024-06-22T01:28:44.434ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 133.993161ms) dns_config_addr = [fd00:1122:3344:1::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:1::1]:5353/config): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:569
5552024-06-22T01:28:44.604ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:549
5562024-06-22T01:28:44.701ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 66.258959ms) dns_config_addr = [fd00:1122:3344:2::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:2::1]:5353/config): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:569
5572024-06-22T01:28:44.768ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 115.350606ms) dns_config_addr = [fd00:1122:3344:2::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:2::1]:5353/config): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:569
5582024-06-22T01:28:44.920ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:549
5592024-06-22T01:28:44.999ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:585
5602024-06-22T01:28:44.999ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:263
5612024-06-22T01:28:45.029ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:280
5622024-06-22T01:28:45.029ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:305
5632024-06-22T01:28:45.029ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:197
5642024-06-22T01:28:45.057ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: 16c270c1-86b1-4539-8ef1-755ae423741a, underlay_address: fd00:1122:3344:1::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fd49fe38-f2ec-424b-a36d-fe54014bb3a5 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 369f0bed-8434-484e-b9e8-c1ffc7a84eb2, underlay_address: fd00:1122:3344:2::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c9d3163d-8113-4008-b362-43292ae5be54 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 511145a8-e42e-4796-b335-b2401f9e65a1, underlay_address: fd00:1122:3344:3::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8c04dded-f22c-49d5-9c59-b5b4be2cf536 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 4df9d50e-e00c-441d-9492-d80e07740151, underlay_address: fd00:1122:3344:101::1b, zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 80783f4b-33f4-40ae-bed8-5120256f0172, kind: Service { id: 4df9d50e-e00c-441d-9492-d80e07740151 }, name: Name("ntp-4df9d50e-e00c-441d-9492-d80e07740151"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 219, 126])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:431 sled_address = [fd00:1122:3344:101::1]:12345
5652024-06-22T01:28:45.057ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35326
5662024-06-22T01:28:45.058ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 16c270c1-86b1-4539-8ef1-755ae423741a, dataset_name: DatasetName { pool_name: ZpoolName { id: fd49fe38-f2ec-424b-a36d-fe54014bb3a5 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
5672024-06-22T01:28:45.058ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 16c270c1-86b1-4539-8ef1-755ae423741a, dataset_name: DatasetName { pool_name: ZpoolName { id: fd49fe38-f2ec-424b-a36d-fe54014bb3a5 (zpool), kind: External }, kind: InternalDns }, responder: ... }
5682024-06-22T01:28:45.087ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 369f0bed-8434-484e-b9e8-c1ffc7a84eb2, dataset_name: DatasetName { pool_name: ZpoolName { id: c9d3163d-8113-4008-b362-43292ae5be54 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
5692024-06-22T01:28:45.087ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 369f0bed-8434-484e-b9e8-c1ffc7a84eb2, dataset_name: DatasetName { pool_name: ZpoolName { id: c9d3163d-8113-4008-b362-43292ae5be54 (zpool), kind: External }, kind: InternalDns }, responder: ... }
5702024-06-22T01:28:45.107ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 511145a8-e42e-4796-b335-b2401f9e65a1, dataset_name: DatasetName { pool_name: ZpoolName { id: 8c04dded-f22c-49d5-9c59-b5b4be2cf536 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
5712024-06-22T01:28:45.107ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 511145a8-e42e-4796-b335-b2401f9e65a1, dataset_name: DatasetName { pool_name: ZpoolName { id: 8c04dded-f22c-49d5-9c59-b5b4be2cf536 (zpool), kind: External }, kind: InternalDns }, responder: ... }
5722024-06-22T01:28:45.125ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
5732024-06-22T01:28:45.125ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/9b2f2513-2520-480a-aa3a-397437db476d/config/omicron-zones.json file = common/src/ledger.rs:177
5742024-06-22T01:28:45.125ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/3e31f9bf-741c-4ad6-aa69-e523a333a2d2/config/omicron-zones.json file = common/src/ledger.rs:177
5752024-06-22T01:28:45.125ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
5762024-06-22T01:28:45.136ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:263
5772024-06-22T01:28:45.168ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:280
5782024-06-22T01:28:45.169ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:305
5792024-06-22T01:28:45.169ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:197
5802024-06-22T01:28:45.213ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:393 port = Port { inner: PortInner { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 219, 126]), slot: 0, vni: Vni { inner: 100 }, gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 }, vnic: "vopte0" } }
5812024-06-22T01:28:45.213ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1190 zone_type = ntp
5822024-06-22T01:28:45.213ZINFOSledAgent (ServiceManager): no nat entry found for: V4( Ipv4Network { addr: 10.151.2.169, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:102
5832024-06-22T01:28:45.213ZINFOSledAgent (ServiceManager): creating nat entry for: V4( Ipv4Network { addr: 10.151.2.169, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:109
5842024-06-22T01:28:45.214ZINFOSledAgent (ServiceManager): creation of nat entry successful for: V4( Ipv4Network { addr: 10.151.2.169, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:137
5852024-06-22T01:28:45.215ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
5862024-06-22T01:28:45.237ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_4df9d50e-e00c-441d-9492-d80e07740151 file = illumos-utils/src/zone.rs:315
5872024-06-22T01:28:45.255ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_4df9d50e-e00c-441d-9492-d80e07740151 file = illumos-utils/src/zone.rs:354
5882024-06-22T01:28:45.900ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_4df9d50e-e00c-441d-9492-d80e07740151: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService4"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::1b"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value="fd00:1122:3344:100::/56"/> <propval type="boolean" name="boundary" value="true"/> <propval type="astring" name="server" value="0.pool.ntp.org"/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value="vopte0"/> <propval type="astring" name="gateway" value="172.30.3.1"/> <propval type="astring" name="ip" value="172.30.3.5"/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
5892024-06-22T01:28:45.900ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_ntp_4df9d50e-e00c-441d-9492-d80e07740151
5902024-06-22T01:28:46.041ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_4df9d50e-e00c-441d-9492-d80e07740151") failed: Property not found. retry in 59.715046ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_4df9d50e-e00c-441d-9492-d80e07740151
5912024-06-22T01:28:46.117ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_4df9d50e-e00c-441d-9492-d80e07740151") failed: Property not found. retry in 67.355189ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_4df9d50e-e00c-441d-9492-d80e07740151
5922024-06-22T01:28:46.211ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_4df9d50e-e00c-441d-9492-d80e07740151") failed: Property not found. retry in 199.079934ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_4df9d50e-e00c-441d-9492-d80e07740151
5932024-06-22T01:28:46.420ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_4df9d50e-e00c-441d-9492-d80e07740151") failed: Property not found. retry in 430.83049ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_4df9d50e-e00c-441d-9492-d80e07740151
5942024-06-22T01:28:46.860ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_4df9d50e-e00c-441d-9492-d80e07740151") failed: Property not found. retry in 978.460288ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_4df9d50e-e00c-441d-9492-d80e07740151
5952024-06-22T01:28:46.907ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:59759
5962024-06-22T01:28:46.908ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 85 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:59759 req_id = bcd41061-3682-416b-a5dd-31e90aa84099 response_code = 200 uri = /baseboard
5972024-06-22T01:28:47.850ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_4df9d50e-e00c-441d-9492-d80e07740151") failed: Property not found. retry in 1.090426425s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_4df9d50e-e00c-441d-9492-d80e07740151
5982024-06-22T01:28:48.951ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_4df9d50e-e00c-441d-9492-d80e07740151") failed: Property not found. retry in 713.782519ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_4df9d50e-e00c-441d-9492-d80e07740151
5992024-06-22T01:28:49.675ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_4df9d50e-e00c-441d-9492-d80e07740151") failed: Property not found. retry in 1.084294213s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_4df9d50e-e00c-441d-9492-d80e07740151
6002024-06-22T01:28:50.768ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_4df9d50e-e00c-441d-9492-d80e07740151") failed: Property not found. retry in 1.185779275s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_4df9d50e-e00c-441d-9492-d80e07740151
6012024-06-22T01:28:51.973ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2956 zone = oxz_ntp_4df9d50e-e00c-441d-9492-d80e07740151
6022024-06-22T01:28:51.973ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/9b2f2513-2520-480a-aa3a-397437db476d/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
6032024-06-22T01:28:51.974ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/3e31f9bf-741c-4ad6-aa69-e523a333a2d2/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
6042024-06-22T01:28:51.974ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 6916488 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:35326 req_id = dd281009-ca44-4f34-a4df-c300190f0117 response_code = 204 uri = /omicron-zones
6052024-06-22T01:28:51.976ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:626
6062024-06-22T01:28:52.005ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6072024-06-22T01:28:52.005ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40125
6082024-06-22T01:28:52.015ZINFOSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_4df9d50e-e00c-441d-9492-d80e07740151': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3533
6092024-06-22T01:28:52.015ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:866 latency_us = 9896 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40125 req_id = 2ce86252-8d4d-4c58-8d75-b0676019c8ec response_code = 500 uri = /timesync
6102024-06-22T01:28:52.017ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6112024-06-22T01:28:52.162ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6122024-06-22T01:28:52.162ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41297
6132024-06-22T01:28:56.170ZINFOSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_4df9d50e-e00c-441d-9492-d80e07740151': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3533
6142024-06-22T01:28:56.170ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:866 latency_us = 4008071 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41297 req_id = 480ddf55-312b-4a35-a3bc-378862faed3b response_code = 500 uri = /timesync
6152024-06-22T01:28:56.173ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6162024-06-22T01:28:56.265ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6172024-06-22T01:28:56.266ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59401
6182024-06-22T01:28:56.275ZINFOSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_4df9d50e-e00c-441d-9492-d80e07740151': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3533
6192024-06-22T01:28:56.275ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:866 latency_us = 9068 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:59401 req_id = 9d9c36bf-e136-4108-977d-5501f05b2898 response_code = 500 uri = /timesync
6202024-06-22T01:28:56.277ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6212024-06-22T01:28:56.383ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6222024-06-22T01:28:56.383ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37618
6232024-06-22T01:29:00.392ZINFOSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_4df9d50e-e00c-441d-9492-d80e07740151': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3533
6242024-06-22T01:29:00.392ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:866 latency_us = 4008787 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:37618 req_id = f35dd6c7-54f1-4b8e-a1a6-e5a5501cb604 response_code = 500 uri = /timesync
6252024-06-22T01:29:00.395ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6262024-06-22T01:29:00.548ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6272024-06-22T01:29:00.548ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57238
6282024-06-22T01:29:00.558ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 9486 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:57238 req_id = e2e7c02a-162f-4d5e-8987-76853dba5056 response_code = 200 uri = /timesync
6292024-06-22T01:29:00.561ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:634
6302024-06-22T01:29:00.561ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6312024-06-22T01:29:00.790ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6322024-06-22T01:29:00.790ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54419
6332024-06-22T01:29:00.799ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 8575 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:54419 req_id = dfbe0b0e-f934-4080-a187-da38f062d4d3 response_code = 200 uri = /timesync
6342024-06-22T01:29:00.800ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:634
6352024-06-22T01:29:00.800ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6362024-06-22T01:29:01.067ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6372024-06-22T01:29:01.068ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37673
6382024-06-22T01:29:01.077ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 9172 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:37673 req_id = 3459e990-af0e-4626-a650-59758819a69c response_code = 200 uri = /timesync
6392024-06-22T01:29:01.079ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:634
6402024-06-22T01:29:01.079ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6412024-06-22T01:29:01.404ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6422024-06-22T01:29:01.405ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60422
6432024-06-22T01:29:01.413ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 8533 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:60422 req_id = 31743d44-5edb-4ecd-a45b-a5bd34786769 response_code = 200 uri = /timesync
6442024-06-22T01:29:01.417ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:634
6452024-06-22T01:29:01.417ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6462024-06-22T01:29:01.864ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6472024-06-22T01:29:01.864ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37365
6482024-06-22T01:29:01.872ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 8157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:37365 req_id = 66d9dda1-d685-4403-948b-b6e3ad5340f9 response_code = 200 uri = /timesync
6492024-06-22T01:29:01.875ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:634
6502024-06-22T01:29:01.875ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6512024-06-22T01:29:02.010ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 174.948348ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:417 sled_id = 9f7cbf52-de0d-48c8-9e7d-2958552743a4
6522024-06-22T01:29:02.006ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6532024-06-22T01:29:02.006ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62784
6542024-06-22T01:29:02.028ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 21329 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:62784 req_id = 30ca4659-8bdf-48a5-ae77-cc698a04961b response_code = 200 uri = /timesync
6552024-06-22T01:29:02.030ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 1753455535, ip_addr: 104.131.155.175, stratum: 3, ref_time: 1719019741.1523974, correction: -0.0 } file = sled-agent/src/rack_setup/service.rs:634
6562024-06-22T01:29:02.030ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1224
6572024-06-22T01:29:02.058ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 16c270c1-86b1-4539-8ef1-755ae423741a, underlay_address: fd00:1122:3344:1::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fd49fe38-f2ec-424b-a36d-fe54014bb3a5 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 369f0bed-8434-484e-b9e8-c1ffc7a84eb2, underlay_address: fd00:1122:3344:2::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c9d3163d-8113-4008-b362-43292ae5be54 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 511145a8-e42e-4796-b335-b2401f9e65a1, underlay_address: fd00:1122:3344:3::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8c04dded-f22c-49d5-9c59-b5b4be2cf536 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 4df9d50e-e00c-441d-9492-d80e07740151, underlay_address: fd00:1122:3344:101::1b, zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 80783f4b-33f4-40ae-bed8-5120256f0172, kind: Service { id: 4df9d50e-e00c-441d-9492-d80e07740151 }, name: Name("ntp-4df9d50e-e00c-441d-9492-d80e07740151"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 219, 126])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: b1941e54-49ca-46c6-a122-bfb5a01d4548, underlay_address: fd00:1122:3344:101::3, zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fd49fe38-f2ec-424b-a36d-fe54014bb3a5 (zpool), kind: External } } } }, OmicronZoneConfig { id: e2c56625-46ac-4698-94ad-89db3c5ee30a, underlay_address: fd00:1122:3344:101::4, zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c9d3163d-8113-4008-b362-43292ae5be54 (zpool), kind: External } } } }, OmicronZoneConfig { id: cec07120-bde1-43be-9015-cc9c80e47619, underlay_address: fd00:1122:3344:101::5, zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8c04dded-f22c-49d5-9c59-b5b4be2cf536 (zpool), kind: External } } } }, OmicronZoneConfig { id: e3f38eaa-8bbf-4b04-90bd-aaac0c891458, underlay_address: fd00:1122:3344:101::6, zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a9e6c25d-f1e0-4d21-b66f-63e2ac90bcb3 (zpool), kind: External } } } }, OmicronZoneConfig { id: bd80ac72-c82c-4ce9-bc52-67f1a196a500, underlay_address: fd00:1122:3344:101::7, zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b14a31e4-ac90-49a4-967f-505e8d513a31 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:431 sled_address = [fd00:1122:3344:101::1]:12345
6582024-06-22T01:29:02.059ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38169
6592024-06-22T01:29:02.059ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 16c270c1-86b1-4539-8ef1-755ae423741a, dataset_name: DatasetName { pool_name: ZpoolName { id: fd49fe38-f2ec-424b-a36d-fe54014bb3a5 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
6602024-06-22T01:29:02.059ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 16c270c1-86b1-4539-8ef1-755ae423741a, dataset_name: DatasetName { pool_name: ZpoolName { id: fd49fe38-f2ec-424b-a36d-fe54014bb3a5 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6612024-06-22T01:29:02.079ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 369f0bed-8434-484e-b9e8-c1ffc7a84eb2, dataset_name: DatasetName { pool_name: ZpoolName { id: c9d3163d-8113-4008-b362-43292ae5be54 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
6622024-06-22T01:29:02.079ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 369f0bed-8434-484e-b9e8-c1ffc7a84eb2, dataset_name: DatasetName { pool_name: ZpoolName { id: c9d3163d-8113-4008-b362-43292ae5be54 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6632024-06-22T01:29:02.098ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 511145a8-e42e-4796-b335-b2401f9e65a1, dataset_name: DatasetName { pool_name: ZpoolName { id: 8c04dded-f22c-49d5-9c59-b5b4be2cf536 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
6642024-06-22T01:29:02.098ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 511145a8-e42e-4796-b335-b2401f9e65a1, dataset_name: DatasetName { pool_name: ZpoolName { id: 8c04dded-f22c-49d5-9c59-b5b4be2cf536 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6652024-06-22T01:29:02.116ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: b1941e54-49ca-46c6-a122-bfb5a01d4548, dataset_name: DatasetName { pool_name: ZpoolName { id: fd49fe38-f2ec-424b-a36d-fe54014bb3a5 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
6662024-06-22T01:29:02.116ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: b1941e54-49ca-46c6-a122-bfb5a01d4548, dataset_name: DatasetName { pool_name: ZpoolName { id: fd49fe38-f2ec-424b-a36d-fe54014bb3a5 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
6672024-06-22T01:29:02.197ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e2c56625-46ac-4698-94ad-89db3c5ee30a, dataset_name: DatasetName { pool_name: ZpoolName { id: c9d3163d-8113-4008-b362-43292ae5be54 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
6682024-06-22T01:29:02.197ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: e2c56625-46ac-4698-94ad-89db3c5ee30a, dataset_name: DatasetName { pool_name: ZpoolName { id: c9d3163d-8113-4008-b362-43292ae5be54 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
6692024-06-22T01:29:02.274ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: cec07120-bde1-43be-9015-cc9c80e47619, dataset_name: DatasetName { pool_name: ZpoolName { id: 8c04dded-f22c-49d5-9c59-b5b4be2cf536 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
6702024-06-22T01:29:02.274ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: cec07120-bde1-43be-9015-cc9c80e47619, dataset_name: DatasetName { pool_name: ZpoolName { id: 8c04dded-f22c-49d5-9c59-b5b4be2cf536 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
6712024-06-22T01:29:02.343ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e3f38eaa-8bbf-4b04-90bd-aaac0c891458, dataset_name: DatasetName { pool_name: ZpoolName { id: a9e6c25d-f1e0-4d21-b66f-63e2ac90bcb3 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
6722024-06-22T01:29:02.343ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: e3f38eaa-8bbf-4b04-90bd-aaac0c891458, dataset_name: DatasetName { pool_name: ZpoolName { id: a9e6c25d-f1e0-4d21-b66f-63e2ac90bcb3 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
6732024-06-22T01:29:02.426ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: bd80ac72-c82c-4ce9-bc52-67f1a196a500, dataset_name: DatasetName { pool_name: ZpoolName { id: b14a31e4-ac90-49a4-967f-505e8d513a31 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
6742024-06-22T01:29:02.426ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: bd80ac72-c82c-4ce9-bc52-67f1a196a500, dataset_name: DatasetName { pool_name: ZpoolName { id: b14a31e4-ac90-49a4-967f-505e8d513a31 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
6752024-06-22T01:29:02.504ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
6762024-06-22T01:29:02.504ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/9b2f2513-2520-480a-aa3a-397437db476d/config/omicron-zones.json file = common/src/ledger.rs:177
6772024-06-22T01:29:02.504ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/3e31f9bf-741c-4ad6-aa69-e523a333a2d2/config/omicron-zones.json file = common/src/ledger.rs:177
6782024-06-22T01:29:02.505ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
6792024-06-22T01:29:02.586ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
6802024-06-22T01:29:02.586ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
6812024-06-22T01:29:02.586ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
6822024-06-22T01:29:02.586ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
6832024-06-22T01:29:02.586ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
6842024-06-22T01:29:02.675ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_cec07120-bde1-43be-9015-cc9c80e47619 file = illumos-utils/src/zone.rs:315
6852024-06-22T01:29:02.679ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_e2c56625-46ac-4698-94ad-89db3c5ee30a file = illumos-utils/src/zone.rs:315
6862024-06-22T01:29:02.683ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_b1941e54-49ca-46c6-a122-bfb5a01d4548 file = illumos-utils/src/zone.rs:315
6872024-06-22T01:29:02.687ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_bd80ac72-c82c-4ce9-bc52-67f1a196a500 file = illumos-utils/src/zone.rs:315
6882024-06-22T01:29:02.692ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_e3f38eaa-8bbf-4b04-90bd-aaac0c891458 file = illumos-utils/src/zone.rs:315
6892024-06-22T01:29:02.697ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_cec07120-bde1-43be-9015-cc9c80e47619 file = illumos-utils/src/zone.rs:354
6902024-06-22T01:29:02.702ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_e2c56625-46ac-4698-94ad-89db3c5ee30a file = illumos-utils/src/zone.rs:354
6912024-06-22T01:29:02.707ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_b1941e54-49ca-46c6-a122-bfb5a01d4548 file = illumos-utils/src/zone.rs:354
6922024-06-22T01:29:02.712ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_bd80ac72-c82c-4ce9-bc52-67f1a196a500 file = illumos-utils/src/zone.rs:354
6932024-06-22T01:29:02.716ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_e3f38eaa-8bbf-4b04-90bd-aaac0c891458 file = illumos-utils/src/zone.rs:354
6942024-06-22T01:29:05.688ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_bd80ac72-c82c-4ce9-bc52-67f1a196a500: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService8"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::7"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="[fd00:1122:3344:101::7]:32221"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value="bd80ac72-c82c-4ce9-bc52-67f1a196a500"/> <propval type="astring" name="cockroach_address" value="[fd00:1122:3344:101::7]:32221"/> <propval type="astring" name="http_address" value="[fd00:1122:3344:101::7]:32222"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6952024-06-22T01:29:05.688ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_cockroachdb_bd80ac72-c82c-4ce9-bc52-67f1a196a500
6962024-06-22T01:29:05.695ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_cec07120-bde1-43be-9015-cc9c80e47619: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService5"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::5"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="[fd00:1122:3344:101::5]:32221"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value="cec07120-bde1-43be-9015-cc9c80e47619"/> <propval type="astring" name="cockroach_address" value="[fd00:1122:3344:101::5]:32221"/> <propval type="astring" name="http_address" value="[fd00:1122:3344:101::5]:32222"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6972024-06-22T01:29:05.695ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_cockroachdb_cec07120-bde1-43be-9015-cc9c80e47619
6982024-06-22T01:29:05.717ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_e2c56625-46ac-4698-94ad-89db3c5ee30a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService6"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::4"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="[fd00:1122:3344:101::4]:32221"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value="e2c56625-46ac-4698-94ad-89db3c5ee30a"/> <propval type="astring" name="cockroach_address" value="[fd00:1122:3344:101::4]:32221"/> <propval type="astring" name="http_address" value="[fd00:1122:3344:101::4]:32222"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6992024-06-22T01:29:05.717ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_cockroachdb_e2c56625-46ac-4698-94ad-89db3c5ee30a
7002024-06-22T01:29:05.722ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_b1941e54-49ca-46c6-a122-bfb5a01d4548: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService7"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::3"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="[fd00:1122:3344:101::3]:32221"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value="b1941e54-49ca-46c6-a122-bfb5a01d4548"/> <propval type="astring" name="cockroach_address" value="[fd00:1122:3344:101::3]:32221"/> <propval type="astring" name="http_address" value="[fd00:1122:3344:101::3]:32222"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7012024-06-22T01:29:05.722ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_cockroachdb_b1941e54-49ca-46c6-a122-bfb5a01d4548
7022024-06-22T01:29:05.734ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_e3f38eaa-8bbf-4b04-90bd-aaac0c891458: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService9"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::6"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="[fd00:1122:3344:101::6]:32221"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value="e3f38eaa-8bbf-4b04-90bd-aaac0c891458"/> <propval type="astring" name="cockroach_address" value="[fd00:1122:3344:101::6]:32221"/> <propval type="astring" name="http_address" value="[fd00:1122:3344:101::6]:32222"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7032024-06-22T01:29:05.734ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_cockroachdb_e3f38eaa-8bbf-4b04-90bd-aaac0c891458
7042024-06-22T01:29:05.844ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cec07120-bde1-43be-9015-cc9c80e47619") failed: Property not found. retry in 55.947777ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cec07120-bde1-43be-9015-cc9c80e47619
7052024-06-22T01:29:05.854ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bd80ac72-c82c-4ce9-bc52-67f1a196a500") failed: Property not found. retry in 62.429557ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bd80ac72-c82c-4ce9-bc52-67f1a196a500
7062024-06-22T01:29:05.863ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b1941e54-49ca-46c6-a122-bfb5a01d4548") failed: Property not found. retry in 47.596379ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b1941e54-49ca-46c6-a122-bfb5a01d4548
7072024-06-22T01:29:05.871ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e2c56625-46ac-4698-94ad-89db3c5ee30a") failed: Property not found. retry in 27.062944ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e2c56625-46ac-4698-94ad-89db3c5ee30a
7082024-06-22T01:29:05.878ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e3f38eaa-8bbf-4b04-90bd-aaac0c891458") failed: Property not found. retry in 60.079001ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e3f38eaa-8bbf-4b04-90bd-aaac0c891458
7092024-06-22T01:29:06.077ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e2c56625-46ac-4698-94ad-89db3c5ee30a") failed: Property not found. retry in 138.927971ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e2c56625-46ac-4698-94ad-89db3c5ee30a
7102024-06-22T01:29:06.087ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cec07120-bde1-43be-9015-cc9c80e47619") failed: Property not found. retry in 94.759534ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cec07120-bde1-43be-9015-cc9c80e47619
7112024-06-22T01:29:06.118ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b1941e54-49ca-46c6-a122-bfb5a01d4548") failed: Property not found. retry in 92.5973ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b1941e54-49ca-46c6-a122-bfb5a01d4548
7122024-06-22T01:29:06.539ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e2c56625-46ac-4698-94ad-89db3c5ee30a") failed: Property not found. retry in 187.074503ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e2c56625-46ac-4698-94ad-89db3c5ee30a
7132024-06-22T01:29:06.614ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b1941e54-49ca-46c6-a122-bfb5a01d4548") failed: Property not found. retry in 298.949741ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b1941e54-49ca-46c6-a122-bfb5a01d4548
7142024-06-22T01:29:06.889ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bd80ac72-c82c-4ce9-bc52-67f1a196a500") failed: Property not found. retry in 119.881186ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bd80ac72-c82c-4ce9-bc52-67f1a196a500
7152024-06-22T01:29:07.210ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e3f38eaa-8bbf-4b04-90bd-aaac0c891458") failed: Property not found. retry in 51.893514ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e3f38eaa-8bbf-4b04-90bd-aaac0c891458
7162024-06-22T01:29:07.902ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cec07120-bde1-43be-9015-cc9c80e47619") failed: Property not found. retry in 295.620441ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cec07120-bde1-43be-9015-cc9c80e47619
7172024-06-22T01:29:08.796ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e2c56625-46ac-4698-94ad-89db3c5ee30a") failed: Property not found. retry in 377.70481ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e2c56625-46ac-4698-94ad-89db3c5ee30a
7182024-06-22T01:29:08.835ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b1941e54-49ca-46c6-a122-bfb5a01d4548") failed: Property not found. retry in 261.301259ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b1941e54-49ca-46c6-a122-bfb5a01d4548
7192024-06-22T01:29:08.861ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bd80ac72-c82c-4ce9-bc52-67f1a196a500") failed: Property not found. retry in 284.316155ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bd80ac72-c82c-4ce9-bc52-67f1a196a500
7202024-06-22T01:29:08.896ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e3f38eaa-8bbf-4b04-90bd-aaac0c891458") failed: Property not found. retry in 246.220827ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e3f38eaa-8bbf-4b04-90bd-aaac0c891458
7212024-06-22T01:29:08.918ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cec07120-bde1-43be-9015-cc9c80e47619") failed: Property not found. retry in 364.218094ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cec07120-bde1-43be-9015-cc9c80e47619
7222024-06-22T01:29:09.107ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b1941e54-49ca-46c6-a122-bfb5a01d4548") failed: Property not found. retry in 484.374923ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b1941e54-49ca-46c6-a122-bfb5a01d4548
7232024-06-22T01:29:09.152ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e3f38eaa-8bbf-4b04-90bd-aaac0c891458") failed: Property not found. retry in 347.67318ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e3f38eaa-8bbf-4b04-90bd-aaac0c891458
7242024-06-22T01:29:09.161ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bd80ac72-c82c-4ce9-bc52-67f1a196a500") failed: Property not found. retry in 397.386917ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bd80ac72-c82c-4ce9-bc52-67f1a196a500
7252024-06-22T01:29:09.183ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e2c56625-46ac-4698-94ad-89db3c5ee30a") failed: Property not found. retry in 681.373571ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e2c56625-46ac-4698-94ad-89db3c5ee30a
7262024-06-22T01:29:09.292ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cec07120-bde1-43be-9015-cc9c80e47619") failed: Property not found. retry in 462.776556ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cec07120-bde1-43be-9015-cc9c80e47619
7272024-06-22T01:29:09.511ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e3f38eaa-8bbf-4b04-90bd-aaac0c891458") failed: Property not found. retry in 546.235302ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e3f38eaa-8bbf-4b04-90bd-aaac0c891458
7282024-06-22T01:29:09.570ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bd80ac72-c82c-4ce9-bc52-67f1a196a500") failed: Property not found. retry in 721.875214ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bd80ac72-c82c-4ce9-bc52-67f1a196a500
7292024-06-22T01:29:09.603ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b1941e54-49ca-46c6-a122-bfb5a01d4548") failed: Property not found. retry in 1.071250419s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b1941e54-49ca-46c6-a122-bfb5a01d4548
7302024-06-22T01:29:09.765ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cec07120-bde1-43be-9015-cc9c80e47619") failed: Property not found. retry in 1.194430589s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cec07120-bde1-43be-9015-cc9c80e47619
7312024-06-22T01:29:09.875ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e2c56625-46ac-4698-94ad-89db3c5ee30a") failed: Property not found. retry in 731.806526ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e2c56625-46ac-4698-94ad-89db3c5ee30a
7322024-06-22T01:29:10.067ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e3f38eaa-8bbf-4b04-90bd-aaac0c891458") failed: Property not found. retry in 1.415934483s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e3f38eaa-8bbf-4b04-90bd-aaac0c891458
7332024-06-22T01:29:10.302ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bd80ac72-c82c-4ce9-bc52-67f1a196a500") failed: Property not found. retry in 1.445019671s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bd80ac72-c82c-4ce9-bc52-67f1a196a500
7342024-06-22T01:29:10.616ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e2c56625-46ac-4698-94ad-89db3c5ee30a") failed: Property not found. retry in 1.068352546s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e2c56625-46ac-4698-94ad-89db3c5ee30a
7352024-06-22T01:29:10.683ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b1941e54-49ca-46c6-a122-bfb5a01d4548") failed: Property not found. retry in 586.42386ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b1941e54-49ca-46c6-a122-bfb5a01d4548
7362024-06-22T01:29:10.969ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cec07120-bde1-43be-9015-cc9c80e47619") failed: Property not found. retry in 634.473797ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cec07120-bde1-43be-9015-cc9c80e47619
7372024-06-22T01:29:11.279ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b1941e54-49ca-46c6-a122-bfb5a01d4548") failed: Property not found. retry in 1.149681385s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b1941e54-49ca-46c6-a122-bfb5a01d4548
7382024-06-22T01:29:11.492ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e3f38eaa-8bbf-4b04-90bd-aaac0c891458") failed: Property not found. retry in 1.331150225s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e3f38eaa-8bbf-4b04-90bd-aaac0c891458
7392024-06-22T01:29:11.614ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cec07120-bde1-43be-9015-cc9c80e47619") failed: Property not found. retry in 597.544379ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cec07120-bde1-43be-9015-cc9c80e47619
7402024-06-22T01:29:11.693ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e2c56625-46ac-4698-94ad-89db3c5ee30a") failed: Property not found. retry in 636.069101ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e2c56625-46ac-4698-94ad-89db3c5ee30a
7412024-06-22T01:29:11.756ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bd80ac72-c82c-4ce9-bc52-67f1a196a500") failed: Property not found. retry in 1.076496922s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bd80ac72-c82c-4ce9-bc52-67f1a196a500
7422024-06-22T01:29:12.222ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cec07120-bde1-43be-9015-cc9c80e47619") failed: Property not found. retry in 892.594092ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cec07120-bde1-43be-9015-cc9c80e47619
7432024-06-22T01:29:12.338ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e2c56625-46ac-4698-94ad-89db3c5ee30a") failed: Property not found. retry in 581.265424ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e2c56625-46ac-4698-94ad-89db3c5ee30a
7442024-06-22T01:29:12.438ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b1941e54-49ca-46c6-a122-bfb5a01d4548") failed: Property not found. retry in 709.410202ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b1941e54-49ca-46c6-a122-bfb5a01d4548
7452024-06-22T01:29:12.832ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e3f38eaa-8bbf-4b04-90bd-aaac0c891458") failed: Property not found. retry in 1.133086908s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e3f38eaa-8bbf-4b04-90bd-aaac0c891458
7462024-06-22T01:29:12.842ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bd80ac72-c82c-4ce9-bc52-67f1a196a500") failed: Property not found. retry in 713.90821ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bd80ac72-c82c-4ce9-bc52-67f1a196a500
7472024-06-22T01:29:12.928ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e2c56625-46ac-4698-94ad-89db3c5ee30a") failed: Property not found. retry in 546.615223ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e2c56625-46ac-4698-94ad-89db3c5ee30a
7482024-06-22T01:29:13.123ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cec07120-bde1-43be-9015-cc9c80e47619") failed: Property not found. retry in 923.116637ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cec07120-bde1-43be-9015-cc9c80e47619
7492024-06-22T01:29:13.156ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b1941e54-49ca-46c6-a122-bfb5a01d4548") failed: Property not found. retry in 650.663012ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b1941e54-49ca-46c6-a122-bfb5a01d4548
7502024-06-22T01:29:13.506ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e2c56625-46ac-4698-94ad-89db3c5ee30a") failed: Property not found. retry in 1.404155634s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e2c56625-46ac-4698-94ad-89db3c5ee30a
7512024-06-22T01:29:13.566ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bd80ac72-c82c-4ce9-bc52-67f1a196a500") failed: Property not found. retry in 530.75282ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bd80ac72-c82c-4ce9-bc52-67f1a196a500
7522024-06-22T01:29:13.817ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b1941e54-49ca-46c6-a122-bfb5a01d4548") failed: Property not found. retry in 822.29008ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b1941e54-49ca-46c6-a122-bfb5a01d4548
7532024-06-22T01:29:13.976ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e3f38eaa-8bbf-4b04-90bd-aaac0c891458") failed: Property not found. retry in 1.452682631s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e3f38eaa-8bbf-4b04-90bd-aaac0c891458
7542024-06-22T01:29:14.056ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cec07120-bde1-43be-9015-cc9c80e47619") failed: Property not found. retry in 1.475569548s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cec07120-bde1-43be-9015-cc9c80e47619
7552024-06-22T01:29:14.109ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bd80ac72-c82c-4ce9-bc52-67f1a196a500") failed: Property not found. retry in 1.475981202s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bd80ac72-c82c-4ce9-bc52-67f1a196a500
7562024-06-22T01:29:14.651ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b1941e54-49ca-46c6-a122-bfb5a01d4548") failed: Property not found. retry in 915.846663ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b1941e54-49ca-46c6-a122-bfb5a01d4548
7572024-06-22T01:29:14.924ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e2c56625-46ac-4698-94ad-89db3c5ee30a") failed: Property not found. retry in 933.176623ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e2c56625-46ac-4698-94ad-89db3c5ee30a
7582024-06-22T01:29:15.438ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e3f38eaa-8bbf-4b04-90bd-aaac0c891458") failed: Property not found. retry in 511.155383ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e3f38eaa-8bbf-4b04-90bd-aaac0c891458
7592024-06-22T01:29:15.540ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cec07120-bde1-43be-9015-cc9c80e47619") failed: Property not found. retry in 691.586849ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cec07120-bde1-43be-9015-cc9c80e47619
7602024-06-22T01:29:15.576ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b1941e54-49ca-46c6-a122-bfb5a01d4548") failed: Property not found. retry in 551.823683ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b1941e54-49ca-46c6-a122-bfb5a01d4548
7612024-06-22T01:29:15.593ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bd80ac72-c82c-4ce9-bc52-67f1a196a500") failed: Property not found. retry in 617.507319ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bd80ac72-c82c-4ce9-bc52-67f1a196a500
7622024-06-22T01:29:15.865ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e2c56625-46ac-4698-94ad-89db3c5ee30a") failed: Property not found. retry in 1.096273547s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e2c56625-46ac-4698-94ad-89db3c5ee30a
7632024-06-22T01:29:15.957ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e3f38eaa-8bbf-4b04-90bd-aaac0c891458") failed: Property not found. retry in 641.499678ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e3f38eaa-8bbf-4b04-90bd-aaac0c891458
7642024-06-22T01:29:16.136ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b1941e54-49ca-46c6-a122-bfb5a01d4548") failed: Property not found. retry in 1.077352068s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b1941e54-49ca-46c6-a122-bfb5a01d4548
7652024-06-22T01:29:16.220ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bd80ac72-c82c-4ce9-bc52-67f1a196a500") failed: Property not found. retry in 1.435575009s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bd80ac72-c82c-4ce9-bc52-67f1a196a500
7662024-06-22T01:29:16.241ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cec07120-bde1-43be-9015-cc9c80e47619") failed: Property not found. retry in 606.958819ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cec07120-bde1-43be-9015-cc9c80e47619
7672024-06-22T01:29:16.608ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e3f38eaa-8bbf-4b04-90bd-aaac0c891458") failed: Property not found. retry in 1.143098408s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e3f38eaa-8bbf-4b04-90bd-aaac0c891458
7682024-06-22T01:29:16.609ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:54731
7692024-06-22T01:29:16.609ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 808 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:54731 req_id = 1ea2c9a4-134d-4ec7-9a88-7b3bf631981c response_code = 200 uri = /baseboard
7702024-06-22T01:29:16.857ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cec07120-bde1-43be-9015-cc9c80e47619") failed: Property not found. retry in 1.139902446s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cec07120-bde1-43be-9015-cc9c80e47619
7712024-06-22T01:29:16.880ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 499.98403ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:417 sled_id = 9f7cbf52-de0d-48c8-9e7d-2958552743a4
7722024-06-22T01:29:16.972ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e2c56625-46ac-4698-94ad-89db3c5ee30a") failed: Property not found. retry in 1.128672364s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e2c56625-46ac-4698-94ad-89db3c5ee30a
7732024-06-22T01:29:17.223ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b1941e54-49ca-46c6-a122-bfb5a01d4548") failed: Property not found. retry in 1.440865518s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b1941e54-49ca-46c6-a122-bfb5a01d4548
7742024-06-22T01:29:17.667ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bd80ac72-c82c-4ce9-bc52-67f1a196a500") failed: Property not found. retry in 910.406797ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bd80ac72-c82c-4ce9-bc52-67f1a196a500
7752024-06-22T01:29:17.762ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e3f38eaa-8bbf-4b04-90bd-aaac0c891458") failed: Property not found. retry in 1.140834817s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e3f38eaa-8bbf-4b04-90bd-aaac0c891458
7762024-06-22T01:29:18.007ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cec07120-bde1-43be-9015-cc9c80e47619") failed: Property not found. retry in 1.433049499s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cec07120-bde1-43be-9015-cc9c80e47619
7772024-06-22T01:29:18.587ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bd80ac72-c82c-4ce9-bc52-67f1a196a500") failed: Property not found. retry in 697.740302ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bd80ac72-c82c-4ce9-bc52-67f1a196a500
7782024-06-22T01:29:19.294ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bd80ac72-c82c-4ce9-bc52-67f1a196a500") failed: Property not found. retry in 1.403270611s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bd80ac72-c82c-4ce9-bc52-67f1a196a500
7792024-06-22T01:29:19.451ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cec07120-bde1-43be-9015-cc9c80e47619") failed: Property not found. retry in 710.256284ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cec07120-bde1-43be-9015-cc9c80e47619
7802024-06-22T01:29:20.172ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cec07120-bde1-43be-9015-cc9c80e47619") failed: Property not found. retry in 515.258362ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cec07120-bde1-43be-9015-cc9c80e47619
7812024-06-22T01:29:20.698ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cec07120-bde1-43be-9015-cc9c80e47619") failed: Property not found. retry in 513.612761ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cec07120-bde1-43be-9015-cc9c80e47619
7822024-06-22T01:29:20.709ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bd80ac72-c82c-4ce9-bc52-67f1a196a500") failed: Property not found. retry in 846.235489ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bd80ac72-c82c-4ce9-bc52-67f1a196a500
7832024-06-22T01:29:21.617ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cec07120-bde1-43be-9015-cc9c80e47619") failed: Property not found. retry in 1.446408794s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cec07120-bde1-43be-9015-cc9c80e47619
7842024-06-22T01:29:21.631ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bd80ac72-c82c-4ce9-bc52-67f1a196a500") failed: Property not found. retry in 1.246558287s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bd80ac72-c82c-4ce9-bc52-67f1a196a500
7852024-06-22T01:29:22.891ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bd80ac72-c82c-4ce9-bc52-67f1a196a500") failed: Property not found. retry in 981.94891ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bd80ac72-c82c-4ce9-bc52-67f1a196a500
7862024-06-22T01:29:23.075ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cec07120-bde1-43be-9015-cc9c80e47619") failed: Property not found. retry in 964.824977ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cec07120-bde1-43be-9015-cc9c80e47619
7872024-06-22T01:29:23.885ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bd80ac72-c82c-4ce9-bc52-67f1a196a500") failed: Property not found. retry in 1.212284371s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bd80ac72-c82c-4ce9-bc52-67f1a196a500
7882024-06-22T01:29:24.050ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cec07120-bde1-43be-9015-cc9c80e47619") failed: Property not found. retry in 1.423782149s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cec07120-bde1-43be-9015-cc9c80e47619
7892024-06-22T01:29:25.106ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bd80ac72-c82c-4ce9-bc52-67f1a196a500") failed: Property not found. retry in 557.873776ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bd80ac72-c82c-4ce9-bc52-67f1a196a500
7902024-06-22T01:29:25.482ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cec07120-bde1-43be-9015-cc9c80e47619") failed: Property not found. retry in 918.331387ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cec07120-bde1-43be-9015-cc9c80e47619
7912024-06-22T01:29:25.673ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bd80ac72-c82c-4ce9-bc52-67f1a196a500") failed: Property not found. retry in 964.964399ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bd80ac72-c82c-4ce9-bc52-67f1a196a500
7922024-06-22T01:29:26.412ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cec07120-bde1-43be-9015-cc9c80e47619") failed: Property not found. retry in 1.318768263s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cec07120-bde1-43be-9015-cc9c80e47619
7932024-06-22T01:29:26.648ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bd80ac72-c82c-4ce9-bc52-67f1a196a500") failed: Property not found. retry in 1.223012868s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bd80ac72-c82c-4ce9-bc52-67f1a196a500
7942024-06-22T01:29:27.741ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cec07120-bde1-43be-9015-cc9c80e47619") failed: Property not found. retry in 644.007671ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cec07120-bde1-43be-9015-cc9c80e47619
7952024-06-22T01:29:28.406ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2956 zone = oxz_cockroachdb_cec07120-bde1-43be-9015-cc9c80e47619
7962024-06-22T01:29:28.407ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2956 zone = oxz_cockroachdb_e2c56625-46ac-4698-94ad-89db3c5ee30a
7972024-06-22T01:29:28.407ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2956 zone = oxz_cockroachdb_b1941e54-49ca-46c6-a122-bfb5a01d4548
7982024-06-22T01:29:28.407ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2956 zone = oxz_cockroachdb_bd80ac72-c82c-4ce9-bc52-67f1a196a500
7992024-06-22T01:29:28.407ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2956 zone = oxz_cockroachdb_e3f38eaa-8bbf-4b04-90bd-aaac0c891458
8002024-06-22T01:29:28.407ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/9b2f2513-2520-480a-aa3a-397437db476d/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8012024-06-22T01:29:28.408ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/3e31f9bf-741c-4ad6-aa69-e523a333a2d2/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8022024-06-22T01:29:28.409ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 26390086 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:38169 req_id = 390f0589-36bf-46ed-81e2-747554134a72 response_code = 204 uri = /omicron-zones
8032024-06-22T01:29:28.441ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63756
8042024-06-22T01:29:28.469ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::3]:32221 file = sled-agent/src/services.rs:3367
8052024-06-22T01:29:28.651ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3385
8062024-06-22T01:29:33.566ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3408
8072024-06-22T01:29:33.566ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 5125029 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:63756 req_id = 2fd377e5-3f71-45f6-9646-43db96f1b812 response_code = 204 uri = /cockroachdb
8082024-06-22T01:29:33.571ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.284611368s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:417 sled_id = 9f7cbf52-de0d-48c8-9e7d-2958552743a4
8092024-06-22T01:29:33.602ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: 16c270c1-86b1-4539-8ef1-755ae423741a, underlay_address: fd00:1122:3344:1::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fd49fe38-f2ec-424b-a36d-fe54014bb3a5 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 369f0bed-8434-484e-b9e8-c1ffc7a84eb2, underlay_address: fd00:1122:3344:2::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c9d3163d-8113-4008-b362-43292ae5be54 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 511145a8-e42e-4796-b335-b2401f9e65a1, underlay_address: fd00:1122:3344:3::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8c04dded-f22c-49d5-9c59-b5b4be2cf536 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 4df9d50e-e00c-441d-9492-d80e07740151, underlay_address: fd00:1122:3344:101::1b, zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 80783f4b-33f4-40ae-bed8-5120256f0172, kind: Service { id: 4df9d50e-e00c-441d-9492-d80e07740151 }, name: Name("ntp-4df9d50e-e00c-441d-9492-d80e07740151"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 219, 126])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: b1941e54-49ca-46c6-a122-bfb5a01d4548, underlay_address: fd00:1122:3344:101::3, zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fd49fe38-f2ec-424b-a36d-fe54014bb3a5 (zpool), kind: External } } } }, OmicronZoneConfig { id: e2c56625-46ac-4698-94ad-89db3c5ee30a, underlay_address: fd00:1122:3344:101::4, zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c9d3163d-8113-4008-b362-43292ae5be54 (zpool), kind: External } } } }, OmicronZoneConfig { id: cec07120-bde1-43be-9015-cc9c80e47619, underlay_address: fd00:1122:3344:101::5, zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8c04dded-f22c-49d5-9c59-b5b4be2cf536 (zpool), kind: External } } } }, OmicronZoneConfig { id: e3f38eaa-8bbf-4b04-90bd-aaac0c891458, underlay_address: fd00:1122:3344:101::6, zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a9e6c25d-f1e0-4d21-b66f-63e2ac90bcb3 (zpool), kind: External } } } }, OmicronZoneConfig { id: bd80ac72-c82c-4ce9-bc52-67f1a196a500, underlay_address: fd00:1122:3344:101::7, zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b14a31e4-ac90-49a4-967f-505e8d513a31 (zpool), kind: External } } } }, OmicronZoneConfig { id: 4794eccf-57ac-4bf0-8ea5-3b0d68786898, underlay_address: fd00:1122:3344:101::8, zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fd49fe38-f2ec-424b-a36d-fe54014bb3a5 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.2.164:53, nic: NetworkInterface { id: d0b869b3-003a-426a-b13e-b2c2aad51442, kind: Service { id: 4794eccf-57ac-4bf0-8ea5-3b0d68786898 }, name: Name("external-dns-4794eccf-57ac-4bf0-8ea5-3b0d68786898"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 135])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 } } }, OmicronZoneConfig { id: 97317836-790a-40be-b49a-5480f32bf256, underlay_address: fd00:1122:3344:101::9, zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c9d3163d-8113-4008-b362-43292ae5be54 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.2.165:53, nic: NetworkInterface { id: 5362db8d-bb29-4e99-8d26-d1a82c174975, kind: Service { id: 97317836-790a-40be-b49a-5480f32bf256 }, name: Name("external-dns-97317836-790a-40be-b49a-5480f32bf256"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 204, 160])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 } } }, OmicronZoneConfig { id: 16f8da3d-c462-4156-86a4-9082477e2e5b, underlay_address: fd00:1122:3344:101::a, zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.2.166, nic: NetworkInterface { id: a2bee4b2-d860-42bc-80f8-8a229d0dcc78, kind: Service { id: 16f8da3d-c462-4156-86a4-9082477e2e5b }, name: Name("nexus-16f8da3d-c462-4156-86a4-9082477e2e5b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 223, 130])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: e0579974-e546-4f30-b7be-c7fca51ee278, underlay_address: fd00:1122:3344:101::b, zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.2.167, nic: NetworkInterface { id: 98a827f1-3762-4c1e-87c3-9167e6e76d2a, kind: Service { id: e0579974-e546-4f30-b7be-c7fca51ee278 }, name: Name("nexus-e0579974-e546-4f30-b7be-c7fca51ee278"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 160, 209])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 515131a9-573e-47f6-bfa4-fac433bd59f0, underlay_address: fd00:1122:3344:101::c, zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.2.168, nic: NetworkInterface { id: 7747eb91-467b-47d6-a128-711ac1c7bf05, kind: Service { id: 515131a9-573e-47f6-bfa4-fac433bd59f0 }, name: Name("nexus-515131a9-573e-47f6-bfa4-fac433bd59f0"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 83])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: a12b3721-98a8-4a75-8617-7177f9f59396, underlay_address: fd00:1122:3344:101::d, zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: a2874889-f5ed-46ab-b850-c6b4c440c268, underlay_address: fd00:1122:3344:101::e, zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fd49fe38-f2ec-424b-a36d-fe54014bb3a5 (zpool), kind: External } } } }, OmicronZoneConfig { id: 701fc4cb-14ab-4427-a48d-e3099ad7363a, underlay_address: fd00:1122:3344:101::f, zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: f4504525-7ee6-43d5-88ab-572513db1611, underlay_address: fd00:1122:3344:101::10, zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: 10154e8d-8a44-4f4f-b3c2-df4ab2aa02b1, underlay_address: fd00:1122:3344:101::11, zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: f6647bd4-cd9a-4181-afc6-adef66316263, underlay_address: fd00:1122:3344:101::12, zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fd49fe38-f2ec-424b-a36d-fe54014bb3a5 (zpool), kind: External } } } }, OmicronZoneConfig { id: 70b0163c-8d01-4c9f-a8c2-c24eae8b3ff8, underlay_address: fd00:1122:3344:101::13, zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c9d3163d-8113-4008-b362-43292ae5be54 (zpool), kind: External } } } }, OmicronZoneConfig { id: e3afa8c8-7f69-4d05-a0a3-37edc5fd4251, underlay_address: fd00:1122:3344:101::14, zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8c04dded-f22c-49d5-9c59-b5b4be2cf536 (zpool), kind: External } } } }, OmicronZoneConfig { id: 015b8ef4-20d3-41b1-aaea-f47794f2a754, underlay_address: fd00:1122:3344:101::15, zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a9e6c25d-f1e0-4d21-b66f-63e2ac90bcb3 (zpool), kind: External } } } }, OmicronZoneConfig { id: 76fb283e-fbaf-44ec-b242-dd9825b0141c, underlay_address: fd00:1122:3344:101::16, zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b14a31e4-ac90-49a4-967f-505e8d513a31 (zpool), kind: External } } } }, OmicronZoneConfig { id: 9ad34640-3c63-473b-a9af-7eb2f4f8da74, underlay_address: fd00:1122:3344:101::17, zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 12d1cb28-982b-440a-a40d-fd94d1ea8903 (zpool), kind: External } } } }, OmicronZoneConfig { id: ca38649f-9346-4829-ae87-5fc70fd55af4, underlay_address: fd00:1122:3344:101::18, zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f6ed7191-8358-44ad-bdc5-56e8c623c8b8 (zpool), kind: External } } } }, OmicronZoneConfig { id: 7e1b8a82-ac86-47b9-a8c8-b6fbe7e7c289, underlay_address: fd00:1122:3344:101::19, zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 870c10b7-1cc9-4791-bad3-d7dbfc885d9d (zpool), kind: External } } } }, OmicronZoneConfig { id: a94fe07b-8874-4ea2-866d-3a65c738a491, underlay_address: fd00:1122:3344:101::1a, zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 4deb6b88-4ed5-4c48-8332-5170c17d8ee2 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:431 sled_address = [fd00:1122:3344:101::1]:12345
8102024-06-22T01:29:33.602ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57333
8112024-06-22T01:29:33.603ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 16c270c1-86b1-4539-8ef1-755ae423741a, dataset_name: DatasetName { pool_name: ZpoolName { id: fd49fe38-f2ec-424b-a36d-fe54014bb3a5 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
8122024-06-22T01:29:33.603ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 16c270c1-86b1-4539-8ef1-755ae423741a, dataset_name: DatasetName { pool_name: ZpoolName { id: fd49fe38-f2ec-424b-a36d-fe54014bb3a5 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8132024-06-22T01:29:33.627ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 369f0bed-8434-484e-b9e8-c1ffc7a84eb2, dataset_name: DatasetName { pool_name: ZpoolName { id: c9d3163d-8113-4008-b362-43292ae5be54 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
8142024-06-22T01:29:33.627ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 369f0bed-8434-484e-b9e8-c1ffc7a84eb2, dataset_name: DatasetName { pool_name: ZpoolName { id: c9d3163d-8113-4008-b362-43292ae5be54 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8152024-06-22T01:29:33.649ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 511145a8-e42e-4796-b335-b2401f9e65a1, dataset_name: DatasetName { pool_name: ZpoolName { id: 8c04dded-f22c-49d5-9c59-b5b4be2cf536 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
8162024-06-22T01:29:33.649ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 511145a8-e42e-4796-b335-b2401f9e65a1, dataset_name: DatasetName { pool_name: ZpoolName { id: 8c04dded-f22c-49d5-9c59-b5b4be2cf536 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8172024-06-22T01:29:33.671ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: b1941e54-49ca-46c6-a122-bfb5a01d4548, dataset_name: DatasetName { pool_name: ZpoolName { id: fd49fe38-f2ec-424b-a36d-fe54014bb3a5 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
8182024-06-22T01:29:33.671ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: b1941e54-49ca-46c6-a122-bfb5a01d4548, dataset_name: DatasetName { pool_name: ZpoolName { id: fd49fe38-f2ec-424b-a36d-fe54014bb3a5 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
8192024-06-22T01:29:33.691ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e2c56625-46ac-4698-94ad-89db3c5ee30a, dataset_name: DatasetName { pool_name: ZpoolName { id: c9d3163d-8113-4008-b362-43292ae5be54 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
8202024-06-22T01:29:33.691ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: e2c56625-46ac-4698-94ad-89db3c5ee30a, dataset_name: DatasetName { pool_name: ZpoolName { id: c9d3163d-8113-4008-b362-43292ae5be54 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
8212024-06-22T01:29:33.709ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: cec07120-bde1-43be-9015-cc9c80e47619, dataset_name: DatasetName { pool_name: ZpoolName { id: 8c04dded-f22c-49d5-9c59-b5b4be2cf536 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
8222024-06-22T01:29:33.709ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: cec07120-bde1-43be-9015-cc9c80e47619, dataset_name: DatasetName { pool_name: ZpoolName { id: 8c04dded-f22c-49d5-9c59-b5b4be2cf536 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
8232024-06-22T01:29:33.729ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e3f38eaa-8bbf-4b04-90bd-aaac0c891458, dataset_name: DatasetName { pool_name: ZpoolName { id: a9e6c25d-f1e0-4d21-b66f-63e2ac90bcb3 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
8242024-06-22T01:29:33.729ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: e3f38eaa-8bbf-4b04-90bd-aaac0c891458, dataset_name: DatasetName { pool_name: ZpoolName { id: a9e6c25d-f1e0-4d21-b66f-63e2ac90bcb3 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
8252024-06-22T01:29:33.749ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: bd80ac72-c82c-4ce9-bc52-67f1a196a500, dataset_name: DatasetName { pool_name: ZpoolName { id: b14a31e4-ac90-49a4-967f-505e8d513a31 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
8262024-06-22T01:29:33.749ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: bd80ac72-c82c-4ce9-bc52-67f1a196a500, dataset_name: DatasetName { pool_name: ZpoolName { id: b14a31e4-ac90-49a4-967f-505e8d513a31 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
8272024-06-22T01:29:33.770ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 4794eccf-57ac-4bf0-8ea5-3b0d68786898, dataset_name: DatasetName { pool_name: ZpoolName { id: fd49fe38-f2ec-424b-a36d-fe54014bb3a5 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
8282024-06-22T01:29:33.770ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 4794eccf-57ac-4bf0-8ea5-3b0d68786898, dataset_name: DatasetName { pool_name: ZpoolName { id: fd49fe38-f2ec-424b-a36d-fe54014bb3a5 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
8292024-06-22T01:29:33.851ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 97317836-790a-40be-b49a-5480f32bf256, dataset_name: DatasetName { pool_name: ZpoolName { id: c9d3163d-8113-4008-b362-43292ae5be54 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
8302024-06-22T01:29:33.851ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 97317836-790a-40be-b49a-5480f32bf256, dataset_name: DatasetName { pool_name: ZpoolName { id: c9d3163d-8113-4008-b362-43292ae5be54 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
8312024-06-22T01:29:33.927ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: a2874889-f5ed-46ab-b850-c6b4c440c268, dataset_name: DatasetName { pool_name: ZpoolName { id: fd49fe38-f2ec-424b-a36d-fe54014bb3a5 (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:381
8322024-06-22T01:29:33.927ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: a2874889-f5ed-46ab-b850-c6b4c440c268, dataset_name: DatasetName { pool_name: ZpoolName { id: fd49fe38-f2ec-424b-a36d-fe54014bb3a5 (zpool), kind: External }, kind: Clickhouse }, responder: ... }
8332024-06-22T01:29:34.002ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: f6647bd4-cd9a-4181-afc6-adef66316263, dataset_name: DatasetName { pool_name: ZpoolName { id: fd49fe38-f2ec-424b-a36d-fe54014bb3a5 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
8342024-06-22T01:29:34.002ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: f6647bd4-cd9a-4181-afc6-adef66316263, dataset_name: DatasetName { pool_name: ZpoolName { id: fd49fe38-f2ec-424b-a36d-fe54014bb3a5 (zpool), kind: External }, kind: Crucible }, responder: ... }
8352024-06-22T01:29:34.073ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 70b0163c-8d01-4c9f-a8c2-c24eae8b3ff8, dataset_name: DatasetName { pool_name: ZpoolName { id: c9d3163d-8113-4008-b362-43292ae5be54 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
8362024-06-22T01:29:34.073ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 70b0163c-8d01-4c9f-a8c2-c24eae8b3ff8, dataset_name: DatasetName { pool_name: ZpoolName { id: c9d3163d-8113-4008-b362-43292ae5be54 (zpool), kind: External }, kind: Crucible }, responder: ... }
8372024-06-22T01:29:34.150ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e3afa8c8-7f69-4d05-a0a3-37edc5fd4251, dataset_name: DatasetName { pool_name: ZpoolName { id: 8c04dded-f22c-49d5-9c59-b5b4be2cf536 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
8382024-06-22T01:29:34.150ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: e3afa8c8-7f69-4d05-a0a3-37edc5fd4251, dataset_name: DatasetName { pool_name: ZpoolName { id: 8c04dded-f22c-49d5-9c59-b5b4be2cf536 (zpool), kind: External }, kind: Crucible }, responder: ... }
8392024-06-22T01:29:34.229ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 015b8ef4-20d3-41b1-aaea-f47794f2a754, dataset_name: DatasetName { pool_name: ZpoolName { id: a9e6c25d-f1e0-4d21-b66f-63e2ac90bcb3 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
8402024-06-22T01:29:34.229ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 015b8ef4-20d3-41b1-aaea-f47794f2a754, dataset_name: DatasetName { pool_name: ZpoolName { id: a9e6c25d-f1e0-4d21-b66f-63e2ac90bcb3 (zpool), kind: External }, kind: Crucible }, responder: ... }
8412024-06-22T01:29:34.306ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 76fb283e-fbaf-44ec-b242-dd9825b0141c, dataset_name: DatasetName { pool_name: ZpoolName { id: b14a31e4-ac90-49a4-967f-505e8d513a31 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
8422024-06-22T01:29:34.306ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 76fb283e-fbaf-44ec-b242-dd9825b0141c, dataset_name: DatasetName { pool_name: ZpoolName { id: b14a31e4-ac90-49a4-967f-505e8d513a31 (zpool), kind: External }, kind: Crucible }, responder: ... }
8432024-06-22T01:29:34.384ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 9ad34640-3c63-473b-a9af-7eb2f4f8da74, dataset_name: DatasetName { pool_name: ZpoolName { id: 12d1cb28-982b-440a-a40d-fd94d1ea8903 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
8442024-06-22T01:29:34.384ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 9ad34640-3c63-473b-a9af-7eb2f4f8da74, dataset_name: DatasetName { pool_name: ZpoolName { id: 12d1cb28-982b-440a-a40d-fd94d1ea8903 (zpool), kind: External }, kind: Crucible }, responder: ... }
8452024-06-22T01:29:34.453ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: ca38649f-9346-4829-ae87-5fc70fd55af4, dataset_name: DatasetName { pool_name: ZpoolName { id: f6ed7191-8358-44ad-bdc5-56e8c623c8b8 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
8462024-06-22T01:29:34.453ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: ca38649f-9346-4829-ae87-5fc70fd55af4, dataset_name: DatasetName { pool_name: ZpoolName { id: f6ed7191-8358-44ad-bdc5-56e8c623c8b8 (zpool), kind: External }, kind: Crucible }, responder: ... }
8472024-06-22T01:29:34.519ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 7e1b8a82-ac86-47b9-a8c8-b6fbe7e7c289, dataset_name: DatasetName { pool_name: ZpoolName { id: 870c10b7-1cc9-4791-bad3-d7dbfc885d9d (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
8482024-06-22T01:29:34.519ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 7e1b8a82-ac86-47b9-a8c8-b6fbe7e7c289, dataset_name: DatasetName { pool_name: ZpoolName { id: 870c10b7-1cc9-4791-bad3-d7dbfc885d9d (zpool), kind: External }, kind: Crucible }, responder: ... }
8492024-06-22T01:29:34.585ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: a94fe07b-8874-4ea2-866d-3a65c738a491, dataset_name: DatasetName { pool_name: ZpoolName { id: 4deb6b88-4ed5-4c48-8332-5170c17d8ee2 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
8502024-06-22T01:29:34.585ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: a94fe07b-8874-4ea2-866d-3a65c738a491, dataset_name: DatasetName { pool_name: ZpoolName { id: 4deb6b88-4ed5-4c48-8332-5170c17d8ee2 (zpool), kind: External }, kind: Crucible }, responder: ... }
8512024-06-22T01:29:34.651ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
8522024-06-22T01:29:34.651ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/9b2f2513-2520-480a-aa3a-397437db476d/config/omicron-zones.json file = common/src/ledger.rs:177
8532024-06-22T01:29:34.652ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/3e31f9bf-741c-4ad6-aa69-e523a333a2d2/config/omicron-zones.json file = common/src/ledger.rs:177
8542024-06-22T01:29:34.652ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
8552024-06-22T01:29:34.764ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:263
8562024-06-22T01:29:34.765ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:263
8572024-06-22T01:29:34.767ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:263
8582024-06-22T01:29:34.768ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:263
8592024-06-22T01:29:34.821ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
8602024-06-22T01:29:34.821ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
8612024-06-22T01:29:34.821ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
8622024-06-22T01:29:34.821ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
8632024-06-22T01:29:34.821ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
8642024-06-22T01:29:34.821ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
8652024-06-22T01:29:34.821ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
8662024-06-22T01:29:35.052ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:263
8672024-06-22T01:29:35.052ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
8682024-06-22T01:29:35.052ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
8692024-06-22T01:29:35.052ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
8702024-06-22T01:29:35.052ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
8712024-06-22T01:29:35.052ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
8722024-06-22T01:29:35.052ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
8732024-06-22T01:29:35.052ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
8742024-06-22T01:29:35.053ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_701fc4cb-14ab-4427-a48d-e3099ad7363a file = illumos-utils/src/zone.rs:315
8752024-06-22T01:29:35.058ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_f4504525-7ee6-43d5-88ab-572513db1611 file = illumos-utils/src/zone.rs:315
8762024-06-22T01:29:35.063ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_a12b3721-98a8-4a75-8617-7177f9f59396 file = illumos-utils/src/zone.rs:315
8772024-06-22T01:29:35.068ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_a2874889-f5ed-46ab-b850-c6b4c440c268 file = illumos-utils/src/zone.rs:315
8782024-06-22T01:29:35.074ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_f6647bd4-cd9a-4181-afc6-adef66316263 file = illumos-utils/src/zone.rs:315
8792024-06-22T01:29:35.079ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_70b0163c-8d01-4c9f-a8c2-c24eae8b3ff8 file = illumos-utils/src/zone.rs:315
8802024-06-22T01:29:35.084ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_e3afa8c8-7f69-4d05-a0a3-37edc5fd4251 file = illumos-utils/src/zone.rs:315
8812024-06-22T01:29:35.240ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_701fc4cb-14ab-4427-a48d-e3099ad7363a file = illumos-utils/src/zone.rs:354
8822024-06-22T01:29:35.246ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_f4504525-7ee6-43d5-88ab-572513db1611 file = illumos-utils/src/zone.rs:354
8832024-06-22T01:29:35.251ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_a12b3721-98a8-4a75-8617-7177f9f59396 file = illumos-utils/src/zone.rs:354
8842024-06-22T01:29:35.256ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_a2874889-f5ed-46ab-b850-c6b4c440c268 file = illumos-utils/src/zone.rs:354
8852024-06-22T01:29:35.260ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_f6647bd4-cd9a-4181-afc6-adef66316263 file = illumos-utils/src/zone.rs:354
8862024-06-22T01:29:35.266ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_70b0163c-8d01-4c9f-a8c2-c24eae8b3ff8 file = illumos-utils/src/zone.rs:354
8872024-06-22T01:29:35.271ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_e3afa8c8-7f69-4d05-a0a3-37edc5fd4251 file = illumos-utils/src/zone.rs:354
8882024-06-22T01:29:35.276ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_015b8ef4-20d3-41b1-aaea-f47794f2a754 file = illumos-utils/src/zone.rs:315
8892024-06-22T01:29:35.282ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_ca38649f-9346-4829-ae87-5fc70fd55af4 file = illumos-utils/src/zone.rs:315
8902024-06-22T01:29:35.288ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_7e1b8a82-ac86-47b9-a8c8-b6fbe7e7c289 file = illumos-utils/src/zone.rs:315
8912024-06-22T01:29:35.293ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_10154e8d-8a44-4f4f-b3c2-df4ab2aa02b1 file = illumos-utils/src/zone.rs:315
8922024-06-22T01:29:35.300ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_9ad34640-3c63-473b-a9af-7eb2f4f8da74 file = illumos-utils/src/zone.rs:315
8932024-06-22T01:29:35.306ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_a94fe07b-8874-4ea2-866d-3a65c738a491 file = illumos-utils/src/zone.rs:315
8942024-06-22T01:29:35.312ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_76fb283e-fbaf-44ec-b242-dd9825b0141c file = illumos-utils/src/zone.rs:315
8952024-06-22T01:29:35.319ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_015b8ef4-20d3-41b1-aaea-f47794f2a754 file = illumos-utils/src/zone.rs:354
8962024-06-22T01:29:35.325ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_ca38649f-9346-4829-ae87-5fc70fd55af4 file = illumos-utils/src/zone.rs:354
8972024-06-22T01:29:35.332ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_7e1b8a82-ac86-47b9-a8c8-b6fbe7e7c289 file = illumos-utils/src/zone.rs:354
8982024-06-22T01:29:35.339ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_10154e8d-8a44-4f4f-b3c2-df4ab2aa02b1 file = illumos-utils/src/zone.rs:354
8992024-06-22T01:29:35.346ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_9ad34640-3c63-473b-a9af-7eb2f4f8da74 file = illumos-utils/src/zone.rs:354
9002024-06-22T01:29:35.353ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_a94fe07b-8874-4ea2-866d-3a65c738a491 file = illumos-utils/src/zone.rs:354
9012024-06-22T01:29:35.360ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_76fb283e-fbaf-44ec-b242-dd9825b0141c file = illumos-utils/src/zone.rs:354
9022024-06-22T01:29:35.430ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:280
9032024-06-22T01:29:35.495ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:280
9042024-06-22T01:29:35.552ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:280
9052024-06-22T01:29:35.606ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:280
9062024-06-22T01:29:35.663ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:280
9072024-06-22T01:29:35.665ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:305
9082024-06-22T01:29:35.665ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:197
9092024-06-22T01:29:35.759ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:393 port = Port { inner: PortInner { name: "opte1", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 204, 160]), slot: 0, vni: Vni { inner: 100 }, gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 }, vnic: "vopte1" } }
9102024-06-22T01:29:35.759ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1190 zone_type = external_dns
9112024-06-22T01:29:35.764ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:305
9122024-06-22T01:29:35.764ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:197
9132024-06-22T01:29:35.870ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:393 port = Port { inner: PortInner { name: "opte2", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 160, 209]), slot: 0, vni: Vni { inner: 100 }, gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 }, vnic: "vopte2" } }
9142024-06-22T01:29:35.870ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1190 zone_type = nexus
9152024-06-22T01:29:35.874ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:305
9162024-06-22T01:29:35.874ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:197
9172024-06-22T01:29:35.976ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:393 port = Port { inner: PortInner { name: "opte3", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 150, 83]), slot: 0, vni: Vni { inner: 100 }, gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 }, vnic: "vopte3" } }
9182024-06-22T01:29:35.976ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1190 zone_type = nexus
9192024-06-22T01:29:35.978ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:305
9202024-06-22T01:29:35.979ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:197
9212024-06-22T01:29:36.070ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:393 port = Port { inner: PortInner { name: "opte4", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 223, 130]), slot: 0, vni: Vni { inner: 100 }, gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 }, vnic: "vopte4" } }
9222024-06-22T01:29:36.070ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1190 zone_type = nexus
9232024-06-22T01:29:36.073ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:305
9242024-06-22T01:29:36.073ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:197
9252024-06-22T01:29:36.206ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:393 port = Port { inner: PortInner { name: "opte5", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 245, 135]), slot: 0, vni: Vni { inner: 100 }, gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 }, vnic: "vopte5" } }
9262024-06-22T01:29:36.206ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1190 zone_type = external_dns
9272024-06-22T01:29:36.209ZINFOSledAgent (ServiceManager): no nat entry found for: V4( Ipv4Network { addr: 10.151.2.165, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:102
9282024-06-22T01:29:36.209ZINFOSledAgent (ServiceManager): creating nat entry for: V4( Ipv4Network { addr: 10.151.2.165, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:109
9292024-06-22T01:29:36.209ZINFOSledAgent (ServiceManager): no nat entry found for: V4( Ipv4Network { addr: 10.151.2.164, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:102
9302024-06-22T01:29:36.209ZINFOSledAgent (ServiceManager): creating nat entry for: V4( Ipv4Network { addr: 10.151.2.164, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:109
9312024-06-22T01:29:36.211ZINFOSledAgent (ServiceManager): no nat entry found for: V4( Ipv4Network { addr: 10.151.2.168, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:102
9322024-06-22T01:29:36.211ZINFOSledAgent (ServiceManager): creating nat entry for: V4( Ipv4Network { addr: 10.151.2.168, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:109
9332024-06-22T01:29:36.212ZINFOSledAgent (ServiceManager): no nat entry found for: V4( Ipv4Network { addr: 10.151.2.166, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:102
9342024-06-22T01:29:36.212ZINFOSledAgent (ServiceManager): creating nat entry for: V4( Ipv4Network { addr: 10.151.2.166, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:109
9352024-06-22T01:29:36.212ZINFOSledAgent (ServiceManager): no nat entry found for: V4( Ipv4Network { addr: 10.151.2.167, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:102
9362024-06-22T01:29:36.212ZINFOSledAgent (ServiceManager): creating nat entry for: V4( Ipv4Network { addr: 10.151.2.167, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:109
9372024-06-22T01:29:36.213ZINFOSledAgent (ServiceManager): creation of nat entry successful for: V4( Ipv4Network { addr: 10.151.2.165, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:137
9382024-06-22T01:29:36.218ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9392024-06-22T01:29:36.264ZINFOSledAgent (ServiceManager): creation of nat entry successful for: V4( Ipv4Network { addr: 10.151.2.167, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:137
9402024-06-22T01:29:36.270ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9412024-06-22T01:29:36.270ZINFOSledAgent (ServiceManager): creation of nat entry successful for: V4( Ipv4Network { addr: 10.151.2.168, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:137
9422024-06-22T01:29:36.273ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9432024-06-22T01:29:36.273ZINFOSledAgent (ServiceManager): creation of nat entry successful for: V4( Ipv4Network { addr: 10.151.2.166, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:137
9442024-06-22T01:29:36.276ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9452024-06-22T01:29:36.276ZINFOSledAgent (ServiceManager): creation of nat entry successful for: V4( Ipv4Network { addr: 10.151.2.164, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:137
9462024-06-22T01:29:36.279ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9472024-06-22T01:29:36.418ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_97317836-790a-40be-b49a-5480f32bf256 file = illumos-utils/src/zone.rs:315
9482024-06-22T01:29:36.424ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_e0579974-e546-4f30-b7be-c7fca51ee278 file = illumos-utils/src/zone.rs:315
9492024-06-22T01:29:36.432ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_515131a9-573e-47f6-bfa4-fac433bd59f0 file = illumos-utils/src/zone.rs:315
9502024-06-22T01:29:36.438ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_16f8da3d-c462-4156-86a4-9082477e2e5b file = illumos-utils/src/zone.rs:315
9512024-06-22T01:29:36.444ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_4794eccf-57ac-4bf0-8ea5-3b0d68786898 file = illumos-utils/src/zone.rs:315
9522024-06-22T01:29:36.452ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_97317836-790a-40be-b49a-5480f32bf256 file = illumos-utils/src/zone.rs:354
9532024-06-22T01:29:36.459ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_e0579974-e546-4f30-b7be-c7fca51ee278 file = illumos-utils/src/zone.rs:354
9542024-06-22T01:29:36.465ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_515131a9-573e-47f6-bfa4-fac433bd59f0 file = illumos-utils/src/zone.rs:354
9552024-06-22T01:29:36.473ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_16f8da3d-c462-4156-86a4-9082477e2e5b file = illumos-utils/src/zone.rs:354
9562024-06-22T01:29:36.479ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_4794eccf-57ac-4bf0-8ea5-3b0d68786898 file = illumos-utils/src/zone.rs:354
9572024-06-22T01:29:37.611ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_f4504525-7ee6-43d5-88ab-572513db1611: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService11"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::10"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::10"/> <propval type="astring" name="listen_port" value="17000"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9582024-06-22T01:29:37.611ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_pantry_f4504525-7ee6-43d5-88ab-572513db1611
9592024-06-22T01:29:37.619ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_701fc4cb-14ab-4427-a48d-e3099ad7363a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService10"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::f"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::f"/> <propval type="astring" name="listen_port" value="17000"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9602024-06-22T01:29:37.619ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_pantry_701fc4cb-14ab-4427-a48d-e3099ad7363a
9612024-06-22T01:29:37.821ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_10154e8d-8a44-4f4f-b3c2-df4ab2aa02b1: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService20"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::11"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::11"/> <propval type="astring" name="listen_port" value="17000"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9622024-06-22T01:29:37.822ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_pantry_10154e8d-8a44-4f4f-b3c2-df4ab2aa02b1
9632024-06-22T01:29:37.831ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_a12b3721-98a8-4a75-8617-7177f9f59396: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService12"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::d"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value="a12b3721-98a8-4a75-8617-7177f9f59396"/> <propval type="astring" name="address" value="[fd00:1122:3344:101::d]:12223"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9642024-06-22T01:29:37.831ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_oximeter_a12b3721-98a8-4a75-8617-7177f9f59396
9652024-06-22T01:29:37.843ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_015b8ef4-20d3-41b1-aaea-f47794f2a754: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService17"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::15"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_a9e6c25d-f1e0-4d21-b66f-63e2ac90bcb3/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::15"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="a535fe9f-808a-40a4-ae41-455487fad6a8"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9662024-06-22T01:29:37.843ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_015b8ef4-20d3-41b1-aaea-f47794f2a754
9672024-06-22T01:29:37.899ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_701fc4cb-14ab-4427-a48d-e3099ad7363a") failed: Property not found. retry in 63.324023ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_701fc4cb-14ab-4427-a48d-e3099ad7363a
9682024-06-22T01:29:37.902ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_ca38649f-9346-4829-ae87-5fc70fd55af4: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService18"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::18"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_f6ed7191-8358-44ad-bdc5-56e8c623c8b8/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::18"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="9ea29490-4c6f-400f-88ad-e023cc3c2703"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9692024-06-22T01:29:37.902ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_ca38649f-9346-4829-ae87-5fc70fd55af4
9702024-06-22T01:29:37.922ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f4504525-7ee6-43d5-88ab-572513db1611") failed: Property not found. retry in 29.792023ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f4504525-7ee6-43d5-88ab-572513db1611
9712024-06-22T01:29:37.922ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_f6647bd4-cd9a-4181-afc6-adef66316263: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService14"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::12"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_fd49fe38-f2ec-424b-a36d-fe54014bb3a5/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::12"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="b383eaa7-145d-46d4-b52b-1c829757739f"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9722024-06-22T01:29:37.922ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_7e1b8a82-ac86-47b9-a8c8-b6fbe7e7c289: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService19"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::19"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_870c10b7-1cc9-4791-bad3-d7dbfc885d9d/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::19"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="4a015981-aa2a-451c-9de6-54863425aaa6"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9732024-06-22T01:29:37.922ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_f6647bd4-cd9a-4181-afc6-adef66316263
9742024-06-22T01:29:37.929ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_7e1b8a82-ac86-47b9-a8c8-b6fbe7e7c289
9752024-06-22T01:29:37.936ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_a94fe07b-8874-4ea2-866d-3a65c738a491: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService22"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::1a"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_4deb6b88-4ed5-4c48-8332-5170c17d8ee2/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::1a"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="24674fba-c9fc-41f2-8721-7781a3240ddc"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9762024-06-22T01:29:37.937ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_a94fe07b-8874-4ea2-866d-3a65c738a491
9772024-06-22T01:29:37.950ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_76fb283e-fbaf-44ec-b242-dd9825b0141c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService23"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::16"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_b14a31e4-ac90-49a4-967f-505e8d513a31/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::16"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="1d9b266c-7959-47ba-95e3-6e2ed57c9b75"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9782024-06-22T01:29:37.950ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_76fb283e-fbaf-44ec-b242-dd9825b0141c
9792024-06-22T01:29:37.969ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f4504525-7ee6-43d5-88ab-572513db1611") failed: Property not found. retry in 79.288863ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f4504525-7ee6-43d5-88ab-572513db1611
9802024-06-22T01:29:37.970ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_e3afa8c8-7f69-4d05-a0a3-37edc5fd4251: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService16"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::14"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_8c04dded-f22c-49d5-9c59-b5b4be2cf536/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::14"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="bc0e4cd4-187b-4dd0-a327-b37a87fd1aa1"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9812024-06-22T01:29:37.981ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_701fc4cb-14ab-4427-a48d-e3099ad7363a") failed: Property not found. retry in 113.587546ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_701fc4cb-14ab-4427-a48d-e3099ad7363a
9822024-06-22T01:29:37.982ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_70b0163c-8d01-4c9f-a8c2-c24eae8b3ff8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService15"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::13"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_c9d3163d-8113-4008-b362-43292ae5be54/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::13"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="dc0518c5-3c10-484e-9ede-269e5e6e345e"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9832024-06-22T01:29:37.982ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_e3afa8c8-7f69-4d05-a0a3-37edc5fd4251
9842024-06-22T01:29:37.990ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_70b0163c-8d01-4c9f-a8c2-c24eae8b3ff8
9852024-06-22T01:29:37.998ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_9ad34640-3c63-473b-a9af-7eb2f4f8da74: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService21"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::17"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_12d1cb28-982b-440a-a40d-fd94d1ea8903/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::17"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="675835d0-09d1-480b-b635-00240a270134"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9862024-06-22T01:29:37.998ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_9ad34640-3c63-473b-a9af-7eb2f4f8da74
9872024-06-22T01:29:38.033ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a12b3721-98a8-4a75-8617-7177f9f59396") failed: Property not found. retry in 71.323847ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a12b3721-98a8-4a75-8617-7177f9f59396
9882024-06-22T01:29:38.050ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_10154e8d-8a44-4f4f-b3c2-df4ab2aa02b1") failed: Property not found. retry in 43.877984ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_10154e8d-8a44-4f4f-b3c2-df4ab2aa02b1
9892024-06-22T01:29:38.061ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f4504525-7ee6-43d5-88ab-572513db1611") failed: Property not found. retry in 106.157872ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f4504525-7ee6-43d5-88ab-572513db1611
9902024-06-22T01:29:38.076ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_015b8ef4-20d3-41b1-aaea-f47794f2a754") failed: Property not found. retry in 40.269555ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_015b8ef4-20d3-41b1-aaea-f47794f2a754
9912024-06-22T01:29:38.107ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_10154e8d-8a44-4f4f-b3c2-df4ab2aa02b1") failed: Property not found. retry in 79.404193ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_10154e8d-8a44-4f4f-b3c2-df4ab2aa02b1
9922024-06-22T01:29:38.124ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_701fc4cb-14ab-4427-a48d-e3099ad7363a") failed: Property not found. retry in 222.097275ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_701fc4cb-14ab-4427-a48d-e3099ad7363a
9932024-06-22T01:29:38.137ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a12b3721-98a8-4a75-8617-7177f9f59396") failed: Property not found. retry in 81.902721ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a12b3721-98a8-4a75-8617-7177f9f59396
9942024-06-22T01:29:38.149ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f6647bd4-cd9a-4181-afc6-adef66316263") failed: Property not found. retry in 51.818706ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f6647bd4-cd9a-4181-afc6-adef66316263
9952024-06-22T01:29:38.160ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_015b8ef4-20d3-41b1-aaea-f47794f2a754") failed: Property not found. retry in 55.906277ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_015b8ef4-20d3-41b1-aaea-f47794f2a754
9962024-06-22T01:29:38.171ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ca38649f-9346-4829-ae87-5fc70fd55af4") failed: Property not found. retry in 68.676964ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ca38649f-9346-4829-ae87-5fc70fd55af4
9972024-06-22T01:29:38.184ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7e1b8a82-ac86-47b9-a8c8-b6fbe7e7c289") failed: Property not found. retry in 47.651207ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7e1b8a82-ac86-47b9-a8c8-b6fbe7e7c289
9982024-06-22T01:29:38.199ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f4504525-7ee6-43d5-88ab-572513db1611") failed: Property not found. retry in 298.985413ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f4504525-7ee6-43d5-88ab-572513db1611
9992024-06-22T01:29:38.210ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a94fe07b-8874-4ea2-866d-3a65c738a491") failed: Property not found. retry in 33.258628ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a94fe07b-8874-4ea2-866d-3a65c738a491
10002024-06-22T01:29:38.311ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_76fb283e-fbaf-44ec-b242-dd9825b0141c") failed: Property not found. retry in 31.522514ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_76fb283e-fbaf-44ec-b242-dd9825b0141c
10012024-06-22T01:29:38.485ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a12b3721-98a8-4a75-8617-7177f9f59396") failed: Property not found. retry in 231.623055ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a12b3721-98a8-4a75-8617-7177f9f59396
10022024-06-22T01:29:38.683ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f6647bd4-cd9a-4181-afc6-adef66316263") failed: Property not found. retry in 100.94365ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f6647bd4-cd9a-4181-afc6-adef66316263
10032024-06-22T01:29:45.184ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_70b0163c-8d01-4c9f-a8c2-c24eae8b3ff8") failed: Property not found. retry in 63.431474ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_70b0163c-8d01-4c9f-a8c2-c24eae8b3ff8
10042024-06-22T01:29:45.579ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3afa8c8-7f69-4d05-a0a3-37edc5fd4251") failed: Property not found. retry in 31.548109ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e3afa8c8-7f69-4d05-a0a3-37edc5fd4251
10052024-06-22T01:29:45.741ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_015b8ef4-20d3-41b1-aaea-f47794f2a754") failed: Property not found. retry in 297.572185ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_015b8ef4-20d3-41b1-aaea-f47794f2a754
10062024-06-22T01:29:45.894ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ca38649f-9346-4829-ae87-5fc70fd55af4") failed: Property not found. retry in 63.47564ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ca38649f-9346-4829-ae87-5fc70fd55af4
10072024-06-22T01:29:46.156ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7e1b8a82-ac86-47b9-a8c8-b6fbe7e7c289") failed: Property not found. retry in 124.576489ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7e1b8a82-ac86-47b9-a8c8-b6fbe7e7c289
10082024-06-22T01:29:46.396ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_10154e8d-8a44-4f4f-b3c2-df4ab2aa02b1") failed: Property not found. retry in 266.060775ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_10154e8d-8a44-4f4f-b3c2-df4ab2aa02b1
10092024-06-22T01:29:46.479ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9ad34640-3c63-473b-a9af-7eb2f4f8da74") failed: Property not found. retry in 36.297855ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9ad34640-3c63-473b-a9af-7eb2f4f8da74
10102024-06-22T01:29:46.586ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a94fe07b-8874-4ea2-866d-3a65c738a491") failed: Property not found. retry in 123.804509ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a94fe07b-8874-4ea2-866d-3a65c738a491
10112024-06-22T01:29:46.625ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_701fc4cb-14ab-4427-a48d-e3099ad7363a") failed: Property not found. retry in 221.656752ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_701fc4cb-14ab-4427-a48d-e3099ad7363a
10122024-06-22T01:29:46.675ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f4504525-7ee6-43d5-88ab-572513db1611") failed: Property not found. retry in 924.134754ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f4504525-7ee6-43d5-88ab-572513db1611
10132024-06-22T01:29:46.707ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a12b3721-98a8-4a75-8617-7177f9f59396") failed: Property not found. retry in 520.820191ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a12b3721-98a8-4a75-8617-7177f9f59396
10142024-06-22T01:29:46.723ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f6647bd4-cd9a-4181-afc6-adef66316263") failed: Property not found. retry in 290.784857ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f6647bd4-cd9a-4181-afc6-adef66316263
10152024-06-22T01:29:46.766ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_70b0163c-8d01-4c9f-a8c2-c24eae8b3ff8") failed: Property not found. retry in 65.660631ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_70b0163c-8d01-4c9f-a8c2-c24eae8b3ff8
10162024-06-22T01:29:46.781ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3afa8c8-7f69-4d05-a0a3-37edc5fd4251") failed: Property not found. retry in 56.567456ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e3afa8c8-7f69-4d05-a0a3-37edc5fd4251
10172024-06-22T01:29:46.802ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_015b8ef4-20d3-41b1-aaea-f47794f2a754") failed: Property not found. retry in 491.572363ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_015b8ef4-20d3-41b1-aaea-f47794f2a754
10182024-06-22T01:29:46.845ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ca38649f-9346-4829-ae87-5fc70fd55af4") failed: Property not found. retry in 254.196678ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ca38649f-9346-4829-ae87-5fc70fd55af4
10192024-06-22T01:29:46.862ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7e1b8a82-ac86-47b9-a8c8-b6fbe7e7c289") failed: Property not found. retry in 161.786828ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7e1b8a82-ac86-47b9-a8c8-b6fbe7e7c289
10202024-06-22T01:29:46.878ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_10154e8d-8a44-4f4f-b3c2-df4ab2aa02b1") failed: Property not found. retry in 473.615746ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_10154e8d-8a44-4f4f-b3c2-df4ab2aa02b1
10212024-06-22T01:29:46.893ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9ad34640-3c63-473b-a9af-7eb2f4f8da74") failed: Property not found. retry in 144.309411ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9ad34640-3c63-473b-a9af-7eb2f4f8da74
10222024-06-22T01:29:46.908ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a94fe07b-8874-4ea2-866d-3a65c738a491") failed: Property not found. retry in 172.288589ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a94fe07b-8874-4ea2-866d-3a65c738a491
10232024-06-22T01:29:46.926ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_76fb283e-fbaf-44ec-b242-dd9825b0141c") failed: Property not found. retry in 135.86197ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_76fb283e-fbaf-44ec-b242-dd9825b0141c
10242024-06-22T01:29:46.941ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_701fc4cb-14ab-4427-a48d-e3099ad7363a") failed: Property not found. retry in 472.790588ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_701fc4cb-14ab-4427-a48d-e3099ad7363a
10252024-06-22T01:29:46.957ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_70b0163c-8d01-4c9f-a8c2-c24eae8b3ff8") failed: Property not found. retry in 165.434407ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_70b0163c-8d01-4c9f-a8c2-c24eae8b3ff8
10262024-06-22T01:29:46.972ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3afa8c8-7f69-4d05-a0a3-37edc5fd4251") failed: Property not found. retry in 128.763705ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e3afa8c8-7f69-4d05-a0a3-37edc5fd4251
10272024-06-22T01:29:47.031ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f6647bd4-cd9a-4181-afc6-adef66316263") failed: Property not found. retry in 271.281582ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f6647bd4-cd9a-4181-afc6-adef66316263
10282024-06-22T01:29:47.045ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7e1b8a82-ac86-47b9-a8c8-b6fbe7e7c289") failed: Property not found. retry in 307.394027ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7e1b8a82-ac86-47b9-a8c8-b6fbe7e7c289
10292024-06-22T01:29:47.061ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9ad34640-3c63-473b-a9af-7eb2f4f8da74") failed: Property not found. retry in 278.988635ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9ad34640-3c63-473b-a9af-7eb2f4f8da74
10302024-06-22T01:29:47.062ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:40354
10312024-06-22T01:29:47.092ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 30069 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:40354 req_id = f0fb9b6e-4922-4057-bc49-c42dca1fb64e response_code = 200 uri = /baseboard
10322024-06-22T01:29:47.107ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a94fe07b-8874-4ea2-866d-3a65c738a491") failed: Property not found. retry in 555.033952ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a94fe07b-8874-4ea2-866d-3a65c738a491
10332024-06-22T01:29:47.119ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_76fb283e-fbaf-44ec-b242-dd9825b0141c") failed: Property not found. retry in 207.280645ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_76fb283e-fbaf-44ec-b242-dd9825b0141c
10342024-06-22T01:29:47.135ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3afa8c8-7f69-4d05-a0a3-37edc5fd4251") failed: Property not found. retry in 397.573803ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e3afa8c8-7f69-4d05-a0a3-37edc5fd4251
10352024-06-22T01:29:47.149ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ca38649f-9346-4829-ae87-5fc70fd55af4") failed: Property not found. retry in 443.124385ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ca38649f-9346-4829-ae87-5fc70fd55af4
10362024-06-22T01:29:47.163ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_70b0163c-8d01-4c9f-a8c2-c24eae8b3ff8") failed: Property not found. retry in 513.456064ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_70b0163c-8d01-4c9f-a8c2-c24eae8b3ff8
10372024-06-22T01:29:47.243ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a12b3721-98a8-4a75-8617-7177f9f59396") failed: Property not found. retry in 1.05629236s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a12b3721-98a8-4a75-8617-7177f9f59396
10382024-06-22T01:29:47.308ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_015b8ef4-20d3-41b1-aaea-f47794f2a754") failed: Property not found. retry in 920.239169ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_015b8ef4-20d3-41b1-aaea-f47794f2a754
10392024-06-22T01:29:47.321ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f6647bd4-cd9a-4181-afc6-adef66316263") failed: Property not found. retry in 455.119038ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f6647bd4-cd9a-4181-afc6-adef66316263
10402024-06-22T01:29:47.341ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_76fb283e-fbaf-44ec-b242-dd9825b0141c") failed: Property not found. retry in 266.852036ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_76fb283e-fbaf-44ec-b242-dd9825b0141c
10412024-06-22T01:29:47.353ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9ad34640-3c63-473b-a9af-7eb2f4f8da74") failed: Property not found. retry in 316.096032ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9ad34640-3c63-473b-a9af-7eb2f4f8da74
10422024-06-22T01:29:47.367ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7e1b8a82-ac86-47b9-a8c8-b6fbe7e7c289") failed: Property not found. retry in 523.271484ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7e1b8a82-ac86-47b9-a8c8-b6fbe7e7c289
10432024-06-22T01:29:47.382ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_10154e8d-8a44-4f4f-b3c2-df4ab2aa02b1") failed: Property not found. retry in 499.809864ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_10154e8d-8a44-4f4f-b3c2-df4ab2aa02b1
10442024-06-22T01:29:47.430ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_701fc4cb-14ab-4427-a48d-e3099ad7363a") failed: Property not found. retry in 509.868082ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_701fc4cb-14ab-4427-a48d-e3099ad7363a
10452024-06-22T01:29:47.549ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3afa8c8-7f69-4d05-a0a3-37edc5fd4251") failed: Property not found. retry in 649.890537ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e3afa8c8-7f69-4d05-a0a3-37edc5fd4251
10462024-06-22T01:29:47.608ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ca38649f-9346-4829-ae87-5fc70fd55af4") failed: Property not found. retry in 446.174168ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ca38649f-9346-4829-ae87-5fc70fd55af4
10472024-06-22T01:29:47.623ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f4504525-7ee6-43d5-88ab-572513db1611") failed: Property not found. retry in 1.353678877s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f4504525-7ee6-43d5-88ab-572513db1611
10482024-06-22T01:29:47.636ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_76fb283e-fbaf-44ec-b242-dd9825b0141c") failed: Property not found. retry in 859.493741ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_76fb283e-fbaf-44ec-b242-dd9825b0141c
10492024-06-22T01:29:47.677ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a94fe07b-8874-4ea2-866d-3a65c738a491") failed: Property not found. retry in 501.802839ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a94fe07b-8874-4ea2-866d-3a65c738a491
10502024-06-22T01:29:47.692ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_70b0163c-8d01-4c9f-a8c2-c24eae8b3ff8") failed: Property not found. retry in 497.38853ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_70b0163c-8d01-4c9f-a8c2-c24eae8b3ff8
10512024-06-22T01:29:47.703ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9ad34640-3c63-473b-a9af-7eb2f4f8da74") failed: Property not found. retry in 1.075605563s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9ad34640-3c63-473b-a9af-7eb2f4f8da74
10522024-06-22T01:29:47.790ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f6647bd4-cd9a-4181-afc6-adef66316263") failed: Property not found. retry in 533.355777ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f6647bd4-cd9a-4181-afc6-adef66316263
10532024-06-22T01:29:47.897ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_10154e8d-8a44-4f4f-b3c2-df4ab2aa02b1") failed: Property not found. retry in 1.07718071s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_10154e8d-8a44-4f4f-b3c2-df4ab2aa02b1
10542024-06-22T01:29:47.911ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7e1b8a82-ac86-47b9-a8c8-b6fbe7e7c289") failed: Property not found. retry in 513.577567ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7e1b8a82-ac86-47b9-a8c8-b6fbe7e7c289
10552024-06-22T01:29:47.954ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_701fc4cb-14ab-4427-a48d-e3099ad7363a") failed: Property not found. retry in 1.048550563s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_701fc4cb-14ab-4427-a48d-e3099ad7363a
10562024-06-22T01:29:48.069ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ca38649f-9346-4829-ae87-5fc70fd55af4") failed: Property not found. retry in 1.399914626s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ca38649f-9346-4829-ae87-5fc70fd55af4
10572024-06-22T01:29:48.194ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a94fe07b-8874-4ea2-866d-3a65c738a491") failed: Property not found. retry in 1.178864153s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a94fe07b-8874-4ea2-866d-3a65c738a491
10582024-06-22T01:29:48.205ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_70b0163c-8d01-4c9f-a8c2-c24eae8b3ff8") failed: Property not found. retry in 510.985386ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_70b0163c-8d01-4c9f-a8c2-c24eae8b3ff8
10592024-06-22T01:29:48.218ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3afa8c8-7f69-4d05-a0a3-37edc5fd4251") failed: Property not found. retry in 1.496109762s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e3afa8c8-7f69-4d05-a0a3-37edc5fd4251
10602024-06-22T01:29:48.243ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_015b8ef4-20d3-41b1-aaea-f47794f2a754") failed: Property not found. retry in 1.065113787s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_015b8ef4-20d3-41b1-aaea-f47794f2a754
10612024-06-22T01:29:48.275ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_97317836-790a-40be-b49a-5480f32bf256: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService24"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::9"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value="vopte1"/> <propval type="astring" name="gateway" value="172.30.1.1"/> <propval type="astring" name="ip" value="172.30.1.6"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value="[fd00:1122:3344:101::9]:5353"/> <propval type="astring" name="dns_address" value="172.30.1.6:53"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10622024-06-22T01:29:48.276ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_external_dns_97317836-790a-40be-b49a-5480f32bf256
10632024-06-22T01:29:48.313ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a12b3721-98a8-4a75-8617-7177f9f59396") failed: Property not found. retry in 1.444177185s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a12b3721-98a8-4a75-8617-7177f9f59396
10642024-06-22T01:29:48.335ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f6647bd4-cd9a-4181-afc6-adef66316263") failed: Property not found. retry in 773.539783ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f6647bd4-cd9a-4181-afc6-adef66316263
10652024-06-22T01:29:48.439ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7e1b8a82-ac86-47b9-a8c8-b6fbe7e7c289") failed: Property not found. retry in 1.317559426s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7e1b8a82-ac86-47b9-a8c8-b6fbe7e7c289
10662024-06-22T01:29:48.509ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_76fb283e-fbaf-44ec-b242-dd9825b0141c") failed: Property not found. retry in 562.505474ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_76fb283e-fbaf-44ec-b242-dd9825b0141c
10672024-06-22T01:29:48.730ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_70b0163c-8d01-4c9f-a8c2-c24eae8b3ff8") failed: Property not found. retry in 1.454922895s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_70b0163c-8d01-4c9f-a8c2-c24eae8b3ff8
10682024-06-22T01:29:48.805ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9ad34640-3c63-473b-a9af-7eb2f4f8da74") failed: Property not found. retry in 1.409875519s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9ad34640-3c63-473b-a9af-7eb2f4f8da74
10692024-06-22T01:29:48.818ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_97317836-790a-40be-b49a-5480f32bf256") failed: Property not found. retry in 66.67011ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_97317836-790a-40be-b49a-5480f32bf256
10702024-06-22T01:29:48.902ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_97317836-790a-40be-b49a-5480f32bf256") failed: Property not found. retry in 69.649002ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_97317836-790a-40be-b49a-5480f32bf256
10712024-06-22T01:29:48.993ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_97317836-790a-40be-b49a-5480f32bf256") failed: Property not found. retry in 107.596938ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_97317836-790a-40be-b49a-5480f32bf256
10722024-06-22T01:29:49.010ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f4504525-7ee6-43d5-88ab-572513db1611") failed: Property not found. retry in 1.211798057s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f4504525-7ee6-43d5-88ab-572513db1611
10732024-06-22T01:29:49.023ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_10154e8d-8a44-4f4f-b3c2-df4ab2aa02b1") failed: Property not found. retry in 535.008267ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_10154e8d-8a44-4f4f-b3c2-df4ab2aa02b1
10742024-06-22T01:29:49.036ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_701fc4cb-14ab-4427-a48d-e3099ad7363a") failed: Property not found. retry in 593.257697ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_701fc4cb-14ab-4427-a48d-e3099ad7363a
10752024-06-22T01:29:49.085ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_76fb283e-fbaf-44ec-b242-dd9825b0141c") failed: Property not found. retry in 857.193342ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_76fb283e-fbaf-44ec-b242-dd9825b0141c
10762024-06-22T01:29:49.113ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_97317836-790a-40be-b49a-5480f32bf256") failed: Property not found. retry in 458.272469ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_97317836-790a-40be-b49a-5480f32bf256
10772024-06-22T01:29:49.124ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f6647bd4-cd9a-4181-afc6-adef66316263") failed: Property not found. retry in 755.422426ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f6647bd4-cd9a-4181-afc6-adef66316263
10782024-06-22T01:29:49.259ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_e0579974-e546-4f30-b7be-c7fca51ee278: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService25"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::b"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value="vopte2"/> <propval type="astring" name="gateway" value="172.30.2.1"/> <propval type="astring" name="ip" value="172.30.2.6"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10792024-06-22T01:29:49.259ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_nexus_e0579974-e546-4f30-b7be-c7fca51ee278
10802024-06-22T01:29:49.273ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_515131a9-573e-47f6-bfa4-fac433bd59f0: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService26"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::c"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value="vopte3"/> <propval type="astring" name="gateway" value="172.30.2.1"/> <propval type="astring" name="ip" value="172.30.2.7"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10812024-06-22T01:29:49.273ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_nexus_515131a9-573e-47f6-bfa4-fac433bd59f0
10822024-06-22T01:29:49.324ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_015b8ef4-20d3-41b1-aaea-f47794f2a754") failed: Property not found. retry in 798.253756ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_015b8ef4-20d3-41b1-aaea-f47794f2a754
10832024-06-22T01:29:49.390ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a94fe07b-8874-4ea2-866d-3a65c738a491") failed: Property not found. retry in 904.604852ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a94fe07b-8874-4ea2-866d-3a65c738a491
10842024-06-22T01:29:49.482ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ca38649f-9346-4829-ae87-5fc70fd55af4") failed: Property not found. retry in 1.129646912s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ca38649f-9346-4829-ae87-5fc70fd55af4
10852024-06-22T01:29:49.493ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e0579974-e546-4f30-b7be-c7fca51ee278") failed: Property not found. retry in 29.18567ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e0579974-e546-4f30-b7be-c7fca51ee278
10862024-06-22T01:29:49.503ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_515131a9-573e-47f6-bfa4-fac433bd59f0") failed: Property not found. retry in 38.274858ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_515131a9-573e-47f6-bfa4-fac433bd59f0
10872024-06-22T01:29:49.533ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e0579974-e546-4f30-b7be-c7fca51ee278") failed: Property not found. retry in 137.396426ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e0579974-e546-4f30-b7be-c7fca51ee278
10882024-06-22T01:29:49.552ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_515131a9-573e-47f6-bfa4-fac433bd59f0") failed: Property not found. retry in 64.197647ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_515131a9-573e-47f6-bfa4-fac433bd59f0
10892024-06-22T01:29:49.571ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_10154e8d-8a44-4f4f-b3c2-df4ab2aa02b1") failed: Property not found. retry in 1.045372499s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_10154e8d-8a44-4f4f-b3c2-df4ab2aa02b1
10902024-06-22T01:29:49.582ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_97317836-790a-40be-b49a-5480f32bf256") failed: Property not found. retry in 691.942823ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_97317836-790a-40be-b49a-5480f32bf256
10912024-06-22T01:29:49.627ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_515131a9-573e-47f6-bfa4-fac433bd59f0") failed: Property not found. retry in 256.687299ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_515131a9-573e-47f6-bfa4-fac433bd59f0
10922024-06-22T01:29:49.641ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_701fc4cb-14ab-4427-a48d-e3099ad7363a") failed: Property not found. retry in 705.309161ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_701fc4cb-14ab-4427-a48d-e3099ad7363a
10932024-06-22T01:29:49.683ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e0579974-e546-4f30-b7be-c7fca51ee278") failed: Property not found. retry in 120.2519ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e0579974-e546-4f30-b7be-c7fca51ee278
10942024-06-22T01:29:49.725ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3afa8c8-7f69-4d05-a0a3-37edc5fd4251") failed: Property not found. retry in 613.707911ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e3afa8c8-7f69-4d05-a0a3-37edc5fd4251
10952024-06-22T01:29:49.770ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7e1b8a82-ac86-47b9-a8c8-b6fbe7e7c289") failed: Property not found. retry in 967.423696ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7e1b8a82-ac86-47b9-a8c8-b6fbe7e7c289
10962024-06-22T01:29:49.781ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a12b3721-98a8-4a75-8617-7177f9f59396") failed: Property not found. retry in 1.055740723s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a12b3721-98a8-4a75-8617-7177f9f59396
10972024-06-22T01:29:49.818ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e0579974-e546-4f30-b7be-c7fca51ee278") failed: Property not found. retry in 370.310739ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e0579974-e546-4f30-b7be-c7fca51ee278
10982024-06-22T01:29:49.861ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_a2874889-f5ed-46ab-b850-c6b4c440c268: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService13"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::e"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::e"/> <propval type="astring" name="listen_port" value="8123"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10992024-06-22T01:29:49.861ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_clickhouse_a2874889-f5ed-46ab-b850-c6b4c440c268
11002024-06-22T01:29:49.892ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f6647bd4-cd9a-4181-afc6-adef66316263") failed: Property not found. retry in 1.027774138s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f6647bd4-cd9a-4181-afc6-adef66316263
11012024-06-22T01:29:49.907ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_515131a9-573e-47f6-bfa4-fac433bd59f0") failed: Property not found. retry in 224.226432ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_515131a9-573e-47f6-bfa4-fac433bd59f0
11022024-06-22T01:29:49.953ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 2.210915427s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:417 sled_id = 9f7cbf52-de0d-48c8-9e7d-2958552743a4
11032024-06-22T01:29:49.966ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_76fb283e-fbaf-44ec-b242-dd9825b0141c") failed: Property not found. retry in 533.507784ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_76fb283e-fbaf-44ec-b242-dd9825b0141c
11042024-06-22T01:29:50.136ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_015b8ef4-20d3-41b1-aaea-f47794f2a754") failed: Property not found. retry in 791.021197ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_015b8ef4-20d3-41b1-aaea-f47794f2a754
11052024-06-22T01:29:50.148ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_515131a9-573e-47f6-bfa4-fac433bd59f0") failed: Property not found. retry in 894.7989ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_515131a9-573e-47f6-bfa4-fac433bd59f0
11062024-06-22T01:29:50.185ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_a2874889-f5ed-46ab-b850-c6b4c440c268") failed: Property not found. retry in 70.516154ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_a2874889-f5ed-46ab-b850-c6b4c440c268
11072024-06-22T01:29:50.196ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_70b0163c-8d01-4c9f-a8c2-c24eae8b3ff8") failed: Property not found. retry in 1.024061017s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_70b0163c-8d01-4c9f-a8c2-c24eae8b3ff8
11082024-06-22T01:29:50.208ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e0579974-e546-4f30-b7be-c7fca51ee278") failed: Property not found. retry in 855.942699ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e0579974-e546-4f30-b7be-c7fca51ee278
11092024-06-22T01:29:50.227ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9ad34640-3c63-473b-a9af-7eb2f4f8da74") failed: Property not found. retry in 1.043370824s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9ad34640-3c63-473b-a9af-7eb2f4f8da74
11102024-06-22T01:29:50.238ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f4504525-7ee6-43d5-88ab-572513db1611") failed: Property not found. retry in 572.656461ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f4504525-7ee6-43d5-88ab-572513db1611
11112024-06-22T01:29:50.266ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_a2874889-f5ed-46ab-b850-c6b4c440c268") failed: Property not found. retry in 56.835914ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_a2874889-f5ed-46ab-b850-c6b4c440c268
11122024-06-22T01:29:50.284ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_97317836-790a-40be-b49a-5480f32bf256") failed: Property not found. retry in 1.183314161s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_97317836-790a-40be-b49a-5480f32bf256
11132024-06-22T01:29:50.307ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a94fe07b-8874-4ea2-866d-3a65c738a491") failed: Property not found. retry in 871.280562ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a94fe07b-8874-4ea2-866d-3a65c738a491
11142024-06-22T01:29:50.332ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_a2874889-f5ed-46ab-b850-c6b4c440c268") failed: Property not found. retry in 168.254209ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_a2874889-f5ed-46ab-b850-c6b4c440c268
11152024-06-22T01:29:50.351ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3afa8c8-7f69-4d05-a0a3-37edc5fd4251") failed: Property not found. retry in 679.57612ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e3afa8c8-7f69-4d05-a0a3-37edc5fd4251
11162024-06-22T01:29:50.360ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_701fc4cb-14ab-4427-a48d-e3099ad7363a") failed: Property not found. retry in 1.348483643s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_701fc4cb-14ab-4427-a48d-e3099ad7363a
11172024-06-22T01:29:50.512ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_76fb283e-fbaf-44ec-b242-dd9825b0141c") failed: Property not found. retry in 1.224387045s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_76fb283e-fbaf-44ec-b242-dd9825b0141c
11182024-06-22T01:29:50.523ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_a2874889-f5ed-46ab-b850-c6b4c440c268") failed: Property not found. retry in 328.611719ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_a2874889-f5ed-46ab-b850-c6b4c440c268
11192024-06-22T01:29:50.626ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ca38649f-9346-4829-ae87-5fc70fd55af4") failed: Property not found. retry in 810.475314ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ca38649f-9346-4829-ae87-5fc70fd55af4
11202024-06-22T01:29:50.637ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_10154e8d-8a44-4f4f-b3c2-df4ab2aa02b1") failed: Property not found. retry in 1.322067131s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_10154e8d-8a44-4f4f-b3c2-df4ab2aa02b1
11212024-06-22T01:29:50.751ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7e1b8a82-ac86-47b9-a8c8-b6fbe7e7c289") failed: Property not found. retry in 1.316252174s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7e1b8a82-ac86-47b9-a8c8-b6fbe7e7c289
11222024-06-22T01:29:50.823ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f4504525-7ee6-43d5-88ab-572513db1611") failed: Property not found. retry in 1.161304701s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f4504525-7ee6-43d5-88ab-572513db1611
11232024-06-22T01:29:50.850ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a12b3721-98a8-4a75-8617-7177f9f59396") failed: Property not found. retry in 800.760509ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a12b3721-98a8-4a75-8617-7177f9f59396
11242024-06-22T01:29:50.862ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_a2874889-f5ed-46ab-b850-c6b4c440c268") failed: Property not found. retry in 1.150483412s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_a2874889-f5ed-46ab-b850-c6b4c440c268
11252024-06-22T01:29:50.932ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f6647bd4-cd9a-4181-afc6-adef66316263") failed: Property not found. retry in 885.417579ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f6647bd4-cd9a-4181-afc6-adef66316263
11262024-06-22T01:29:50.945ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_015b8ef4-20d3-41b1-aaea-f47794f2a754") failed: Property not found. retry in 1.23568027s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_015b8ef4-20d3-41b1-aaea-f47794f2a754
11272024-06-22T01:29:51.043ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3afa8c8-7f69-4d05-a0a3-37edc5fd4251") failed: Property not found. retry in 897.667703ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e3afa8c8-7f69-4d05-a0a3-37edc5fd4251
11282024-06-22T01:29:51.056ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_515131a9-573e-47f6-bfa4-fac433bd59f0") failed: Property not found. retry in 1.31888741s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_515131a9-573e-47f6-bfa4-fac433bd59f0
11292024-06-22T01:29:51.076ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e0579974-e546-4f30-b7be-c7fca51ee278") failed: Property not found. retry in 1.192433004s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e0579974-e546-4f30-b7be-c7fca51ee278
11302024-06-22T01:29:51.193ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a94fe07b-8874-4ea2-866d-3a65c738a491") failed: Property not found. retry in 907.936688ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a94fe07b-8874-4ea2-866d-3a65c738a491
11312024-06-22T01:29:51.233ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_70b0163c-8d01-4c9f-a8c2-c24eae8b3ff8") failed: Property not found. retry in 1.047096761s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_70b0163c-8d01-4c9f-a8c2-c24eae8b3ff8
11322024-06-22T01:29:51.284ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9ad34640-3c63-473b-a9af-7eb2f4f8da74") failed: Property not found. retry in 1.10849851s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9ad34640-3c63-473b-a9af-7eb2f4f8da74
11332024-06-22T01:29:51.511ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ca38649f-9346-4829-ae87-5fc70fd55af4") failed: Property not found. retry in 1.472280963s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ca38649f-9346-4829-ae87-5fc70fd55af4
11342024-06-22T01:29:51.533ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_97317836-790a-40be-b49a-5480f32bf256") failed: Property not found. retry in 1.071597588s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_97317836-790a-40be-b49a-5480f32bf256
11352024-06-22T01:29:51.677ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a12b3721-98a8-4a75-8617-7177f9f59396") failed: Property not found. retry in 1.136400446s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a12b3721-98a8-4a75-8617-7177f9f59396
11362024-06-22T01:29:51.727ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_701fc4cb-14ab-4427-a48d-e3099ad7363a") failed: Property not found. retry in 539.159006ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_701fc4cb-14ab-4427-a48d-e3099ad7363a
11372024-06-22T01:29:51.769ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_76fb283e-fbaf-44ec-b242-dd9825b0141c") failed: Property not found. retry in 1.264369942s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_76fb283e-fbaf-44ec-b242-dd9825b0141c
11382024-06-22T01:29:51.840ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f6647bd4-cd9a-4181-afc6-adef66316263") failed: Property not found. retry in 620.544265ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f6647bd4-cd9a-4181-afc6-adef66316263
11392024-06-22T01:29:51.954ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3afa8c8-7f69-4d05-a0a3-37edc5fd4251") failed: Property not found. retry in 930.937269ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e3afa8c8-7f69-4d05-a0a3-37edc5fd4251
11402024-06-22T01:29:51.973ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_10154e8d-8a44-4f4f-b3c2-df4ab2aa02b1") failed: Property not found. retry in 610.514982ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_10154e8d-8a44-4f4f-b3c2-df4ab2aa02b1
11412024-06-22T01:29:51.998ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f4504525-7ee6-43d5-88ab-572513db1611") failed: Property not found. retry in 752.609297ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f4504525-7ee6-43d5-88ab-572513db1611
11422024-06-22T01:29:52.027ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_a2874889-f5ed-46ab-b850-c6b4c440c268") failed: Property not found. retry in 871.861172ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_a2874889-f5ed-46ab-b850-c6b4c440c268
11432024-06-22T01:29:52.082ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7e1b8a82-ac86-47b9-a8c8-b6fbe7e7c289") failed: Property not found. retry in 956.991387ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7e1b8a82-ac86-47b9-a8c8-b6fbe7e7c289
11442024-06-22T01:29:52.115ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a94fe07b-8874-4ea2-866d-3a65c738a491") failed: Property not found. retry in 578.18641ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a94fe07b-8874-4ea2-866d-3a65c738a491
11452024-06-22T01:29:52.238ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_015b8ef4-20d3-41b1-aaea-f47794f2a754") failed: Property not found. retry in 847.282825ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_015b8ef4-20d3-41b1-aaea-f47794f2a754
11462024-06-22T01:29:52.284ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_701fc4cb-14ab-4427-a48d-e3099ad7363a") failed: Property not found. retry in 1.402074802s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_701fc4cb-14ab-4427-a48d-e3099ad7363a
11472024-06-22T01:29:52.341ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e0579974-e546-4f30-b7be-c7fca51ee278") failed: Property not found. retry in 1.087710729s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e0579974-e546-4f30-b7be-c7fca51ee278
11482024-06-22T01:29:52.396ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_70b0163c-8d01-4c9f-a8c2-c24eae8b3ff8") failed: Property not found. retry in 766.878504ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_70b0163c-8d01-4c9f-a8c2-c24eae8b3ff8
11492024-06-22T01:29:52.456ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_515131a9-573e-47f6-bfa4-fac433bd59f0") failed: Property not found. retry in 1.103341462s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_515131a9-573e-47f6-bfa4-fac433bd59f0
11502024-06-22T01:29:52.549ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9ad34640-3c63-473b-a9af-7eb2f4f8da74") failed: Property not found. retry in 766.688876ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9ad34640-3c63-473b-a9af-7eb2f4f8da74
11512024-06-22T01:29:52.581ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f6647bd4-cd9a-4181-afc6-adef66316263") failed: Property not found. retry in 596.297033ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f6647bd4-cd9a-4181-afc6-adef66316263
11522024-06-22T01:29:52.598ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_10154e8d-8a44-4f4f-b3c2-df4ab2aa02b1") failed: Property not found. retry in 718.766223ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_10154e8d-8a44-4f4f-b3c2-df4ab2aa02b1
11532024-06-22T01:29:52.617ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_97317836-790a-40be-b49a-5480f32bf256") failed: Property not found. retry in 971.107914ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_97317836-790a-40be-b49a-5480f32bf256
11542024-06-22T01:29:52.710ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a94fe07b-8874-4ea2-866d-3a65c738a491") failed: Property not found. retry in 1.194638208s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a94fe07b-8874-4ea2-866d-3a65c738a491
11552024-06-22T01:29:52.764ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f4504525-7ee6-43d5-88ab-572513db1611") failed: Property not found. retry in 1.067404642s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f4504525-7ee6-43d5-88ab-572513db1611
11562024-06-22T01:29:52.828ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a12b3721-98a8-4a75-8617-7177f9f59396") failed: Property not found. retry in 1.415105832s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a12b3721-98a8-4a75-8617-7177f9f59396
11572024-06-22T01:29:52.900ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3afa8c8-7f69-4d05-a0a3-37edc5fd4251") failed: Property not found. retry in 1.013518936s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e3afa8c8-7f69-4d05-a0a3-37edc5fd4251
11582024-06-22T01:29:52.915ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_a2874889-f5ed-46ab-b850-c6b4c440c268") failed: Property not found. retry in 1.357087782s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_a2874889-f5ed-46ab-b850-c6b4c440c268
11592024-06-22T01:29:53.001ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ca38649f-9346-4829-ae87-5fc70fd55af4") failed: Property not found. retry in 1.255605416s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ca38649f-9346-4829-ae87-5fc70fd55af4
11602024-06-22T01:29:53.048ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_76fb283e-fbaf-44ec-b242-dd9825b0141c") failed: Property not found. retry in 749.540587ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_76fb283e-fbaf-44ec-b242-dd9825b0141c
11612024-06-22T01:29:53.061ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7e1b8a82-ac86-47b9-a8c8-b6fbe7e7c289") failed: Property not found. retry in 542.225548ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7e1b8a82-ac86-47b9-a8c8-b6fbe7e7c289
11622024-06-22T01:29:53.098ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_015b8ef4-20d3-41b1-aaea-f47794f2a754") failed: Property not found. retry in 720.359474ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_015b8ef4-20d3-41b1-aaea-f47794f2a754
11632024-06-22T01:29:53.178ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_70b0163c-8d01-4c9f-a8c2-c24eae8b3ff8") failed: Property not found. retry in 825.026609ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_70b0163c-8d01-4c9f-a8c2-c24eae8b3ff8
11642024-06-22T01:29:53.190ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f6647bd4-cd9a-4181-afc6-adef66316263") failed: Property not found. retry in 903.017544ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f6647bd4-cd9a-4181-afc6-adef66316263
11652024-06-22T01:29:53.329ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9ad34640-3c63-473b-a9af-7eb2f4f8da74") failed: Property not found. retry in 706.605024ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9ad34640-3c63-473b-a9af-7eb2f4f8da74
11662024-06-22T01:29:53.341ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_10154e8d-8a44-4f4f-b3c2-df4ab2aa02b1") failed: Property not found. retry in 1.112494052s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_10154e8d-8a44-4f4f-b3c2-df4ab2aa02b1
11672024-06-22T01:29:53.443ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e0579974-e546-4f30-b7be-c7fca51ee278") failed: Property not found. retry in 1.148436615s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e0579974-e546-4f30-b7be-c7fca51ee278
11682024-06-22T01:29:53.572ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_515131a9-573e-47f6-bfa4-fac433bd59f0") failed: Property not found. retry in 1.077156178s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_515131a9-573e-47f6-bfa4-fac433bd59f0
11692024-06-22T01:29:53.601ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_97317836-790a-40be-b49a-5480f32bf256") failed: Property not found. retry in 1.116134965s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_97317836-790a-40be-b49a-5480f32bf256
11702024-06-22T01:29:53.617ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7e1b8a82-ac86-47b9-a8c8-b6fbe7e7c289") failed: Property not found. retry in 1.091700436s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7e1b8a82-ac86-47b9-a8c8-b6fbe7e7c289
11712024-06-22T01:29:53.699ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_701fc4cb-14ab-4427-a48d-e3099ad7363a") failed: Property not found. retry in 883.330951ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_701fc4cb-14ab-4427-a48d-e3099ad7363a
11722024-06-22T01:29:53.813ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_76fb283e-fbaf-44ec-b242-dd9825b0141c") failed: Property not found. retry in 806.370931ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_76fb283e-fbaf-44ec-b242-dd9825b0141c
11732024-06-22T01:29:53.832ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_015b8ef4-20d3-41b1-aaea-f47794f2a754") failed: Property not found. retry in 1.171322852s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_015b8ef4-20d3-41b1-aaea-f47794f2a754
11742024-06-22T01:29:53.844ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f4504525-7ee6-43d5-88ab-572513db1611") failed: Property not found. retry in 1.310389892s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f4504525-7ee6-43d5-88ab-572513db1611
11752024-06-22T01:29:53.917ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a94fe07b-8874-4ea2-866d-3a65c738a491") failed: Property not found. retry in 1.160209492s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a94fe07b-8874-4ea2-866d-3a65c738a491
11762024-06-22T01:29:53.928ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3afa8c8-7f69-4d05-a0a3-37edc5fd4251") failed: Property not found. retry in 752.580884ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e3afa8c8-7f69-4d05-a0a3-37edc5fd4251
11772024-06-22T01:29:54.018ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_70b0163c-8d01-4c9f-a8c2-c24eae8b3ff8") failed: Property not found. retry in 1.150733411s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_70b0163c-8d01-4c9f-a8c2-c24eae8b3ff8
11782024-06-22T01:29:54.048ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9ad34640-3c63-473b-a9af-7eb2f4f8da74") failed: Property not found. retry in 1.483662498s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9ad34640-3c63-473b-a9af-7eb2f4f8da74
11792024-06-22T01:29:54.107ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f6647bd4-cd9a-4181-afc6-adef66316263") failed: Property not found. retry in 1.248351041s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f6647bd4-cd9a-4181-afc6-adef66316263
11802024-06-22T01:29:54.256ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a12b3721-98a8-4a75-8617-7177f9f59396") failed: Property not found. retry in 942.828288ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a12b3721-98a8-4a75-8617-7177f9f59396
11812024-06-22T01:29:54.270ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ca38649f-9346-4829-ae87-5fc70fd55af4") failed: Property not found. retry in 985.75065ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ca38649f-9346-4829-ae87-5fc70fd55af4
11822024-06-22T01:29:54.285ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_a2874889-f5ed-46ab-b850-c6b4c440c268") failed: Property not found. retry in 762.725964ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_a2874889-f5ed-46ab-b850-c6b4c440c268
11832024-06-22T01:29:54.466ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_10154e8d-8a44-4f4f-b3c2-df4ab2aa02b1") failed: Property not found. retry in 1.313370867s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_10154e8d-8a44-4f4f-b3c2-df4ab2aa02b1
11842024-06-22T01:29:54.592ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_701fc4cb-14ab-4427-a48d-e3099ad7363a") failed: Property not found. retry in 897.41044ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_701fc4cb-14ab-4427-a48d-e3099ad7363a
11852024-06-22T01:29:54.601ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e0579974-e546-4f30-b7be-c7fca51ee278") failed: Property not found. retry in 701.127975ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e0579974-e546-4f30-b7be-c7fca51ee278
11862024-06-22T01:29:54.630ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_76fb283e-fbaf-44ec-b242-dd9825b0141c") failed: Property not found. retry in 1.387292755s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_76fb283e-fbaf-44ec-b242-dd9825b0141c
11872024-06-22T01:29:54.659ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_515131a9-573e-47f6-bfa4-fac433bd59f0") failed: Property not found. retry in 1.314046114s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_515131a9-573e-47f6-bfa4-fac433bd59f0
11882024-06-22T01:29:54.690ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3afa8c8-7f69-4d05-a0a3-37edc5fd4251") failed: Property not found. retry in 958.236111ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e3afa8c8-7f69-4d05-a0a3-37edc5fd4251
11892024-06-22T01:29:54.717ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7e1b8a82-ac86-47b9-a8c8-b6fbe7e7c289") failed: Property not found. retry in 820.36235ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7e1b8a82-ac86-47b9-a8c8-b6fbe7e7c289
11902024-06-22T01:29:54.725ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_97317836-790a-40be-b49a-5480f32bf256") failed: Property not found. retry in 1.156903669s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_97317836-790a-40be-b49a-5480f32bf256
11912024-06-22T01:29:55.014ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_015b8ef4-20d3-41b1-aaea-f47794f2a754") failed: Property not found. retry in 655.038733ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_015b8ef4-20d3-41b1-aaea-f47794f2a754
11922024-06-22T01:29:55.059ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_a2874889-f5ed-46ab-b850-c6b4c440c268") failed: Property not found. retry in 1.129887703s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_a2874889-f5ed-46ab-b850-c6b4c440c268
11932024-06-22T01:29:55.088ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a94fe07b-8874-4ea2-866d-3a65c738a491") failed: Property not found. retry in 1.360258545s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a94fe07b-8874-4ea2-866d-3a65c738a491
11942024-06-22T01:29:55.164ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f4504525-7ee6-43d5-88ab-572513db1611") failed: Property not found. retry in 708.447311ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f4504525-7ee6-43d5-88ab-572513db1611
11952024-06-22T01:29:55.178ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_70b0163c-8d01-4c9f-a8c2-c24eae8b3ff8") failed: Property not found. retry in 1.053167823s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_70b0163c-8d01-4c9f-a8c2-c24eae8b3ff8
11962024-06-22T01:29:55.207ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a12b3721-98a8-4a75-8617-7177f9f59396") failed: Property not found. retry in 1.227908866s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a12b3721-98a8-4a75-8617-7177f9f59396
11972024-06-22T01:29:55.266ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ca38649f-9346-4829-ae87-5fc70fd55af4") failed: Property not found. retry in 1.070166836s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ca38649f-9346-4829-ae87-5fc70fd55af4
11982024-06-22T01:29:55.312ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e0579974-e546-4f30-b7be-c7fca51ee278") failed: Property not found. retry in 918.495305ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e0579974-e546-4f30-b7be-c7fca51ee278
11992024-06-22T01:29:55.365ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f6647bd4-cd9a-4181-afc6-adef66316263") failed: Property not found. retry in 1.177251026s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f6647bd4-cd9a-4181-afc6-adef66316263
12002024-06-22T01:29:55.500ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_701fc4cb-14ab-4427-a48d-e3099ad7363a") failed: Property not found. retry in 869.460482ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_701fc4cb-14ab-4427-a48d-e3099ad7363a
12012024-06-22T01:29:55.543ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9ad34640-3c63-473b-a9af-7eb2f4f8da74") failed: Property not found. retry in 910.876895ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9ad34640-3c63-473b-a9af-7eb2f4f8da74
12022024-06-22T01:29:55.552ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7e1b8a82-ac86-47b9-a8c8-b6fbe7e7c289") failed: Property not found. retry in 1.445387877s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7e1b8a82-ac86-47b9-a8c8-b6fbe7e7c289
12032024-06-22T01:29:55.658ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3afa8c8-7f69-4d05-a0a3-37edc5fd4251") failed: Property not found. retry in 1.376621662s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e3afa8c8-7f69-4d05-a0a3-37edc5fd4251
12042024-06-22T01:29:55.678ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_015b8ef4-20d3-41b1-aaea-f47794f2a754") failed: Property not found. retry in 1.257719008s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_015b8ef4-20d3-41b1-aaea-f47794f2a754
12052024-06-22T01:29:55.789ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_10154e8d-8a44-4f4f-b3c2-df4ab2aa02b1") failed: Property not found. retry in 1.065279714s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_10154e8d-8a44-4f4f-b3c2-df4ab2aa02b1
12062024-06-22T01:29:55.884ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f4504525-7ee6-43d5-88ab-572513db1611") failed: Property not found. retry in 887.219058ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f4504525-7ee6-43d5-88ab-572513db1611
12072024-06-22T01:29:55.893ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_97317836-790a-40be-b49a-5480f32bf256") failed: Property not found. retry in 1.325414519s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_97317836-790a-40be-b49a-5480f32bf256
12082024-06-22T01:29:55.987ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_515131a9-573e-47f6-bfa4-fac433bd59f0") failed: Property not found. retry in 796.911969ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_515131a9-573e-47f6-bfa4-fac433bd59f0
12092024-06-22T01:29:56.029ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_76fb283e-fbaf-44ec-b242-dd9825b0141c") failed: Property not found. retry in 1.121983077s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_76fb283e-fbaf-44ec-b242-dd9825b0141c
12102024-06-22T01:29:56.204ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_a2874889-f5ed-46ab-b850-c6b4c440c268") failed: Property not found. retry in 1.342177963s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_a2874889-f5ed-46ab-b850-c6b4c440c268
12112024-06-22T01:29:56.244ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e0579974-e546-4f30-b7be-c7fca51ee278") failed: Property not found. retry in 1.117226315s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e0579974-e546-4f30-b7be-c7fca51ee278
12122024-06-22T01:29:56.256ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_70b0163c-8d01-4c9f-a8c2-c24eae8b3ff8") failed: Property not found. retry in 973.510795ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_70b0163c-8d01-4c9f-a8c2-c24eae8b3ff8
12132024-06-22T01:29:56.348ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ca38649f-9346-4829-ae87-5fc70fd55af4") failed: Property not found. retry in 782.114019ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ca38649f-9346-4829-ae87-5fc70fd55af4
12142024-06-22T01:29:56.378ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_701fc4cb-14ab-4427-a48d-e3099ad7363a") failed: Property not found. retry in 847.92325ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_701fc4cb-14ab-4427-a48d-e3099ad7363a
12152024-06-22T01:29:56.444ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a12b3721-98a8-4a75-8617-7177f9f59396") failed: Property not found. retry in 1.2686807s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a12b3721-98a8-4a75-8617-7177f9f59396
12162024-06-22T01:29:56.456ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a94fe07b-8874-4ea2-866d-3a65c738a491") failed: Property not found. retry in 583.519704ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a94fe07b-8874-4ea2-866d-3a65c738a491
12172024-06-22T01:29:56.464ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9ad34640-3c63-473b-a9af-7eb2f4f8da74") failed: Property not found. retry in 687.815455ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9ad34640-3c63-473b-a9af-7eb2f4f8da74
12182024-06-22T01:29:56.550ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f6647bd4-cd9a-4181-afc6-adef66316263") failed: Property not found. retry in 1.152474353s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f6647bd4-cd9a-4181-afc6-adef66316263
12192024-06-22T01:29:56.780ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f4504525-7ee6-43d5-88ab-572513db1611") failed: Property not found. retry in 618.375836ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f4504525-7ee6-43d5-88ab-572513db1611
12202024-06-22T01:29:56.793ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_515131a9-573e-47f6-bfa4-fac433bd59f0") failed: Property not found. retry in 1.391614922s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_515131a9-573e-47f6-bfa4-fac433bd59f0
12212024-06-22T01:29:56.864ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_10154e8d-8a44-4f4f-b3c2-df4ab2aa02b1") failed: Property not found. retry in 1.420158512s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_10154e8d-8a44-4f4f-b3c2-df4ab2aa02b1
12222024-06-22T01:29:56.945ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_015b8ef4-20d3-41b1-aaea-f47794f2a754") failed: Property not found. retry in 1.388738983s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_015b8ef4-20d3-41b1-aaea-f47794f2a754
12232024-06-22T01:29:57.006ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7e1b8a82-ac86-47b9-a8c8-b6fbe7e7c289") failed: Property not found. retry in 697.050463ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7e1b8a82-ac86-47b9-a8c8-b6fbe7e7c289
12242024-06-22T01:29:57.044ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3afa8c8-7f69-4d05-a0a3-37edc5fd4251") failed: Property not found. retry in 1.483647425s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e3afa8c8-7f69-4d05-a0a3-37edc5fd4251
12252024-06-22T01:29:57.051ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a94fe07b-8874-4ea2-866d-3a65c738a491") failed: Property not found. retry in 993.035914ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a94fe07b-8874-4ea2-866d-3a65c738a491
12262024-06-22T01:29:57.140ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ca38649f-9346-4829-ae87-5fc70fd55af4") failed: Property not found. retry in 1.42923149s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ca38649f-9346-4829-ae87-5fc70fd55af4
12272024-06-22T01:29:57.161ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9ad34640-3c63-473b-a9af-7eb2f4f8da74") failed: Property not found. retry in 1.217572921s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9ad34640-3c63-473b-a9af-7eb2f4f8da74
12282024-06-22T01:29:57.168ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_76fb283e-fbaf-44ec-b242-dd9825b0141c") failed: Property not found. retry in 682.721945ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_76fb283e-fbaf-44ec-b242-dd9825b0141c
12292024-06-22T01:29:57.228ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_97317836-790a-40be-b49a-5480f32bf256") failed: Property not found. retry in 880.159463ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_97317836-790a-40be-b49a-5480f32bf256
12302024-06-22T01:29:57.239ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_701fc4cb-14ab-4427-a48d-e3099ad7363a") failed: Property not found. retry in 1.496052243s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_701fc4cb-14ab-4427-a48d-e3099ad7363a
12312024-06-22T01:29:57.249ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_70b0163c-8d01-4c9f-a8c2-c24eae8b3ff8") failed: Property not found. retry in 1.131224285s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_70b0163c-8d01-4c9f-a8c2-c24eae8b3ff8
12322024-06-22T01:29:57.377ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e0579974-e546-4f30-b7be-c7fca51ee278") failed: Property not found. retry in 501.121716ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e0579974-e546-4f30-b7be-c7fca51ee278
12332024-06-22T01:29:57.419ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f4504525-7ee6-43d5-88ab-572513db1611") failed: Property not found. retry in 698.287437ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f4504525-7ee6-43d5-88ab-572513db1611
12342024-06-22T01:29:57.536ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_16f8da3d-c462-4156-86a4-9082477e2e5b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService27"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::a"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value="vopte4"/> <propval type="astring" name="gateway" value="172.30.2.1"/> <propval type="astring" name="ip" value="172.30.2.5"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12352024-06-22T01:29:57.536ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_nexus_16f8da3d-c462-4156-86a4-9082477e2e5b
12362024-06-22T01:29:57.561ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_a2874889-f5ed-46ab-b850-c6b4c440c268") failed: Property not found. retry in 1.427081537s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_a2874889-f5ed-46ab-b850-c6b4c440c268
12372024-06-22T01:29:57.714ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f6647bd4-cd9a-4181-afc6-adef66316263") failed: Property not found. retry in 597.490961ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f6647bd4-cd9a-4181-afc6-adef66316263
12382024-06-22T01:29:57.722ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a12b3721-98a8-4a75-8617-7177f9f59396") failed: Property not found. retry in 832.75678ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a12b3721-98a8-4a75-8617-7177f9f59396
12392024-06-22T01:29:57.732ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7e1b8a82-ac86-47b9-a8c8-b6fbe7e7c289") failed: Property not found. retry in 918.015892ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7e1b8a82-ac86-47b9-a8c8-b6fbe7e7c289
12402024-06-22T01:29:57.741ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_16f8da3d-c462-4156-86a4-9082477e2e5b") failed: Property not found. retry in 52.155214ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_16f8da3d-c462-4156-86a4-9082477e2e5b
12412024-06-22T01:29:57.803ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_16f8da3d-c462-4156-86a4-9082477e2e5b") failed: Property not found. retry in 92.396891ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_16f8da3d-c462-4156-86a4-9082477e2e5b
12422024-06-22T01:29:57.862ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_76fb283e-fbaf-44ec-b242-dd9825b0141c") failed: Property not found. retry in 850.24486ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_76fb283e-fbaf-44ec-b242-dd9825b0141c
12432024-06-22T01:29:57.892ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e0579974-e546-4f30-b7be-c7fca51ee278") failed: Property not found. retry in 1.439142799s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e0579974-e546-4f30-b7be-c7fca51ee278
12442024-06-22T01:29:57.906ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_16f8da3d-c462-4156-86a4-9082477e2e5b") failed: Property not found. retry in 256.904101ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_16f8da3d-c462-4156-86a4-9082477e2e5b
12452024-06-22T01:29:57.983ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_4794eccf-57ac-4bf0-8ea5-3b0d68786898: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService28"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::8"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value="vopte5"/> <propval type="astring" name="gateway" value="172.30.1.1"/> <propval type="astring" name="ip" value="172.30.1.5"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value="[fd00:1122:3344:101::8]:5353"/> <propval type="astring" name="dns_address" value="172.30.1.5:53"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12462024-06-22T01:29:57.983ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_external_dns_4794eccf-57ac-4bf0-8ea5-3b0d68786898
12472024-06-22T01:29:58.055ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a94fe07b-8874-4ea2-866d-3a65c738a491") failed: Property not found. retry in 716.069246ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a94fe07b-8874-4ea2-866d-3a65c738a491
12482024-06-22T01:29:58.119ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_97317836-790a-40be-b49a-5480f32bf256") failed: Property not found. retry in 923.270363ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_97317836-790a-40be-b49a-5480f32bf256
12492024-06-22T01:29:58.128ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f4504525-7ee6-43d5-88ab-572513db1611") failed: Property not found. retry in 1.097337808s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f4504525-7ee6-43d5-88ab-572513db1611
12502024-06-22T01:29:58.146ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4794eccf-57ac-4bf0-8ea5-3b0d68786898") failed: Property not found. retry in 40.639364ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4794eccf-57ac-4bf0-8ea5-3b0d68786898
12512024-06-22T01:29:58.174ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_16f8da3d-c462-4156-86a4-9082477e2e5b") failed: Property not found. retry in 565.150383ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_16f8da3d-c462-4156-86a4-9082477e2e5b
12522024-06-22T01:29:58.194ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_515131a9-573e-47f6-bfa4-fac433bd59f0") failed: Property not found. retry in 1.428695242s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_515131a9-573e-47f6-bfa4-fac433bd59f0
12532024-06-22T01:29:58.202ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4794eccf-57ac-4bf0-8ea5-3b0d68786898") failed: Property not found. retry in 134.163594ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4794eccf-57ac-4bf0-8ea5-3b0d68786898
12542024-06-22T01:29:58.297ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_10154e8d-8a44-4f4f-b3c2-df4ab2aa02b1") failed: Property not found. retry in 1.254638735s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_10154e8d-8a44-4f4f-b3c2-df4ab2aa02b1
12552024-06-22T01:29:58.322ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f6647bd4-cd9a-4181-afc6-adef66316263") failed: Property not found. retry in 1.02652387s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f6647bd4-cd9a-4181-afc6-adef66316263
12562024-06-22T01:29:58.348ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_015b8ef4-20d3-41b1-aaea-f47794f2a754") failed: Property not found. retry in 871.629103ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_015b8ef4-20d3-41b1-aaea-f47794f2a754
12572024-06-22T01:29:58.370ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4794eccf-57ac-4bf0-8ea5-3b0d68786898") failed: Property not found. retry in 233.334691ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4794eccf-57ac-4bf0-8ea5-3b0d68786898
12582024-06-22T01:29:58.388ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9ad34640-3c63-473b-a9af-7eb2f4f8da74") failed: Property not found. retry in 1.305653879s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9ad34640-3c63-473b-a9af-7eb2f4f8da74
12592024-06-22T01:29:58.397ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_70b0163c-8d01-4c9f-a8c2-c24eae8b3ff8") failed: Property not found. retry in 987.244235ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_70b0163c-8d01-4c9f-a8c2-c24eae8b3ff8
12602024-06-22T01:29:58.538ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3afa8c8-7f69-4d05-a0a3-37edc5fd4251") failed: Property not found. retry in 771.005066ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e3afa8c8-7f69-4d05-a0a3-37edc5fd4251
12612024-06-22T01:29:58.566ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a12b3721-98a8-4a75-8617-7177f9f59396") failed: Property not found. retry in 1.308934837s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a12b3721-98a8-4a75-8617-7177f9f59396
12622024-06-22T01:29:58.580ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ca38649f-9346-4829-ae87-5fc70fd55af4") failed: Property not found. retry in 1.003502452s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ca38649f-9346-4829-ae87-5fc70fd55af4
12632024-06-22T01:29:58.613ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4794eccf-57ac-4bf0-8ea5-3b0d68786898") failed: Property not found. retry in 218.864098ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4794eccf-57ac-4bf0-8ea5-3b0d68786898
12642024-06-22T01:29:58.659ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7e1b8a82-ac86-47b9-a8c8-b6fbe7e7c289") failed: Property not found. retry in 1.210168527s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7e1b8a82-ac86-47b9-a8c8-b6fbe7e7c289
12652024-06-22T01:29:58.723ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_76fb283e-fbaf-44ec-b242-dd9825b0141c") failed: Property not found. retry in 573.128744ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_76fb283e-fbaf-44ec-b242-dd9825b0141c
12662024-06-22T01:29:58.746ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_701fc4cb-14ab-4427-a48d-e3099ad7363a") failed: Property not found. retry in 1.358783533s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_701fc4cb-14ab-4427-a48d-e3099ad7363a
12672024-06-22T01:29:58.754ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_16f8da3d-c462-4156-86a4-9082477e2e5b") failed: Property not found. retry in 621.768461ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_16f8da3d-c462-4156-86a4-9082477e2e5b
12682024-06-22T01:29:58.782ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a94fe07b-8874-4ea2-866d-3a65c738a491") failed: Property not found. retry in 1.390886013s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a94fe07b-8874-4ea2-866d-3a65c738a491
12692024-06-22T01:29:58.843ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4794eccf-57ac-4bf0-8ea5-3b0d68786898") failed: Property not found. retry in 580.589341ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4794eccf-57ac-4bf0-8ea5-3b0d68786898
12702024-06-22T01:29:59.000ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_a2874889-f5ed-46ab-b850-c6b4c440c268") failed: Property not found. retry in 1.281576945s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_a2874889-f5ed-46ab-b850-c6b4c440c268
12712024-06-22T01:29:59.053ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_97317836-790a-40be-b49a-5480f32bf256") failed: Property not found. retry in 823.175886ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_97317836-790a-40be-b49a-5480f32bf256
12722024-06-22T01:29:59.232ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_015b8ef4-20d3-41b1-aaea-f47794f2a754") failed: Property not found. retry in 510.034128ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_015b8ef4-20d3-41b1-aaea-f47794f2a754
12732024-06-22T01:29:59.241ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f4504525-7ee6-43d5-88ab-572513db1611") failed: Property not found. retry in 1.248078735s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f4504525-7ee6-43d5-88ab-572513db1611
12742024-06-22T01:29:59.306ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_76fb283e-fbaf-44ec-b242-dd9825b0141c") failed: Property not found. retry in 567.89601ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_76fb283e-fbaf-44ec-b242-dd9825b0141c
12752024-06-22T01:29:59.317ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3afa8c8-7f69-4d05-a0a3-37edc5fd4251") failed: Property not found. retry in 585.015541ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e3afa8c8-7f69-4d05-a0a3-37edc5fd4251
12762024-06-22T01:29:59.341ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e0579974-e546-4f30-b7be-c7fca51ee278") failed: Property not found. retry in 1.463670243s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e0579974-e546-4f30-b7be-c7fca51ee278
12772024-06-22T01:29:59.359ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f6647bd4-cd9a-4181-afc6-adef66316263") failed: Property not found. retry in 1.38747052s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f6647bd4-cd9a-4181-afc6-adef66316263
12782024-06-22T01:29:59.385ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_16f8da3d-c462-4156-86a4-9082477e2e5b") failed: Property not found. retry in 923.793947ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_16f8da3d-c462-4156-86a4-9082477e2e5b
12792024-06-22T01:29:59.393ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_70b0163c-8d01-4c9f-a8c2-c24eae8b3ff8") failed: Property not found. retry in 950.986777ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_70b0163c-8d01-4c9f-a8c2-c24eae8b3ff8
12802024-06-22T01:29:59.432ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4794eccf-57ac-4bf0-8ea5-3b0d68786898") failed: Property not found. retry in 1.092561981s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4794eccf-57ac-4bf0-8ea5-3b0d68786898
12812024-06-22T01:29:59.563ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_10154e8d-8a44-4f4f-b3c2-df4ab2aa02b1") failed: Property not found. retry in 763.119034ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_10154e8d-8a44-4f4f-b3c2-df4ab2aa02b1
12822024-06-22T01:29:59.593ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ca38649f-9346-4829-ae87-5fc70fd55af4") failed: Property not found. retry in 634.791001ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ca38649f-9346-4829-ae87-5fc70fd55af4
12832024-06-22T01:29:59.632ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_515131a9-573e-47f6-bfa4-fac433bd59f0") failed: Property not found. retry in 1.111409428s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_515131a9-573e-47f6-bfa4-fac433bd59f0
12842024-06-22T01:29:59.708ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9ad34640-3c63-473b-a9af-7eb2f4f8da74") failed: Property not found. retry in 1.207458829s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9ad34640-3c63-473b-a9af-7eb2f4f8da74
12852024-06-22T01:29:59.759ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_015b8ef4-20d3-41b1-aaea-f47794f2a754") failed: Property not found. retry in 877.711564ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_015b8ef4-20d3-41b1-aaea-f47794f2a754
12862024-06-22T01:29:59.882ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7e1b8a82-ac86-47b9-a8c8-b6fbe7e7c289") failed: Property not found. retry in 1.392942306s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7e1b8a82-ac86-47b9-a8c8-b6fbe7e7c289
12872024-06-22T01:29:59.891ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_97317836-790a-40be-b49a-5480f32bf256") failed: Property not found. retry in 966.69868ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_97317836-790a-40be-b49a-5480f32bf256
12882024-06-22T01:29:59.900ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a12b3721-98a8-4a75-8617-7177f9f59396") failed: Property not found. retry in 1.230345623s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a12b3721-98a8-4a75-8617-7177f9f59396
12892024-06-22T01:29:59.909ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_76fb283e-fbaf-44ec-b242-dd9825b0141c") failed: Property not found. retry in 946.771392ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_76fb283e-fbaf-44ec-b242-dd9825b0141c
12902024-06-22T01:29:59.921ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3afa8c8-7f69-4d05-a0a3-37edc5fd4251") failed: Property not found. retry in 1.098473702s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e3afa8c8-7f69-4d05-a0a3-37edc5fd4251
12912024-06-22T01:30:00.116ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_701fc4cb-14ab-4427-a48d-e3099ad7363a") failed: Property not found. retry in 950.694655ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_701fc4cb-14ab-4427-a48d-e3099ad7363a
12922024-06-22T01:30:00.187ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a94fe07b-8874-4ea2-866d-3a65c738a491") failed: Property not found. retry in 596.566318ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a94fe07b-8874-4ea2-866d-3a65c738a491
12932024-06-22T01:30:00.240ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ca38649f-9346-4829-ae87-5fc70fd55af4") failed: Property not found. retry in 904.024814ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ca38649f-9346-4829-ae87-5fc70fd55af4
12942024-06-22T01:30:00.294ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_a2874889-f5ed-46ab-b850-c6b4c440c268") failed: Property not found. retry in 866.41969ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_a2874889-f5ed-46ab-b850-c6b4c440c268
12952024-06-22T01:30:00.322ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_16f8da3d-c462-4156-86a4-9082477e2e5b") failed: Property not found. retry in 1.372413109s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_16f8da3d-c462-4156-86a4-9082477e2e5b
12962024-06-22T01:30:00.339ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_10154e8d-8a44-4f4f-b3c2-df4ab2aa02b1") failed: Property not found. retry in 955.18969ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_10154e8d-8a44-4f4f-b3c2-df4ab2aa02b1
12972024-06-22T01:30:00.357ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_70b0163c-8d01-4c9f-a8c2-c24eae8b3ff8") failed: Property not found. retry in 875.664532ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_70b0163c-8d01-4c9f-a8c2-c24eae8b3ff8
12982024-06-22T01:30:00.509ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f4504525-7ee6-43d5-88ab-572513db1611") failed: Property not found. retry in 698.029988ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f4504525-7ee6-43d5-88ab-572513db1611
12992024-06-22T01:30:00.557ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4794eccf-57ac-4bf0-8ea5-3b0d68786898") failed: Property not found. retry in 778.455343ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4794eccf-57ac-4bf0-8ea5-3b0d68786898
13002024-06-22T01:30:00.659ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_015b8ef4-20d3-41b1-aaea-f47794f2a754") failed: Property not found. retry in 1.299805846s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_015b8ef4-20d3-41b1-aaea-f47794f2a754
13012024-06-22T01:30:00.767ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_515131a9-573e-47f6-bfa4-fac433bd59f0") failed: Property not found. retry in 777.104597ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_515131a9-573e-47f6-bfa4-fac433bd59f0
13022024-06-22T01:30:00.784ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f6647bd4-cd9a-4181-afc6-adef66316263") failed: Property not found. retry in 973.974418ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f6647bd4-cd9a-4181-afc6-adef66316263
13032024-06-22T01:30:00.804ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a94fe07b-8874-4ea2-866d-3a65c738a491") failed: Property not found. retry in 806.414992ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a94fe07b-8874-4ea2-866d-3a65c738a491
13042024-06-22T01:30:00.822ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e0579974-e546-4f30-b7be-c7fca51ee278") failed: Property not found. retry in 872.05134ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e0579974-e546-4f30-b7be-c7fca51ee278
13052024-06-22T01:30:00.886ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_76fb283e-fbaf-44ec-b242-dd9825b0141c") failed: Property not found. retry in 933.466234ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_76fb283e-fbaf-44ec-b242-dd9825b0141c
13062024-06-22T01:30:00.914ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_97317836-790a-40be-b49a-5480f32bf256") failed: Property not found. retry in 1.343518728s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_97317836-790a-40be-b49a-5480f32bf256
13072024-06-22T01:30:00.945ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9ad34640-3c63-473b-a9af-7eb2f4f8da74") failed: Property not found. retry in 1.179857158s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9ad34640-3c63-473b-a9af-7eb2f4f8da74
13082024-06-22T01:30:01.055ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3afa8c8-7f69-4d05-a0a3-37edc5fd4251") failed: Property not found. retry in 635.64522ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e3afa8c8-7f69-4d05-a0a3-37edc5fd4251
13092024-06-22T01:30:01.092ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_701fc4cb-14ab-4427-a48d-e3099ad7363a") failed: Property not found. retry in 1.104069774s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_701fc4cb-14ab-4427-a48d-e3099ad7363a
13102024-06-22T01:30:01.148ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a12b3721-98a8-4a75-8617-7177f9f59396") failed: Property not found. retry in 738.825154ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a12b3721-98a8-4a75-8617-7177f9f59396
13112024-06-22T01:30:01.164ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ca38649f-9346-4829-ae87-5fc70fd55af4") failed: Property not found. retry in 1.490214828s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ca38649f-9346-4829-ae87-5fc70fd55af4
13122024-06-22T01:30:01.184ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_a2874889-f5ed-46ab-b850-c6b4c440c268") failed: Property not found. retry in 982.795557ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_a2874889-f5ed-46ab-b850-c6b4c440c268
13132024-06-22T01:30:01.225ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f4504525-7ee6-43d5-88ab-572513db1611") failed: Property not found. retry in 776.625708ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f4504525-7ee6-43d5-88ab-572513db1611
13142024-06-22T01:30:01.260ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_70b0163c-8d01-4c9f-a8c2-c24eae8b3ff8") failed: Property not found. retry in 738.221133ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_70b0163c-8d01-4c9f-a8c2-c24eae8b3ff8
13152024-06-22T01:30:01.299ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7e1b8a82-ac86-47b9-a8c8-b6fbe7e7c289") failed: Property not found. retry in 743.398562ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7e1b8a82-ac86-47b9-a8c8-b6fbe7e7c289
13162024-06-22T01:30:01.331ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_10154e8d-8a44-4f4f-b3c2-df4ab2aa02b1") failed: Property not found. retry in 1.278700647s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_10154e8d-8a44-4f4f-b3c2-df4ab2aa02b1
13172024-06-22T01:30:01.360ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4794eccf-57ac-4bf0-8ea5-3b0d68786898") failed: Property not found. retry in 587.83983ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4794eccf-57ac-4bf0-8ea5-3b0d68786898
13182024-06-22T01:30:01.581ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_515131a9-573e-47f6-bfa4-fac433bd59f0") failed: Property not found. retry in 1.270271431s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_515131a9-573e-47f6-bfa4-fac433bd59f0
13192024-06-22T01:30:01.630ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a94fe07b-8874-4ea2-866d-3a65c738a491") failed: Property not found. retry in 870.407361ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a94fe07b-8874-4ea2-866d-3a65c738a491
13202024-06-22T01:30:01.746ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3afa8c8-7f69-4d05-a0a3-37edc5fd4251") failed: Property not found. retry in 688.523473ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e3afa8c8-7f69-4d05-a0a3-37edc5fd4251
13212024-06-22T01:30:01.769ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e0579974-e546-4f30-b7be-c7fca51ee278") failed: Property not found. retry in 588.899604ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e0579974-e546-4f30-b7be-c7fca51ee278
13222024-06-22T01:30:01.790ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_16f8da3d-c462-4156-86a4-9082477e2e5b") failed: Property not found. retry in 1.243395405s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_16f8da3d-c462-4156-86a4-9082477e2e5b
13232024-06-22T01:30:01.815ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f6647bd4-cd9a-4181-afc6-adef66316263") failed: Property not found. retry in 888.99986ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f6647bd4-cd9a-4181-afc6-adef66316263
13242024-06-22T01:30:01.842ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_76fb283e-fbaf-44ec-b242-dd9825b0141c") failed: Property not found. retry in 1.269054762s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_76fb283e-fbaf-44ec-b242-dd9825b0141c
13252024-06-22T01:30:01.907ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a12b3721-98a8-4a75-8617-7177f9f59396") failed: Property not found. retry in 767.169097ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a12b3721-98a8-4a75-8617-7177f9f59396
13262024-06-22T01:30:01.963ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4794eccf-57ac-4bf0-8ea5-3b0d68786898") failed: Property not found. retry in 821.382277ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4794eccf-57ac-4bf0-8ea5-3b0d68786898
13272024-06-22T01:30:01.977ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_015b8ef4-20d3-41b1-aaea-f47794f2a754") failed: Property not found. retry in 544.194351ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_015b8ef4-20d3-41b1-aaea-f47794f2a754
13282024-06-22T01:30:02.013ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_70b0163c-8d01-4c9f-a8c2-c24eae8b3ff8") failed: Property not found. retry in 704.45817ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_70b0163c-8d01-4c9f-a8c2-c24eae8b3ff8
13292024-06-22T01:30:02.025ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f4504525-7ee6-43d5-88ab-572513db1611") failed: Property not found. retry in 1.045181366s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f4504525-7ee6-43d5-88ab-572513db1611
13302024-06-22T01:30:02.061ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7e1b8a82-ac86-47b9-a8c8-b6fbe7e7c289") failed: Property not found. retry in 699.003551ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7e1b8a82-ac86-47b9-a8c8-b6fbe7e7c289
13312024-06-22T01:30:02.141ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9ad34640-3c63-473b-a9af-7eb2f4f8da74") failed: Property not found. retry in 642.402856ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9ad34640-3c63-473b-a9af-7eb2f4f8da74
13322024-06-22T01:30:02.189ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_a2874889-f5ed-46ab-b850-c6b4c440c268") failed: Property not found. retry in 740.463975ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_a2874889-f5ed-46ab-b850-c6b4c440c268
13332024-06-22T01:30:02.215ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_701fc4cb-14ab-4427-a48d-e3099ad7363a") failed: Property not found. retry in 819.901996ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_701fc4cb-14ab-4427-a48d-e3099ad7363a
13342024-06-22T01:30:02.278ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_97317836-790a-40be-b49a-5480f32bf256") failed: Property not found. retry in 668.968825ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_97317836-790a-40be-b49a-5480f32bf256
13352024-06-22T01:30:02.383ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e0579974-e546-4f30-b7be-c7fca51ee278") failed: Property not found. retry in 797.629645ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e0579974-e546-4f30-b7be-c7fca51ee278
13362024-06-22T01:30:02.449ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3afa8c8-7f69-4d05-a0a3-37edc5fd4251") failed: Property not found. retry in 796.77364ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e3afa8c8-7f69-4d05-a0a3-37edc5fd4251
13372024-06-22T01:30:02.515ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a94fe07b-8874-4ea2-866d-3a65c738a491") failed: Property not found. retry in 1.227272519s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a94fe07b-8874-4ea2-866d-3a65c738a491
13382024-06-22T01:30:02.535ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_015b8ef4-20d3-41b1-aaea-f47794f2a754") failed: Property not found. retry in 668.07692ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_015b8ef4-20d3-41b1-aaea-f47794f2a754
13392024-06-22T01:30:02.622ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_10154e8d-8a44-4f4f-b3c2-df4ab2aa02b1") failed: Property not found. retry in 594.055269ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_10154e8d-8a44-4f4f-b3c2-df4ab2aa02b1
13402024-06-22T01:30:02.667ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ca38649f-9346-4829-ae87-5fc70fd55af4") failed: Property not found. retry in 676.227277ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ca38649f-9346-4829-ae87-5fc70fd55af4
13412024-06-22T01:30:02.685ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a12b3721-98a8-4a75-8617-7177f9f59396") failed: Property not found. retry in 1.199220483s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a12b3721-98a8-4a75-8617-7177f9f59396
13422024-06-22T01:30:02.716ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f6647bd4-cd9a-4181-afc6-adef66316263") failed: Property not found. retry in 972.60238ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f6647bd4-cd9a-4181-afc6-adef66316263
13432024-06-22T01:30:02.729ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_70b0163c-8d01-4c9f-a8c2-c24eae8b3ff8") failed: Property not found. retry in 723.293835ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_70b0163c-8d01-4c9f-a8c2-c24eae8b3ff8
13442024-06-22T01:30:02.769ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7e1b8a82-ac86-47b9-a8c8-b6fbe7e7c289") failed: Property not found. retry in 1.215042251s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7e1b8a82-ac86-47b9-a8c8-b6fbe7e7c289
13452024-06-22T01:30:02.795ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9ad34640-3c63-473b-a9af-7eb2f4f8da74") failed: Property not found. retry in 640.876552ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9ad34640-3c63-473b-a9af-7eb2f4f8da74
13462024-06-22T01:30:02.803ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4794eccf-57ac-4bf0-8ea5-3b0d68786898") failed: Property not found. retry in 1.423035301s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4794eccf-57ac-4bf0-8ea5-3b0d68786898
13472024-06-22T01:30:02.862ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_515131a9-573e-47f6-bfa4-fac433bd59f0") failed: Property not found. retry in 887.755814ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_515131a9-573e-47f6-bfa4-fac433bd59f0
13482024-06-22T01:30:02.944ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_a2874889-f5ed-46ab-b850-c6b4c440c268") failed: Property not found. retry in 916.858725ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_a2874889-f5ed-46ab-b850-c6b4c440c268
13492024-06-22T01:30:02.958ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_97317836-790a-40be-b49a-5480f32bf256") failed: Property not found. retry in 1.46161626s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_97317836-790a-40be-b49a-5480f32bf256
13502024-06-22T01:30:03.046ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_16f8da3d-c462-4156-86a4-9082477e2e5b") failed: Property not found. retry in 1.334597683s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_16f8da3d-c462-4156-86a4-9082477e2e5b
13512024-06-22T01:30:03.055ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_701fc4cb-14ab-4427-a48d-e3099ad7363a") failed: Property not found. retry in 822.646642ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_701fc4cb-14ab-4427-a48d-e3099ad7363a
13522024-06-22T01:30:03.080ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f4504525-7ee6-43d5-88ab-572513db1611") failed: Property not found. retry in 1.276339076s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f4504525-7ee6-43d5-88ab-572513db1611
13532024-06-22T01:30:03.121ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_76fb283e-fbaf-44ec-b242-dd9825b0141c") failed: Property not found. retry in 1.256462375s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_76fb283e-fbaf-44ec-b242-dd9825b0141c
13542024-06-22T01:30:03.190ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e0579974-e546-4f30-b7be-c7fca51ee278") failed: Property not found. retry in 1.163527483s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e0579974-e546-4f30-b7be-c7fca51ee278
13552024-06-22T01:30:03.214ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_015b8ef4-20d3-41b1-aaea-f47794f2a754") failed: Property not found. retry in 1.227664616s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_015b8ef4-20d3-41b1-aaea-f47794f2a754
13562024-06-22T01:30:03.227ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_10154e8d-8a44-4f4f-b3c2-df4ab2aa02b1") failed: Property not found. retry in 753.351148ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_10154e8d-8a44-4f4f-b3c2-df4ab2aa02b1
13572024-06-22T01:30:03.269ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3afa8c8-7f69-4d05-a0a3-37edc5fd4251") failed: Property not found. retry in 1.000882809s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e3afa8c8-7f69-4d05-a0a3-37edc5fd4251
13582024-06-22T01:30:03.356ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ca38649f-9346-4829-ae87-5fc70fd55af4") failed: Property not found. retry in 876.823695ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ca38649f-9346-4829-ae87-5fc70fd55af4
13592024-06-22T01:30:03.447ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9ad34640-3c63-473b-a9af-7eb2f4f8da74") failed: Property not found. retry in 1.071755908s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9ad34640-3c63-473b-a9af-7eb2f4f8da74
13602024-06-22T01:30:03.462ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_70b0163c-8d01-4c9f-a8c2-c24eae8b3ff8") failed: Property not found. retry in 798.019618ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_70b0163c-8d01-4c9f-a8c2-c24eae8b3ff8
13612024-06-22T01:30:03.702ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f6647bd4-cd9a-4181-afc6-adef66316263") failed: Property not found. retry in 1.169726182s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f6647bd4-cd9a-4181-afc6-adef66316263
13622024-06-22T01:30:03.757ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a94fe07b-8874-4ea2-866d-3a65c738a491") failed: Property not found. retry in 1.175303175s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a94fe07b-8874-4ea2-866d-3a65c738a491
13632024-06-22T01:30:03.767ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_515131a9-573e-47f6-bfa4-fac433bd59f0") failed: Property not found. retry in 989.993415ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_515131a9-573e-47f6-bfa4-fac433bd59f0
13642024-06-22T01:30:03.873ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_a2874889-f5ed-46ab-b850-c6b4c440c268") failed: Property not found. retry in 1.071795623s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_a2874889-f5ed-46ab-b850-c6b4c440c268
13652024-06-22T01:30:03.890ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_701fc4cb-14ab-4427-a48d-e3099ad7363a") failed: Property not found. retry in 1.399081247s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_701fc4cb-14ab-4427-a48d-e3099ad7363a
13662024-06-22T01:30:03.903ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a12b3721-98a8-4a75-8617-7177f9f59396") failed: Property not found. retry in 1.147853138s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a12b3721-98a8-4a75-8617-7177f9f59396
13672024-06-22T01:30:03.995ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_10154e8d-8a44-4f4f-b3c2-df4ab2aa02b1") failed: Property not found. retry in 749.314165ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_10154e8d-8a44-4f4f-b3c2-df4ab2aa02b1
13682024-06-22T01:30:04.008ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7e1b8a82-ac86-47b9-a8c8-b6fbe7e7c289") failed: Property not found. retry in 1.108969208s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7e1b8a82-ac86-47b9-a8c8-b6fbe7e7c289
13692024-06-22T01:30:04.240ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4794eccf-57ac-4bf0-8ea5-3b0d68786898") failed: Property not found. retry in 836.131909ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4794eccf-57ac-4bf0-8ea5-3b0d68786898
13702024-06-22T01:30:04.255ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ca38649f-9346-4829-ae87-5fc70fd55af4") failed: Property not found. retry in 506.868264ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ca38649f-9346-4829-ae87-5fc70fd55af4
13712024-06-22T01:30:04.271ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_70b0163c-8d01-4c9f-a8c2-c24eae8b3ff8") failed: Property not found. retry in 1.147936824s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_70b0163c-8d01-4c9f-a8c2-c24eae8b3ff8
13722024-06-22T01:30:04.284ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3afa8c8-7f69-4d05-a0a3-37edc5fd4251") failed: Property not found. retry in 1.355312546s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e3afa8c8-7f69-4d05-a0a3-37edc5fd4251
13732024-06-22T01:30:04.370ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e0579974-e546-4f30-b7be-c7fca51ee278") failed: Property not found. retry in 725.066027ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e0579974-e546-4f30-b7be-c7fca51ee278
13742024-06-22T01:30:04.382ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f4504525-7ee6-43d5-88ab-572513db1611") failed: Property not found. retry in 1.239002459s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f4504525-7ee6-43d5-88ab-572513db1611
13752024-06-22T01:30:04.394ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_16f8da3d-c462-4156-86a4-9082477e2e5b") failed: Property not found. retry in 878.715397ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_16f8da3d-c462-4156-86a4-9082477e2e5b
13762024-06-22T01:30:04.408ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_76fb283e-fbaf-44ec-b242-dd9825b0141c") failed: Property not found. retry in 770.70654ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_76fb283e-fbaf-44ec-b242-dd9825b0141c
13772024-06-22T01:30:04.433ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_97317836-790a-40be-b49a-5480f32bf256") failed: Property not found. retry in 529.152461ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_97317836-790a-40be-b49a-5480f32bf256
13782024-06-22T01:30:04.456ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_015b8ef4-20d3-41b1-aaea-f47794f2a754") failed: Property not found. retry in 1.242908286s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_015b8ef4-20d3-41b1-aaea-f47794f2a754
13792024-06-22T01:30:04.532ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9ad34640-3c63-473b-a9af-7eb2f4f8da74") failed: Property not found. retry in 706.217276ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9ad34640-3c63-473b-a9af-7eb2f4f8da74
13802024-06-22T01:30:04.757ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_10154e8d-8a44-4f4f-b3c2-df4ab2aa02b1") failed: Property not found. retry in 1.304472415s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_10154e8d-8a44-4f4f-b3c2-df4ab2aa02b1
13812024-06-22T01:30:04.768ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_515131a9-573e-47f6-bfa4-fac433bd59f0") failed: Property not found. retry in 651.051779ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_515131a9-573e-47f6-bfa4-fac433bd59f0
13822024-06-22T01:30:04.778ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ca38649f-9346-4829-ae87-5fc70fd55af4") failed: Property not found. retry in 1.066446408s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ca38649f-9346-4829-ae87-5fc70fd55af4
13832024-06-22T01:30:04.886ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f6647bd4-cd9a-4181-afc6-adef66316263") failed: Property not found. retry in 1.039185221s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f6647bd4-cd9a-4181-afc6-adef66316263
13842024-06-22T01:30:04.949ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a94fe07b-8874-4ea2-866d-3a65c738a491") failed: Property not found. retry in 576.702425ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a94fe07b-8874-4ea2-866d-3a65c738a491
13852024-06-22T01:30:04.960ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_a2874889-f5ed-46ab-b850-c6b4c440c268") failed: Property not found. retry in 1.332351766s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_a2874889-f5ed-46ab-b850-c6b4c440c268
13862024-06-22T01:30:04.974ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_97317836-790a-40be-b49a-5480f32bf256") failed: Property not found. retry in 1.040279509s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_97317836-790a-40be-b49a-5480f32bf256
13872024-06-22T01:30:05.064ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a12b3721-98a8-4a75-8617-7177f9f59396") failed: Property not found. retry in 1.441546658s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a12b3721-98a8-4a75-8617-7177f9f59396
13882024-06-22T01:30:05.086ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4794eccf-57ac-4bf0-8ea5-3b0d68786898") failed: Property not found. retry in 660.688115ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4794eccf-57ac-4bf0-8ea5-3b0d68786898
13892024-06-22T01:30:05.104ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e0579974-e546-4f30-b7be-c7fca51ee278") failed: Property not found. retry in 1.376837523s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e0579974-e546-4f30-b7be-c7fca51ee278
13902024-06-22T01:30:05.133ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7e1b8a82-ac86-47b9-a8c8-b6fbe7e7c289") failed: Property not found. retry in 1.274661687s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7e1b8a82-ac86-47b9-a8c8-b6fbe7e7c289
13912024-06-22T01:30:05.191ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_76fb283e-fbaf-44ec-b242-dd9825b0141c") failed: Property not found. retry in 1.058746421s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_76fb283e-fbaf-44ec-b242-dd9825b0141c
13922024-06-22T01:30:05.251ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9ad34640-3c63-473b-a9af-7eb2f4f8da74") failed: Property not found. retry in 1.368702353s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9ad34640-3c63-473b-a9af-7eb2f4f8da74
13932024-06-22T01:30:05.287ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_16f8da3d-c462-4156-86a4-9082477e2e5b") failed: Property not found. retry in 862.410449ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_16f8da3d-c462-4156-86a4-9082477e2e5b
13942024-06-22T01:30:05.304ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_701fc4cb-14ab-4427-a48d-e3099ad7363a") failed: Property not found. retry in 663.654183ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_701fc4cb-14ab-4427-a48d-e3099ad7363a
13952024-06-22T01:30:05.433ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_70b0163c-8d01-4c9f-a8c2-c24eae8b3ff8") failed: Property not found. retry in 603.581338ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_70b0163c-8d01-4c9f-a8c2-c24eae8b3ff8
13962024-06-22T01:30:05.446ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_515131a9-573e-47f6-bfa4-fac433bd59f0") failed: Property not found. retry in 914.11881ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_515131a9-573e-47f6-bfa4-fac433bd59f0
13972024-06-22T01:30:05.541ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a94fe07b-8874-4ea2-866d-3a65c738a491") failed: Property not found. retry in 798.127264ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a94fe07b-8874-4ea2-866d-3a65c738a491
13982024-06-22T01:30:05.636ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f4504525-7ee6-43d5-88ab-572513db1611") failed: Property not found. retry in 1.490340732s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f4504525-7ee6-43d5-88ab-572513db1611
13992024-06-22T01:30:05.655ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3afa8c8-7f69-4d05-a0a3-37edc5fd4251") failed: Property not found. retry in 1.168442382s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e3afa8c8-7f69-4d05-a0a3-37edc5fd4251
14002024-06-22T01:30:05.712ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_015b8ef4-20d3-41b1-aaea-f47794f2a754") failed: Property not found. retry in 1.321926845s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_015b8ef4-20d3-41b1-aaea-f47794f2a754
14012024-06-22T01:30:05.761ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4794eccf-57ac-4bf0-8ea5-3b0d68786898") failed: Property not found. retry in 1.217527746s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4794eccf-57ac-4bf0-8ea5-3b0d68786898
14022024-06-22T01:30:05.857ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ca38649f-9346-4829-ae87-5fc70fd55af4") failed: Property not found. retry in 524.670978ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ca38649f-9346-4829-ae87-5fc70fd55af4
14032024-06-22T01:30:05.937ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f6647bd4-cd9a-4181-afc6-adef66316263") failed: Property not found. retry in 631.663069ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f6647bd4-cd9a-4181-afc6-adef66316263
14042024-06-22T01:30:05.978ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_701fc4cb-14ab-4427-a48d-e3099ad7363a") failed: Property not found. retry in 768.591658ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_701fc4cb-14ab-4427-a48d-e3099ad7363a
14052024-06-22T01:30:06.026ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_97317836-790a-40be-b49a-5480f32bf256") failed: Property not found. retry in 1.207318208s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_97317836-790a-40be-b49a-5480f32bf256
14062024-06-22T01:30:06.047ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_70b0163c-8d01-4c9f-a8c2-c24eae8b3ff8") failed: Property not found. retry in 561.40665ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_70b0163c-8d01-4c9f-a8c2-c24eae8b3ff8
14072024-06-22T01:30:06.225ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_16f8da3d-c462-4156-86a4-9082477e2e5b") failed: Property not found. retry in 582.701836ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_16f8da3d-c462-4156-86a4-9082477e2e5b
14082024-06-22T01:30:06.260ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_76fb283e-fbaf-44ec-b242-dd9825b0141c") failed: Property not found. retry in 1.052045008s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_76fb283e-fbaf-44ec-b242-dd9825b0141c
14092024-06-22T01:30:06.304ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_a2874889-f5ed-46ab-b850-c6b4c440c268") failed: Property not found. retry in 1.03360536s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_a2874889-f5ed-46ab-b850-c6b4c440c268
14102024-06-22T01:30:06.350ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a94fe07b-8874-4ea2-866d-3a65c738a491") failed: Property not found. retry in 1.309950574s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a94fe07b-8874-4ea2-866d-3a65c738a491
14112024-06-22T01:30:06.370ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_515131a9-573e-47f6-bfa4-fac433bd59f0") failed: Property not found. retry in 1.224122323s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_515131a9-573e-47f6-bfa4-fac433bd59f0
14122024-06-22T01:30:06.391ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ca38649f-9346-4829-ae87-5fc70fd55af4") failed: Property not found. retry in 1.207773335s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ca38649f-9346-4829-ae87-5fc70fd55af4
14132024-06-22T01:30:06.417ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7e1b8a82-ac86-47b9-a8c8-b6fbe7e7c289") failed: Property not found. retry in 1.19287233s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7e1b8a82-ac86-47b9-a8c8-b6fbe7e7c289
14142024-06-22T01:30:06.490ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e0579974-e546-4f30-b7be-c7fca51ee278") failed: Property not found. retry in 831.990528ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e0579974-e546-4f30-b7be-c7fca51ee278
14152024-06-22T01:30:06.515ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a12b3721-98a8-4a75-8617-7177f9f59396") failed: Property not found. retry in 1.266588737s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a12b3721-98a8-4a75-8617-7177f9f59396
14162024-06-22T01:30:06.578ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f6647bd4-cd9a-4181-afc6-adef66316263") failed: Property not found. retry in 681.233774ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f6647bd4-cd9a-4181-afc6-adef66316263
14172024-06-22T01:30:06.618ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_70b0163c-8d01-4c9f-a8c2-c24eae8b3ff8") failed: Property not found. retry in 1.480674414s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_70b0163c-8d01-4c9f-a8c2-c24eae8b3ff8
14182024-06-22T01:30:06.629ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9ad34640-3c63-473b-a9af-7eb2f4f8da74") failed: Property not found. retry in 770.66608ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9ad34640-3c63-473b-a9af-7eb2f4f8da74
14192024-06-22T01:30:06.757ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_701fc4cb-14ab-4427-a48d-e3099ad7363a") failed: Property not found. retry in 825.606549ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_701fc4cb-14ab-4427-a48d-e3099ad7363a
14202024-06-22T01:30:06.818ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_16f8da3d-c462-4156-86a4-9082477e2e5b") failed: Property not found. retry in 1.158595888s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_16f8da3d-c462-4156-86a4-9082477e2e5b
14212024-06-22T01:30:06.833ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3afa8c8-7f69-4d05-a0a3-37edc5fd4251") failed: Property not found. retry in 1.227458894s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e3afa8c8-7f69-4d05-a0a3-37edc5fd4251
14222024-06-22T01:30:06.990ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4794eccf-57ac-4bf0-8ea5-3b0d68786898") failed: Property not found. retry in 1.06678269s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4794eccf-57ac-4bf0-8ea5-3b0d68786898
14232024-06-22T01:30:07.045ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_015b8ef4-20d3-41b1-aaea-f47794f2a754") failed: Property not found. retry in 683.611504ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_015b8ef4-20d3-41b1-aaea-f47794f2a754
14242024-06-22T01:30:07.138ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f4504525-7ee6-43d5-88ab-572513db1611") failed: Property not found. retry in 1.20743738s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f4504525-7ee6-43d5-88ab-572513db1611
14252024-06-22T01:30:07.228ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 5.599787864s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:417 sled_id = 9f7cbf52-de0d-48c8-9e7d-2958552743a4
14262024-06-22T01:30:07.246ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_97317836-790a-40be-b49a-5480f32bf256") failed: Property not found. retry in 635.968639ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_97317836-790a-40be-b49a-5480f32bf256
14272024-06-22T01:30:07.270ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f6647bd4-cd9a-4181-afc6-adef66316263") failed: Property not found. retry in 1.187593325s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f6647bd4-cd9a-4181-afc6-adef66316263
14282024-06-22T01:30:07.322ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_76fb283e-fbaf-44ec-b242-dd9825b0141c") failed: Property not found. retry in 1.161269544s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_76fb283e-fbaf-44ec-b242-dd9825b0141c
14292024-06-22T01:30:07.331ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e0579974-e546-4f30-b7be-c7fca51ee278") failed: Property not found. retry in 729.2135ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e0579974-e546-4f30-b7be-c7fca51ee278
14302024-06-22T01:30:07.352ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_a2874889-f5ed-46ab-b850-c6b4c440c268") failed: Property not found. retry in 615.44729ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_a2874889-f5ed-46ab-b850-c6b4c440c268
14312024-06-22T01:30:07.410ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9ad34640-3c63-473b-a9af-7eb2f4f8da74") failed: Property not found. retry in 709.055798ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9ad34640-3c63-473b-a9af-7eb2f4f8da74
14322024-06-22T01:30:07.592ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_701fc4cb-14ab-4427-a48d-e3099ad7363a") failed: Property not found. retry in 1.472809897s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_701fc4cb-14ab-4427-a48d-e3099ad7363a
14332024-06-22T01:30:07.602ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_515131a9-573e-47f6-bfa4-fac433bd59f0") failed: Property not found. retry in 517.182621ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_515131a9-573e-47f6-bfa4-fac433bd59f0
14342024-06-22T01:30:07.610ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ca38649f-9346-4829-ae87-5fc70fd55af4") failed: Property not found. retry in 1.161917087s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ca38649f-9346-4829-ae87-5fc70fd55af4
14352024-06-22T01:30:07.620ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7e1b8a82-ac86-47b9-a8c8-b6fbe7e7c289") failed: Property not found. retry in 1.000919446s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7e1b8a82-ac86-47b9-a8c8-b6fbe7e7c289
14362024-06-22T01:30:07.669ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a94fe07b-8874-4ea2-866d-3a65c738a491") failed: Property not found. retry in 1.067185532s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a94fe07b-8874-4ea2-866d-3a65c738a491
14372024-06-22T01:30:07.738ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_015b8ef4-20d3-41b1-aaea-f47794f2a754") failed: Property not found. retry in 695.284893ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_015b8ef4-20d3-41b1-aaea-f47794f2a754
14382024-06-22T01:30:07.791ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a12b3721-98a8-4a75-8617-7177f9f59396") failed: Property not found. retry in 524.352363ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a12b3721-98a8-4a75-8617-7177f9f59396
14392024-06-22T01:30:07.892ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_97317836-790a-40be-b49a-5480f32bf256") failed: Property not found. retry in 798.80357ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_97317836-790a-40be-b49a-5480f32bf256
14402024-06-22T01:30:07.977ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_a2874889-f5ed-46ab-b850-c6b4c440c268") failed: Property not found. retry in 1.450711672s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_a2874889-f5ed-46ab-b850-c6b4c440c268
14412024-06-22T01:30:07.986ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_16f8da3d-c462-4156-86a4-9082477e2e5b") failed: Property not found. retry in 1.456705919s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_16f8da3d-c462-4156-86a4-9082477e2e5b
14422024-06-22T01:30:08.066ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4794eccf-57ac-4bf0-8ea5-3b0d68786898") failed: Property not found. retry in 783.156726ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4794eccf-57ac-4bf0-8ea5-3b0d68786898
14432024-06-22T01:30:08.075ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e0579974-e546-4f30-b7be-c7fca51ee278") failed: Property not found. retry in 1.410279923s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e0579974-e546-4f30-b7be-c7fca51ee278
14442024-06-22T01:30:08.083ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3afa8c8-7f69-4d05-a0a3-37edc5fd4251") failed: Property not found. retry in 1.162903533s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e3afa8c8-7f69-4d05-a0a3-37edc5fd4251
14452024-06-22T01:30:08.108ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_70b0163c-8d01-4c9f-a8c2-c24eae8b3ff8") failed: Property not found. retry in 1.122781372s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_70b0163c-8d01-4c9f-a8c2-c24eae8b3ff8
14462024-06-22T01:30:08.129ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_515131a9-573e-47f6-bfa4-fac433bd59f0") failed: Property not found. retry in 1.114202385s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_515131a9-573e-47f6-bfa4-fac433bd59f0
14472024-06-22T01:30:08.137ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9ad34640-3c63-473b-a9af-7eb2f4f8da74") failed: Property not found. retry in 595.032397ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9ad34640-3c63-473b-a9af-7eb2f4f8da74
14482024-06-22T01:30:08.327ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a12b3721-98a8-4a75-8617-7177f9f59396") failed: Property not found. retry in 1.387579873s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a12b3721-98a8-4a75-8617-7177f9f59396
14492024-06-22T01:30:08.356ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f4504525-7ee6-43d5-88ab-572513db1611") failed: Property not found. retry in 1.305616041s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f4504525-7ee6-43d5-88ab-572513db1611
14502024-06-22T01:30:08.443ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_015b8ef4-20d3-41b1-aaea-f47794f2a754") failed: Property not found. retry in 869.631097ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_015b8ef4-20d3-41b1-aaea-f47794f2a754
14512024-06-22T01:30:08.467ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f6647bd4-cd9a-4181-afc6-adef66316263") failed: Property not found. retry in 1.136465216s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f6647bd4-cd9a-4181-afc6-adef66316263
14522024-06-22T01:30:08.493ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_76fb283e-fbaf-44ec-b242-dd9825b0141c") failed: Property not found. retry in 1.471552887s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_76fb283e-fbaf-44ec-b242-dd9825b0141c
14532024-06-22T01:30:08.631ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7e1b8a82-ac86-47b9-a8c8-b6fbe7e7c289") failed: Property not found. retry in 571.685803ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7e1b8a82-ac86-47b9-a8c8-b6fbe7e7c289
14542024-06-22T01:30:08.700ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_97317836-790a-40be-b49a-5480f32bf256") failed: Property not found. retry in 1.370961093s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_97317836-790a-40be-b49a-5480f32bf256
14552024-06-22T01:30:08.741ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9ad34640-3c63-473b-a9af-7eb2f4f8da74") failed: Property not found. retry in 1.024981823s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9ad34640-3c63-473b-a9af-7eb2f4f8da74
14562024-06-22T01:30:08.750ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a94fe07b-8874-4ea2-866d-3a65c738a491") failed: Property not found. retry in 566.146337ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a94fe07b-8874-4ea2-866d-3a65c738a491
14572024-06-22T01:30:08.781ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ca38649f-9346-4829-ae87-5fc70fd55af4") failed: Property not found. retry in 952.441944ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ca38649f-9346-4829-ae87-5fc70fd55af4
14582024-06-22T01:30:08.859ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4794eccf-57ac-4bf0-8ea5-3b0d68786898") failed: Property not found. retry in 1.255013674s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4794eccf-57ac-4bf0-8ea5-3b0d68786898
14592024-06-22T01:30:09.213ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7e1b8a82-ac86-47b9-a8c8-b6fbe7e7c289") failed: Property not found. retry in 1.440959415s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7e1b8a82-ac86-47b9-a8c8-b6fbe7e7c289
14602024-06-22T01:30:09.243ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_70b0163c-8d01-4c9f-a8c2-c24eae8b3ff8") failed: Property not found. retry in 985.216194ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_70b0163c-8d01-4c9f-a8c2-c24eae8b3ff8
14612024-06-22T01:30:09.254ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_515131a9-573e-47f6-bfa4-fac433bd59f0") failed: Property not found. retry in 512.311253ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_515131a9-573e-47f6-bfa4-fac433bd59f0
14622024-06-22T01:30:09.262ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3afa8c8-7f69-4d05-a0a3-37edc5fd4251") failed: Property not found. retry in 1.181179929s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e3afa8c8-7f69-4d05-a0a3-37edc5fd4251
14632024-06-22T01:30:09.326ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_015b8ef4-20d3-41b1-aaea-f47794f2a754") failed: Property not found. retry in 712.399311ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_015b8ef4-20d3-41b1-aaea-f47794f2a754
14642024-06-22T01:30:09.334ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a94fe07b-8874-4ea2-866d-3a65c738a491") failed: Property not found. retry in 1.302081497s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a94fe07b-8874-4ea2-866d-3a65c738a491
14652024-06-22T01:30:09.440ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_a2874889-f5ed-46ab-b850-c6b4c440c268") failed: Property not found. retry in 670.352454ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_a2874889-f5ed-46ab-b850-c6b4c440c268
14662024-06-22T01:30:09.454ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_16f8da3d-c462-4156-86a4-9082477e2e5b") failed: Property not found. retry in 1.152384825s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_16f8da3d-c462-4156-86a4-9082477e2e5b
14672024-06-22T01:30:09.498ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e0579974-e546-4f30-b7be-c7fca51ee278") failed: Property not found. retry in 1.2731993s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e0579974-e546-4f30-b7be-c7fca51ee278
14682024-06-22T01:30:09.617ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f6647bd4-cd9a-4181-afc6-adef66316263") failed: Property not found. retry in 559.368708ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f6647bd4-cd9a-4181-afc6-adef66316263
14692024-06-22T01:30:09.674ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f4504525-7ee6-43d5-88ab-572513db1611") failed: Property not found. retry in 1.046161388s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f4504525-7ee6-43d5-88ab-572513db1611
14702024-06-22T01:30:09.727ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a12b3721-98a8-4a75-8617-7177f9f59396") failed: Property not found. retry in 573.494089ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a12b3721-98a8-4a75-8617-7177f9f59396
14712024-06-22T01:30:09.747ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ca38649f-9346-4829-ae87-5fc70fd55af4") failed: Property not found. retry in 900.371452ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ca38649f-9346-4829-ae87-5fc70fd55af4
14722024-06-22T01:30:09.781ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_515131a9-573e-47f6-bfa4-fac433bd59f0") failed: Property not found. retry in 1.197672874s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_515131a9-573e-47f6-bfa4-fac433bd59f0
14732024-06-22T01:30:09.791ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9ad34640-3c63-473b-a9af-7eb2f4f8da74") failed: Property not found. retry in 1.1241993s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9ad34640-3c63-473b-a9af-7eb2f4f8da74
14742024-06-22T01:30:09.982ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_76fb283e-fbaf-44ec-b242-dd9825b0141c") failed: Property not found. retry in 606.145666ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_76fb283e-fbaf-44ec-b242-dd9825b0141c
14752024-06-22T01:30:10.060ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_015b8ef4-20d3-41b1-aaea-f47794f2a754") failed: Property not found. retry in 897.195486ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_015b8ef4-20d3-41b1-aaea-f47794f2a754
14762024-06-22T01:30:10.088ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_97317836-790a-40be-b49a-5480f32bf256") failed: Property not found. retry in 667.049856ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_97317836-790a-40be-b49a-5480f32bf256
14772024-06-22T01:30:10.124ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_a2874889-f5ed-46ab-b850-c6b4c440c268") failed: Property not found. retry in 958.477686ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_a2874889-f5ed-46ab-b850-c6b4c440c268
14782024-06-22T01:30:10.188ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f6647bd4-cd9a-4181-afc6-adef66316263") failed: Property not found. retry in 1.190765654s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f6647bd4-cd9a-4181-afc6-adef66316263
14792024-06-22T01:30:10.465ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3afa8c8-7f69-4d05-a0a3-37edc5fd4251") failed: Property not found. retry in 1.372438438s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e3afa8c8-7f69-4d05-a0a3-37edc5fd4251
14802024-06-22T01:30:11.879ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2956 zone = oxz_external_dns_97317836-790a-40be-b49a-5480f32bf256
14812024-06-22T01:30:11.879ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2956 zone = oxz_nexus_e0579974-e546-4f30-b7be-c7fca51ee278
14822024-06-22T01:30:11.879ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2956 zone = oxz_nexus_515131a9-573e-47f6-bfa4-fac433bd59f0
14832024-06-22T01:30:11.879ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2956 zone = oxz_nexus_16f8da3d-c462-4156-86a4-9082477e2e5b
14842024-06-22T01:30:11.879ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2956 zone = oxz_crucible_pantry_701fc4cb-14ab-4427-a48d-e3099ad7363a
14852024-06-22T01:30:11.879ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2956 zone = oxz_crucible_pantry_f4504525-7ee6-43d5-88ab-572513db1611
14862024-06-22T01:30:11.879ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2956 zone = oxz_oximeter_a12b3721-98a8-4a75-8617-7177f9f59396
14872024-06-22T01:30:11.879ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2956 zone = oxz_clickhouse_a2874889-f5ed-46ab-b850-c6b4c440c268
14882024-06-22T01:30:11.879ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2956 zone = oxz_crucible_f6647bd4-cd9a-4181-afc6-adef66316263
14892024-06-22T01:30:11.879ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2956 zone = oxz_crucible_70b0163c-8d01-4c9f-a8c2-c24eae8b3ff8
14902024-06-22T01:30:11.879ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2956 zone = oxz_crucible_e3afa8c8-7f69-4d05-a0a3-37edc5fd4251
14912024-06-22T01:30:11.879ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2956 zone = oxz_crucible_015b8ef4-20d3-41b1-aaea-f47794f2a754
14922024-06-22T01:30:11.879ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2956 zone = oxz_crucible_ca38649f-9346-4829-ae87-5fc70fd55af4
14932024-06-22T01:30:11.879ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2956 zone = oxz_crucible_7e1b8a82-ac86-47b9-a8c8-b6fbe7e7c289
14942024-06-22T01:30:11.879ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2956 zone = oxz_crucible_pantry_10154e8d-8a44-4f4f-b3c2-df4ab2aa02b1
14952024-06-22T01:30:11.879ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2956 zone = oxz_crucible_9ad34640-3c63-473b-a9af-7eb2f4f8da74
14962024-06-22T01:30:11.879ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2956 zone = oxz_crucible_a94fe07b-8874-4ea2-866d-3a65c738a491
14972024-06-22T01:30:11.879ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2956 zone = oxz_crucible_76fb283e-fbaf-44ec-b242-dd9825b0141c
14982024-06-22T01:30:11.879ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2956 zone = oxz_external_dns_4794eccf-57ac-4bf0-8ea5-3b0d68786898
14992024-06-22T01:30:11.879ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/9b2f2513-2520-480a-aa3a-397437db476d/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
15002024-06-22T01:30:11.893ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/3e31f9bf-741c-4ad6-aa69-e523a333a2d2/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
15012024-06-22T01:30:11.905ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 38286104 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:57333 req_id = 245eec3e-3366-4d4f-9d3f-8a5b535f2f94 response_code = 204 uri = /omicron-zones
15022024-06-22T01:30:11.912ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1244
15032024-06-22T01:30:11.913ZINFOSledAgent (RSS): Writing ledger to /pool/int/9b2f2513-2520-480a-aa3a-397437db476d/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
15042024-06-22T01:30:11.913ZINFOSledAgent (RSS): Writing ledger to /pool/int/3e31f9bf-741c-4ad6-aa69-e523a333a2d2/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
15052024-06-22T01:30:11.916ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:681
15062024-06-22T01:30:11.919ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::a]:12221 file = sled-agent/src/rack_setup/service.rs:694
15072024-06-22T01:30:11.956ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, vlan_id: None, }, ], switch: Switch0, uplink_port_fec: None, uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:825
15082024-06-22T01:30:16.531ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/43e686a5-5e84-4578-a9f9-dc715322753f/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:887
15092024-06-22T01:30:16.533ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 7.704817721s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): error trying to connect: tcp connect error: Connection refused (os error 146)" file = oximeter/producer/src/lib.rs:417 sled_id = 9f7cbf52-de0d-48c8-9e7d-2958552743a4
15102024-06-22T01:30:16.655ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/43e686a5-5e84-4578-a9f9-dc715322753f/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:887
15112024-06-22T01:30:16.803ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/43e686a5-5e84-4578-a9f9-dc715322753f/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:887
15122024-06-22T01:30:16.890ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/43e686a5-5e84-4578-a9f9-dc715322753f/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:887
15132024-06-22T01:30:16.993ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/43e686a5-5e84-4578-a9f9-dc715322753f/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:887
15142024-06-22T01:30:17.171ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:51708
15152024-06-22T01:30:17.172ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 42 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:51708 req_id = 3d5f6870-fe87-4c42-90bd-384ecb3e91e4 response_code = 200 uri = /baseboard
15162024-06-22T01:30:17.278ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/43e686a5-5e84-4578-a9f9-dc715322753f/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:887
15172024-06-22T01:30:17.569ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/43e686a5-5e84-4578-a9f9-dc715322753f/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:887
15182024-06-22T01:30:17.794ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/43e686a5-5e84-4578-a9f9-dc715322753f/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:887
15192024-06-22T01:30:18.001ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/43e686a5-5e84-4578-a9f9-dc715322753f/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:887
15202024-06-22T01:30:18.401ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/43e686a5-5e84-4578-a9f9-dc715322753f/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:887
15212024-06-22T01:30:18.899ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/43e686a5-5e84-4578-a9f9-dc715322753f/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:887
15222024-06-22T01:30:19.392ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/43e686a5-5e84-4578-a9f9-dc715322753f/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:887
15232024-06-22T01:30:20.173ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/43e686a5-5e84-4578-a9f9-dc715322753f/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:887
15242024-06-22T01:30:21.402ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/43e686a5-5e84-4578-a9f9-dc715322753f/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:887
15252024-06-22T01:30:22.660ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/43e686a5-5e84-4578-a9f9-dc715322753f/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:887
15262024-06-22T01:30:24.231ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/43e686a5-5e84-4578-a9f9-dc715322753f/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:887
15272024-06-22T01:30:24.313ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 18.251785316s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): error trying to connect: tcp connect error: Connection refused (os error 146)" file = oximeter/producer/src/lib.rs:417 sled_id = 9f7cbf52-de0d-48c8-9e7d-2958552743a4
15282024-06-22T01:30:25.261ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/43e686a5-5e84-4578-a9f9-dc715322753f/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:887
15292024-06-22T01:30:27.606ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "068f97bb-730c-4f9d-bd36-0f5bdecd25dd", "content-length": "173", "date": "Sat, 22 Jun 2024 01:30:27 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"9f7cbf52-de0d-48c8-9e7d-2958552743a4\"", request_id: "068f97bb-730c-4f9d-bd36-0f5bdecd25dd" } file = sled-agent/src/rack_setup/service.rs:887
15302024-06-22T01:30:31.064ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "a67d1ba8-361e-4401-96c7-55ebd3f09b02", "content-length": "173", "date": "Sat, 22 Jun 2024 01:30:31 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"9f7cbf52-de0d-48c8-9e7d-2958552743a4\"", request_id: "a67d1ba8-361e-4401-96c7-55ebd3f09b02" } file = sled-agent/src/rack_setup/service.rs:887
15312024-06-22T01:30:34.158ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "19ec5f34-ba5f-49d2-a49b-6e228ca53541", "content-length": "173", "date": "Sat, 22 Jun 2024 01:30:33 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"9f7cbf52-de0d-48c8-9e7d-2958552743a4\"", request_id: "19ec5f34-ba5f-49d2-a49b-6e228ca53541" } file = sled-agent/src/rack_setup/service.rs:887
15322024-06-22T01:30:36.330ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "126ab584-55bd-4450-85b0-9ec7e3bd25d7", "content-length": "173", "date": "Sat, 22 Jun 2024 01:30:36 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"9f7cbf52-de0d-48c8-9e7d-2958552743a4\"", request_id: "126ab584-55bd-4450-85b0-9ec7e3bd25d7" } file = sled-agent/src/rack_setup/service.rs:887
15332024-06-22T01:30:39.319ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "c531361e-2cba-4497-b2de-80dd84fd3d90", "content-length": "173", "date": "Sat, 22 Jun 2024 01:30:39 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"9f7cbf52-de0d-48c8-9e7d-2958552743a4\"", request_id: "c531361e-2cba-4497-b2de-80dd84fd3d90" } file = sled-agent/src/rack_setup/service.rs:887
15342024-06-22T01:30:46.571ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "1020f184-b023-43fe-acce-78e4b76f14c4", "content-length": "173", "date": "Sat, 22 Jun 2024 01:30:46 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"9f7cbf52-de0d-48c8-9e7d-2958552743a4\"", request_id: "1020f184-b023-43fe-acce-78e4b76f14c4" } file = sled-agent/src/rack_setup/service.rs:887
15352024-06-22T01:30:47.367ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:48057
15362024-06-22T01:30:47.367ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 35 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:48057 req_id = 7c5a6463-c7dc-4d94-8afd-d1070011c16e response_code = 200 uri = /baseboard
15372024-06-22T01:30:53.918ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "d5b9a8d6-4c6a-48c8-a562-95fa8cef696e", "content-length": "173", "date": "Sat, 22 Jun 2024 01:30:53 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"9f7cbf52-de0d-48c8-9e7d-2958552743a4\"", request_id: "d5b9a8d6-4c6a-48c8-a562-95fa8cef696e" } file = sled-agent/src/rack_setup/service.rs:887
15382024-06-22T01:30:59.309ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "645a31b4-ecf4-4587-85ce-408b6918dc28", "content-length": "173", "date": "Sat, 22 Jun 2024 01:30:59 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"9f7cbf52-de0d-48c8-9e7d-2958552743a4\"", request_id: "645a31b4-ecf4-4587-85ce-408b6918dc28" } file = sled-agent/src/rack_setup/service.rs:887
15392024-06-22T01:31:02.972ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:592 new_generation = 1 old_generation = 1 sled_id = 9f7cbf52-de0d-48c8-9e7d-2958552743a4
15402024-06-22T01:31:03.057ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56941
15412024-06-22T01:31:03.058ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
15422024-06-22T01:31:03.144ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 85630 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56941 req_id = fd8be436-d0d1-4803-8fcb-115e328a1c7e response_code = 200 uri = /inventory
15432024-06-22T01:31:03.144ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
15442024-06-22T01:31:03.145ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/9b2f2513-2520-480a-aa3a-397437db476d/config/omicron-zones.json file = common/src/ledger.rs:177
15452024-06-22T01:31:03.145ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/3e31f9bf-741c-4ad6-aa69-e523a333a2d2/config/omicron-zones.json file = common/src/ledger.rs:177
15462024-06-22T01:31:03.146ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1545 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56941 req_id = c401cb89-211f-4a02-80ff-91706c9822cb response_code = 200 uri = /omicron-zones
15472024-06-22T01:31:08.910ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58510
15482024-06-22T01:31:08.912ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:524 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5362db8d-bb29-4e99-8d26-d1a82c174975, kind: Service { id: 97317836-790a-40be-b49a-5480f32bf256 }, name: Name("external-dns-97317836-790a-40be-b49a-5480f32bf256"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 204, 160])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: d0b869b3-003a-426a-b13e-b2c2aad51442, kind: Service { id: 4794eccf-57ac-4bf0-8ea5-3b0d68786898 }, name: Name("external-dns-4794eccf-57ac-4bf0-8ea5-3b0d68786898"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 135])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7747eb91-467b-47d6-a128-711ac1c7bf05, kind: Service { id: 515131a9-573e-47f6-bfa4-fac433bd59f0 }, name: Name("nexus-515131a9-573e-47f6-bfa4-fac433bd59f0"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 83])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 98a827f1-3762-4c1e-87c3-9167e6e76d2a, kind: Service { id: e0579974-e546-4f30-b7be-c7fca51ee278 }, name: Name("nexus-e0579974-e546-4f30-b7be-c7fca51ee278"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 160, 209])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: a2bee4b2-d860-42bc-80f8-8a229d0dcc78, kind: Service { id: 16f8da3d-c462-4156-86a4-9082477e2e5b }, name: Name("nexus-16f8da3d-c462-4156-86a4-9082477e2e5b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 223, 130])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
15492024-06-22T01:31:08.912ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15502024-06-22T01:31:08.913ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15512024-06-22T01:31:08.913ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte0" rules = []
15522024-06-22T01:31:08.913ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15532024-06-22T01:31:08.913ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15542024-06-22T01:31:08.913ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15552024-06-22T01:31:08.913ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 3394 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58510 req_id = 5b532bfa-6a80-4cf1-af81-c0e66d8a54e9 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
15562024-06-22T01:31:08.914ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:897
15572024-06-22T01:31:09.035ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58542
15582024-06-22T01:31:09.036ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
15592024-06-22T01:31:09.119ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 83155 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58542 req_id = 707aa30b-c338-44d0-89d8-4337dc1f2014 response_code = 200 uri = /inventory
15602024-06-22T01:31:09.119ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
15612024-06-22T01:31:09.119ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/9b2f2513-2520-480a-aa3a-397437db476d/config/omicron-zones.json file = common/src/ledger.rs:177
15622024-06-22T01:31:09.120ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/3e31f9bf-741c-4ad6-aa69-e523a333a2d2/config/omicron-zones.json file = common/src/ledger.rs:177
15632024-06-22T01:31:09.120ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1017 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58542 req_id = 02f74954-4f50-4d54-8e35-08fecb290caa response_code = 200 uri = /omicron-zones
15642024-06-22T01:31:10.205ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37359
15652024-06-22T01:31:10.205ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:524 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5362db8d-bb29-4e99-8d26-d1a82c174975, kind: Service { id: 97317836-790a-40be-b49a-5480f32bf256 }, name: Name("external-dns-97317836-790a-40be-b49a-5480f32bf256"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 204, 160])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: d0b869b3-003a-426a-b13e-b2c2aad51442, kind: Service { id: 4794eccf-57ac-4bf0-8ea5-3b0d68786898 }, name: Name("external-dns-4794eccf-57ac-4bf0-8ea5-3b0d68786898"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 135])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7747eb91-467b-47d6-a128-711ac1c7bf05, kind: Service { id: 515131a9-573e-47f6-bfa4-fac433bd59f0 }, name: Name("nexus-515131a9-573e-47f6-bfa4-fac433bd59f0"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 83])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 98a827f1-3762-4c1e-87c3-9167e6e76d2a, kind: Service { id: e0579974-e546-4f30-b7be-c7fca51ee278 }, name: Name("nexus-e0579974-e546-4f30-b7be-c7fca51ee278"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 160, 209])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: a2bee4b2-d860-42bc-80f8-8a229d0dcc78, kind: Service { id: 16f8da3d-c462-4156-86a4-9082477e2e5b }, name: Name("nexus-16f8da3d-c462-4156-86a4-9082477e2e5b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 223, 130])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
15662024-06-22T01:31:10.205ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15672024-06-22T01:31:10.205ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15682024-06-22T01:31:10.205ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte0" rules = []
15692024-06-22T01:31:10.205ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15702024-06-22T01:31:10.205ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15712024-06-22T01:31:10.205ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15722024-06-22T01:31:10.205ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 341 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37359 req_id = 581b48ab-7e33-417d-ac29-6767754bbfce response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
15732024-06-22T01:31:10.219ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58812
15742024-06-22T01:31:10.219ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:524 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5362db8d-bb29-4e99-8d26-d1a82c174975, kind: Service { id: 97317836-790a-40be-b49a-5480f32bf256 }, name: Name("external-dns-97317836-790a-40be-b49a-5480f32bf256"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 204, 160])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: d0b869b3-003a-426a-b13e-b2c2aad51442, kind: Service { id: 4794eccf-57ac-4bf0-8ea5-3b0d68786898 }, name: Name("external-dns-4794eccf-57ac-4bf0-8ea5-3b0d68786898"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 135])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7747eb91-467b-47d6-a128-711ac1c7bf05, kind: Service { id: 515131a9-573e-47f6-bfa4-fac433bd59f0 }, name: Name("nexus-515131a9-573e-47f6-bfa4-fac433bd59f0"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 83])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 98a827f1-3762-4c1e-87c3-9167e6e76d2a, kind: Service { id: e0579974-e546-4f30-b7be-c7fca51ee278 }, name: Name("nexus-e0579974-e546-4f30-b7be-c7fca51ee278"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 160, 209])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: a2bee4b2-d860-42bc-80f8-8a229d0dcc78, kind: Service { id: 16f8da3d-c462-4156-86a4-9082477e2e5b }, name: Name("nexus-16f8da3d-c462-4156-86a4-9082477e2e5b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 223, 130])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
15752024-06-22T01:31:10.219ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15762024-06-22T01:31:10.219ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15772024-06-22T01:31:10.219ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte0" rules = []
15782024-06-22T01:31:10.219ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15792024-06-22T01:31:10.219ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15802024-06-22T01:31:10.219ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15812024-06-22T01:31:10.219ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 412 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58812 req_id = d8367a0a-5ecb-4072-9a25-a39720a128c8 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
15822024-06-22T01:31:10.239ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63294
15832024-06-22T01:31:10.239ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:524 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5362db8d-bb29-4e99-8d26-d1a82c174975, kind: Service { id: 97317836-790a-40be-b49a-5480f32bf256 }, name: Name("external-dns-97317836-790a-40be-b49a-5480f32bf256"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 204, 160])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: d0b869b3-003a-426a-b13e-b2c2aad51442, kind: Service { id: 4794eccf-57ac-4bf0-8ea5-3b0d68786898 }, name: Name("external-dns-4794eccf-57ac-4bf0-8ea5-3b0d68786898"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 135])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7747eb91-467b-47d6-a128-711ac1c7bf05, kind: Service { id: 515131a9-573e-47f6-bfa4-fac433bd59f0 }, name: Name("nexus-515131a9-573e-47f6-bfa4-fac433bd59f0"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 83])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 98a827f1-3762-4c1e-87c3-9167e6e76d2a, kind: Service { id: e0579974-e546-4f30-b7be-c7fca51ee278 }, name: Name("nexus-e0579974-e546-4f30-b7be-c7fca51ee278"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 160, 209])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: a2bee4b2-d860-42bc-80f8-8a229d0dcc78, kind: Service { id: 16f8da3d-c462-4156-86a4-9082477e2e5b }, name: Name("nexus-16f8da3d-c462-4156-86a4-9082477e2e5b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 223, 130])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
15842024-06-22T01:31:10.239ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15852024-06-22T01:31:10.239ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15862024-06-22T01:31:10.239ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte0" rules = []
15872024-06-22T01:31:10.239ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15882024-06-22T01:31:10.239ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15892024-06-22T01:31:10.239ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15902024-06-22T01:31:10.239ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 231 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63294 req_id = 2902d637-97cf-42d4-a501-09826a1a2767 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
15912024-06-22T01:31:12.951ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:65146 remote_addr = [fd00:1122:3344:101::d]:61009 sled_id = 9f7cbf52-de0d-48c8-9e7d-2958552743a4
15922024-06-22T01:31:12.957ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 5324 local_addr = [fd00:1122:3344:101::1]:65146 method = GET remote_addr = [fd00:1122:3344:101::d]:61009 req_id = 0ed1a3a4-0afa-478d-aaa9-09471adb4a8a response_code = 200 sled_id = 9f7cbf52-de0d-48c8-9e7d-2958552743a4 uri = /9f7cbf52-de0d-48c8-9e7d-2958552743a4
15932024-06-22T01:31:17.534ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:64669
15942024-06-22T01:31:17.534ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 50 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:64669 req_id = 317ab536-2204-4bb8-8f46-0b5b1bf6a238 response_code = 200 uri = /baseboard
15952024-06-22T01:31:25.940ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58596
15962024-06-22T01:31:25.940ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 393 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58596 req_id = f6925c5e-2880-4f96-88fb-cb231125fc96 response_code = 200 uri = /v2p
15972024-06-22T01:31:26.094ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43440
15982024-06-22T01:31:26.094ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43440 req_id = 80d73263-4d5c-437f-98de-7c1d4e96c42b response_code = 200 uri = /v2p
15992024-06-22T01:31:26.144ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45575
16002024-06-22T01:31:26.144ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45575 req_id = 900593b8-30a0-45e1-bada-260f44776bb3 response_code = 200 uri = /v2p
16012024-06-22T01:31:26.259ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47572
16022024-06-22T01:31:26.341ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 81308 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:47572 req_id = ea0757f9-98f9-473b-b771-9f8df2cf6a0c response_code = 204 uri = /switch-ports
16032024-06-22T01:31:26.341ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47572 req_id = 68b7aa4b-6823-4e93-a011-dc07725a50cc response_code = 200 uri = /network-bootstore-config
16042024-06-22T01:31:26.349ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44469
16052024-06-22T01:31:26.402ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 53077 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:44469 req_id = e4e5aa51-e351-4ef3-9491-92b7fec56fc2 response_code = 204 uri = /switch-ports
16062024-06-22T01:31:26.403ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
16072024-06-22T01:31:26.403ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1060 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44469 req_id = 95cf9552-952a-4244-9980-63ae54713e78 response_code = 200 uri = /network-bootstore-config
16082024-06-22T01:31:26.403ZINFOSledAgent (bootstore): Writing ledger to /pool/int/9b2f2513-2520-480a-aa3a-397437db476d/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
16092024-06-22T01:31:26.405ZINFOSledAgent (bootstore): Writing ledger to /pool/int/3e31f9bf-741c-4ad6-aa69-e523a333a2d2/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
16102024-06-22T01:31:26.406ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
16112024-06-22T01:31:26.406ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 3876 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47572 req_id = 9d5c1a29-51d6-4035-99cc-bd0aebe61ea3 response_code = 204 uri = /network-bootstore-config
16122024-06-22T01:31:26.589ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62300
16132024-06-22T01:31:26.634ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 45544 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:62300 req_id = 83661fe4-92a8-4607-a322-b6e37df9c0d2 response_code = 204 uri = /switch-ports
16142024-06-22T01:31:26.635ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62300 req_id = 62fa0390-59ec-4607-a021-49e63eb93b8d response_code = 200 uri = /network-bootstore-config
16152024-06-22T01:31:42.894ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 733 local_addr = [fd00:1122:3344:101::1]:65146 method = GET remote_addr = [fd00:1122:3344:101::d]:61009 req_id = 769d005c-b95f-448f-afd5-bf220739e525 response_code = 200 sled_id = 9f7cbf52-de0d-48c8-9e7d-2958552743a4 uri = /9f7cbf52-de0d-48c8-9e7d-2958552743a4
16162024-06-22T01:31:47.502ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:35712
16172024-06-22T01:31:47.502ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 676 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:35712 req_id = b5bab046-4260-4274-a951-61297d880694 response_code = 200 uri = /baseboard
16182024-06-22T01:31:55.868ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64407
16192024-06-22T01:31:55.869ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 233 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64407 req_id = 233a9d62-40ba-4749-8ed5-3fcbc5cf66b3 response_code = 200 uri = /v2p
16202024-06-22T01:31:55.913ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51944
16212024-06-22T01:31:55.914ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51944 req_id = 4f202096-5d29-4d34-bb03-e3c0ec8ce0e3 response_code = 200 uri = /v2p
16222024-06-22T01:31:55.962ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62666
16232024-06-22T01:31:55.962ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62666 req_id = 25d974fa-48c1-4016-8f48-017e9abc335f response_code = 200 uri = /v2p
16242024-06-22T01:31:56.001ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45625
16252024-06-22T01:31:56.051ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 50742 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:45625 req_id = e0adf8ab-56fe-4c73-986e-3df16d099135 response_code = 204 uri = /switch-ports
16262024-06-22T01:31:56.051ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57864
16272024-06-22T01:31:56.052ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45543
16282024-06-22T01:31:56.055ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 3405 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45625 req_id = 667a5fdc-d152-4ce3-9da2-9e71b849a768 response_code = 200 uri = /network-bootstore-config
16292024-06-22T01:31:56.096ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 45007 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:57864 req_id = 2b04f71e-5e3d-437d-aa5b-1ebea3c8db50 response_code = 204 uri = /switch-ports
16302024-06-22T01:31:56.101ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1086 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57864 req_id = cb5ab5f9-1f8c-4283-940e-2c9a85a6126d response_code = 200 uri = /network-bootstore-config
16312024-06-22T01:31:56.141ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 89492 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:45543 req_id = 04b03e40-fc15-4258-b88a-4a56700219e5 response_code = 204 uri = /switch-ports
16322024-06-22T01:31:56.141ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45543 req_id = 469942f0-7b0c-4085-8b67-416234224e8a response_code = 200 uri = /network-bootstore-config
16332024-06-22T01:32:12.830ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 856 local_addr = [fd00:1122:3344:101::1]:65146 method = GET remote_addr = [fd00:1122:3344:101::d]:61009 req_id = b4ec1325-f138-46f5-9485-2db7fc33ec1f response_code = 200 sled_id = 9f7cbf52-de0d-48c8-9e7d-2958552743a4 uri = /9f7cbf52-de0d-48c8-9e7d-2958552743a4
16342024-06-22T01:32:17.480ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:47536
16352024-06-22T01:32:17.480ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 73 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:47536 req_id = d650c671-38c8-43cc-bdae-3cad4031cdbe response_code = 200 uri = /baseboard
16362024-06-22T01:32:25.908ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56232
16372024-06-22T01:32:25.908ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56232 req_id = e0cc1038-1887-4013-9dce-ea8ad25d3ffa response_code = 200 uri = /v2p
16382024-06-22T01:32:25.955ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49808
16392024-06-22T01:32:25.956ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 959 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49808 req_id = 600ac54f-dae2-4ed8-a6af-a3e5b7c6d4a3 response_code = 200 uri = /v2p
16402024-06-22T01:32:25.988ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60148
16412024-06-22T01:32:25.989ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60148 req_id = efa5f163-04ef-4c6a-88eb-bb3892eb00b2 response_code = 200 uri = /v2p
16422024-06-22T01:32:26.100ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48226
16432024-06-22T01:32:26.149ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 48267 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:48226 req_id = 8691f38d-ba94-4f57-bda7-6817f986959c response_code = 204 uri = /switch-ports
16442024-06-22T01:32:26.149ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43912
16452024-06-22T01:32:26.149ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64467
16462024-06-22T01:32:26.152ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 3003 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48226 req_id = 9bc629e6-5e11-4723-8c58-08b3f75ede7f response_code = 200 uri = /network-bootstore-config
16472024-06-22T01:32:26.191ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 42583 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:43912 req_id = 443b9458-7e73-4ede-bdb9-882c14cfd314 response_code = 204 uri = /switch-ports
16482024-06-22T01:32:26.194ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 342 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43912 req_id = 29d32f65-50f5-4d51-b780-0a3595e0973a response_code = 200 uri = /network-bootstore-config
16492024-06-22T01:32:26.233ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 84040 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:64467 req_id = 2e38a05b-f5f9-42f5-b05a-ddb9836a688e response_code = 204 uri = /switch-ports
16502024-06-22T01:32:26.234ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 855 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64467 req_id = 7e7c4888-5f36-4ac8-9a75-8fa3f55b4406 response_code = 200 uri = /network-bootstore-config
16512024-06-22T01:32:42.789ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 560 local_addr = [fd00:1122:3344:101::1]:65146 method = GET remote_addr = [fd00:1122:3344:101::d]:61009 req_id = d1ce93af-d158-4847-b3ea-50ad98a72b34 response_code = 200 sled_id = 9f7cbf52-de0d-48c8-9e7d-2958552743a4 uri = /9f7cbf52-de0d-48c8-9e7d-2958552743a4
16522024-06-22T01:32:47.471ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:43192
16532024-06-22T01:32:47.471ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 72 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:43192 req_id = 3ae827fb-28a5-4339-848d-3393c2152b71 response_code = 200 uri = /baseboard
16542024-06-22T01:32:55.764ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47814
16552024-06-22T01:32:55.764ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 178 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47814 req_id = cb20570a-b59b-454d-b8cd-d6fbba2f64fd response_code = 200 uri = /v2p
16562024-06-22T01:32:55.781ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56550
16572024-06-22T01:32:55.781ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56550 req_id = ea0e1d45-7ee6-46ca-ac8b-e697d4f894dd response_code = 200 uri = /v2p
16582024-06-22T01:32:55.786ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58461
16592024-06-22T01:32:55.786ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58461 req_id = 723b9349-b303-4d5d-996f-7e6f637c97d7 response_code = 200 uri = /v2p
16602024-06-22T01:32:55.873ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40472
16612024-06-22T01:32:55.919ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 45422 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:40472 req_id = 37c32dbd-8334-474b-99fc-48ddcd1539aa response_code = 204 uri = /switch-ports
16622024-06-22T01:32:55.920ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 879 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40472 req_id = 0f9e8664-52d7-4bb4-9db9-e3462e8ead11 response_code = 200 uri = /network-bootstore-config
16632024-06-22T01:32:55.943ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53375
16642024-06-22T01:32:55.991ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 47685 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:53375 req_id = d18b61e6-acef-4da8-8f84-ca47a00a643c response_code = 204 uri = /switch-ports
16652024-06-22T01:32:55.991ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58641
16662024-06-22T01:32:55.995ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 3306 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53375 req_id = c7600771-6c8a-4c5d-8a28-1461c97cfe1d response_code = 200 uri = /network-bootstore-config
16672024-06-22T01:32:56.040ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 48842 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:58641 req_id = 4664938f-4d42-4adc-b0ae-81e47e260c2b response_code = 204 uri = /switch-ports
16682024-06-22T01:32:56.040ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58641 req_id = bb8c95ed-21db-458b-a951-376faac248e9 response_code = 200 uri = /network-bootstore-config
16692024-06-22T01:33:12.801ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 368 local_addr = [fd00:1122:3344:101::1]:65146 method = GET remote_addr = [fd00:1122:3344:101::d]:61009 req_id = b02b9c05-f4e4-485b-9ddd-4a856ab1f112 response_code = 200 sled_id = 9f7cbf52-de0d-48c8-9e7d-2958552743a4 uri = /9f7cbf52-de0d-48c8-9e7d-2958552743a4
16702024-06-22T01:33:17.506ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:47378
16712024-06-22T01:33:17.506ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 101 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:47378 req_id = 34089832-9fb8-491a-a856-5fb8c081ee08 response_code = 200 uri = /baseboard
16722024-06-22T01:33:25.876ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44310
16732024-06-22T01:33:25.876ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 203 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44310 req_id = 54cdc2e2-d018-4613-848e-d00032b4c63e response_code = 200 uri = /v2p
16742024-06-22T01:33:25.880ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34859
16752024-06-22T01:33:25.880ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34859 req_id = a473b844-f636-480f-8db7-5c457c0e96a2 response_code = 200 uri = /v2p
16762024-06-22T01:33:26.108ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57254
16772024-06-22T01:33:26.108ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 195 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57254 req_id = 96d3e126-836d-4450-ad1b-44c145e78ee8 response_code = 200 uri = /v2p
16782024-06-22T01:33:26.124ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34308
16792024-06-22T01:33:26.175ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 51106 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:34308 req_id = 091ae6cd-53df-4d78-b5fa-54f9f49c2092 response_code = 204 uri = /switch-ports
16802024-06-22T01:33:26.176ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34308 req_id = c649f399-7a89-4068-a347-409377c267cd response_code = 200 uri = /network-bootstore-config
16812024-06-22T01:33:26.271ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63189
16822024-06-22T01:33:26.316ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 44468 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:63189 req_id = f5ee6390-f7d3-460d-8c93-736bfa28a426 response_code = 204 uri = /switch-ports
16832024-06-22T01:33:26.316ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42930
16842024-06-22T01:33:26.319ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 2971 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63189 req_id = 98454a5d-199b-4758-bf4b-adadf1fe7c1c response_code = 200 uri = /network-bootstore-config
16852024-06-22T01:33:26.361ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 44591 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:42930 req_id = d3870304-f6e0-4abe-b12b-a4cb4788412c response_code = 204 uri = /switch-ports
16862024-06-22T01:33:26.361ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42930 req_id = 14c48f4c-c020-4013-b7b9-916c4f1d9d70 response_code = 200 uri = /network-bootstore-config
16872024-06-22T01:33:34.397ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
16882024-06-22T01:33:42.865ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 581 local_addr = [fd00:1122:3344:101::1]:65146 method = GET remote_addr = [fd00:1122:3344:101::d]:61009 req_id = 3ce90ac4-4a02-43bb-bb6c-44ab3f086db6 response_code = 200 sled_id = 9f7cbf52-de0d-48c8-9e7d-2958552743a4 uri = /9f7cbf52-de0d-48c8-9e7d-2958552743a4
16892024-06-22T01:33:47.539ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:45085
16902024-06-22T01:33:47.540ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 622 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:45085 req_id = a33048d4-ade4-4603-b0b5-919f17f7a804 response_code = 200 uri = /baseboard
16912024-06-22T01:33:55.747ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51689
16922024-06-22T01:33:55.747ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51689 req_id = be68514f-13d0-4f81-9cbd-fccf0399d06d response_code = 200 uri = /v2p
16932024-06-22T01:33:55.760ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58548
16942024-06-22T01:33:55.760ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58548 req_id = 5bc44b4a-f0af-4eeb-b836-9f68e4b0223f response_code = 200 uri = /v2p
16952024-06-22T01:33:55.773ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34770
16962024-06-22T01:33:55.773ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34770 req_id = 0f6f6da8-093f-4971-b5af-37fd679fe88e response_code = 200 uri = /v2p
16972024-06-22T01:33:55.905ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58570
16982024-06-22T01:33:55.954ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 48420 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:58570 req_id = 3de65631-ba9a-417d-8c4d-b5c3ca5ca9dc response_code = 204 uri = /switch-ports
16992024-06-22T01:33:55.954ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60420
17002024-06-22T01:33:55.957ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 3201 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58570 req_id = d1d054ae-40e8-438f-b6d3-8e09c5489f07 response_code = 200 uri = /network-bootstore-config
17012024-06-22T01:33:55.965ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60909
17022024-06-22T01:33:56.000ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 45776 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:60420 req_id = a6cee446-2c2b-4a98-ac89-0eb4fe889307 response_code = 204 uri = /switch-ports
17032024-06-22T01:33:56.004ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 562 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60420 req_id = b9bdb10e-5b9c-47f3-b52d-6f76dd3578bf response_code = 200 uri = /network-bootstore-config
17042024-06-22T01:33:56.046ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 80437 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:60909 req_id = e0e76e54-0a1e-47fb-ba54-4e65ec238dd5 response_code = 204 uri = /switch-ports
17052024-06-22T01:33:56.046ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60909 req_id = 39100160-3ba5-451b-a9ce-90a958113693 response_code = 200 uri = /network-bootstore-config
17062024-06-22T01:34:12.866ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 899 local_addr = [fd00:1122:3344:101::1]:65146 method = GET remote_addr = [fd00:1122:3344:101::d]:61009 req_id = be24bf97-976b-4b5f-936e-5c4d7dbe2b65 response_code = 200 sled_id = 9f7cbf52-de0d-48c8-9e7d-2958552743a4 uri = /9f7cbf52-de0d-48c8-9e7d-2958552743a4
17072024-06-22T01:34:17.575ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:32777
17082024-06-22T01:34:17.575ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 801 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:32777 req_id = fc6dc3fa-b7e4-472d-8b24-ddfb71f7a34d response_code = 200 uri = /baseboard
17092024-06-22T01:34:25.829ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44231
17102024-06-22T01:34:25.831ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1480 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44231 req_id = 7cd6fd79-769b-4279-b9c0-8600381bed4f response_code = 200 uri = /v2p
17112024-06-22T01:34:25.856ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41182
17122024-06-22T01:34:25.856ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41182 req_id = c7000498-6930-48f6-a73d-51cf4134b13b response_code = 200 uri = /v2p
17132024-06-22T01:34:26.079ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63875
17142024-06-22T01:34:26.079ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63875 req_id = bcdbc77f-3a7e-4c9c-b790-d1f025ec3e09 response_code = 200 uri = /v2p
17152024-06-22T01:34:26.085ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60414
17162024-06-22T01:34:26.136ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 50901 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:60414 req_id = e679bace-7105-4f02-918e-f63eaf10e717 response_code = 204 uri = /switch-ports
17172024-06-22T01:34:26.136ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60414 req_id = cf30792d-4633-4f07-a093-a676fd10e5f3 response_code = 200 uri = /network-bootstore-config
17182024-06-22T01:34:26.208ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47616
17192024-06-22T01:34:26.257ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 48362 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:47616 req_id = cca372aa-7c2e-4dcd-81b1-b421f1429dab response_code = 204 uri = /switch-ports
17202024-06-22T01:34:26.257ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54489
17212024-06-22T01:34:26.260ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 3211 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47616 req_id = 993c5bd6-cdc5-4c7d-96c5-9cf6f95da538 response_code = 200 uri = /network-bootstore-config
17222024-06-22T01:34:26.301ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 43858 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:54489 req_id = c71a964d-6ed3-4496-bb1b-d1246b6b2851 response_code = 204 uri = /switch-ports
17232024-06-22T01:34:26.301ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54489 req_id = 0fc311fe-27b6-40bf-b943-7b6f2b1436c5 response_code = 200 uri = /network-bootstore-config
17242024-06-22T01:34:42.867ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1259 local_addr = [fd00:1122:3344:101::1]:65146 method = GET remote_addr = [fd00:1122:3344:101::d]:61009 req_id = 06ec8eec-cdfb-4afe-948d-94da53166daf response_code = 200 sled_id = 9f7cbf52-de0d-48c8-9e7d-2958552743a4 uri = /9f7cbf52-de0d-48c8-9e7d-2958552743a4
17252024-06-22T01:34:47.607ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:51778
17262024-06-22T01:34:47.608ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 572 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:51778 req_id = 67fb0443-64ba-4c48-91f9-8c71c7da3e38 response_code = 200 uri = /baseboard
17272024-06-22T01:34:55.733ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52838
17282024-06-22T01:34:55.734ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 195 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52838 req_id = e2b629f2-1d45-4032-bfc3-2fa6742e1550 response_code = 200 uri = /v2p
17292024-06-22T01:34:55.756ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52092
17302024-06-22T01:34:55.756ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52092 req_id = d8ded948-595f-4794-ac18-8a7166aa7525 response_code = 200 uri = /v2p
17312024-06-22T01:34:55.780ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46815
17322024-06-22T01:34:55.781ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46815 req_id = 5da83ca0-e378-47f7-8484-834e96a71680 response_code = 200 uri = /v2p
17332024-06-22T01:34:55.883ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59233
17342024-06-22T01:34:55.929ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 46291 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:59233 req_id = 804e1bd0-07ea-4cb4-b773-73e5481c20c4 response_code = 204 uri = /switch-ports
17352024-06-22T01:34:55.929ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64012
17362024-06-22T01:34:55.930ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 287 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59233 req_id = 822d728e-e0b9-48ee-a83d-a4f7c865eac1 response_code = 200 uri = /network-bootstore-config
17372024-06-22T01:34:55.961ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56504
17382024-06-22T01:34:55.979ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 49001 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:64012 req_id = 8adaf976-3b5d-4be6-9552-b42f344bdfa9 response_code = 204 uri = /switch-ports
17392024-06-22T01:34:55.982ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 580 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64012 req_id = 4d9df4ae-a2d9-4165-aaa9-f0973a581414 response_code = 200 uri = /network-bootstore-config
17402024-06-22T01:34:56.023ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 62260 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:56504 req_id = 4161d8a1-d2fd-4f01-af41-100bb794eb59 response_code = 204 uri = /switch-ports
17412024-06-22T01:34:56.024ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56504 req_id = bfb1fb6a-3f82-4f44-b0e5-322483277071 response_code = 200 uri = /network-bootstore-config
17422024-06-22T01:35:12.867ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 983 local_addr = [fd00:1122:3344:101::1]:65146 method = GET remote_addr = [fd00:1122:3344:101::d]:61009 req_id = c35b0dff-0b05-4d14-931c-1acafb542944 response_code = 200 sled_id = 9f7cbf52-de0d-48c8-9e7d-2958552743a4 uri = /9f7cbf52-de0d-48c8-9e7d-2958552743a4
17432024-06-22T01:35:17.642ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:37859
17442024-06-22T01:35:17.642ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 104 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:37859 req_id = d2169e49-e09f-4012-aad2-74083b46dfba response_code = 200 uri = /baseboard
17452024-06-22T01:35:25.847ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33622
17462024-06-22T01:35:25.848ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1246 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33622 req_id = 946bdc3d-acee-4bae-8069-60a2fd700941 response_code = 200 uri = /v2p
17472024-06-22T01:35:25.974ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38630
17482024-06-22T01:35:25.975ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1038 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38630 req_id = 99e8b4c9-d177-44ad-9477-7b5dfc827db9 response_code = 200 uri = /v2p
17492024-06-22T01:35:26.020ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64587
17502024-06-22T01:35:26.021ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64587 req_id = 7d2c2166-98df-43a5-8adf-823afef6a9a2 response_code = 200 uri = /v2p
17512024-06-22T01:35:26.043ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39826
17522024-06-22T01:35:26.043ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:524 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5362db8d-bb29-4e99-8d26-d1a82c174975, kind: Service { id: 97317836-790a-40be-b49a-5480f32bf256 }, name: Name("external-dns-97317836-790a-40be-b49a-5480f32bf256"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 204, 160])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: d0b869b3-003a-426a-b13e-b2c2aad51442, kind: Service { id: 4794eccf-57ac-4bf0-8ea5-3b0d68786898 }, name: Name("external-dns-4794eccf-57ac-4bf0-8ea5-3b0d68786898"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 135])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7747eb91-467b-47d6-a128-711ac1c7bf05, kind: Service { id: 515131a9-573e-47f6-bfa4-fac433bd59f0 }, name: Name("nexus-515131a9-573e-47f6-bfa4-fac433bd59f0"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 83])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 98a827f1-3762-4c1e-87c3-9167e6e76d2a, kind: Service { id: e0579974-e546-4f30-b7be-c7fca51ee278 }, name: Name("nexus-e0579974-e546-4f30-b7be-c7fca51ee278"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 160, 209])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: a2bee4b2-d860-42bc-80f8-8a229d0dcc78, kind: Service { id: 16f8da3d-c462-4156-86a4-9082477e2e5b }, name: Name("nexus-16f8da3d-c462-4156-86a4-9082477e2e5b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 223, 130])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17532024-06-22T01:35:26.043ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17542024-06-22T01:35:26.043ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17552024-06-22T01:35:26.043ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte0" rules = []
17562024-06-22T01:35:26.043ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17572024-06-22T01:35:26.043ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17582024-06-22T01:35:26.043ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17592024-06-22T01:35:26.043ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 372 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39826 req_id = 84448ec7-7e39-4cd7-bc73-549d1fbe0f0d response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17602024-06-22T01:35:26.133ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51523
17612024-06-22T01:35:26.134ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:524 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5362db8d-bb29-4e99-8d26-d1a82c174975, kind: Service { id: 97317836-790a-40be-b49a-5480f32bf256 }, name: Name("external-dns-97317836-790a-40be-b49a-5480f32bf256"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 204, 160])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: d0b869b3-003a-426a-b13e-b2c2aad51442, kind: Service { id: 4794eccf-57ac-4bf0-8ea5-3b0d68786898 }, name: Name("external-dns-4794eccf-57ac-4bf0-8ea5-3b0d68786898"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 135])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7747eb91-467b-47d6-a128-711ac1c7bf05, kind: Service { id: 515131a9-573e-47f6-bfa4-fac433bd59f0 }, name: Name("nexus-515131a9-573e-47f6-bfa4-fac433bd59f0"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 83])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 98a827f1-3762-4c1e-87c3-9167e6e76d2a, kind: Service { id: e0579974-e546-4f30-b7be-c7fca51ee278 }, name: Name("nexus-e0579974-e546-4f30-b7be-c7fca51ee278"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 160, 209])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: a2bee4b2-d860-42bc-80f8-8a229d0dcc78, kind: Service { id: 16f8da3d-c462-4156-86a4-9082477e2e5b }, name: Name("nexus-16f8da3d-c462-4156-86a4-9082477e2e5b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 223, 130])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17622024-06-22T01:35:26.134ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17632024-06-22T01:35:26.134ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17642024-06-22T01:35:26.134ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte0" rules = []
17652024-06-22T01:35:26.134ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17662024-06-22T01:35:26.134ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17672024-06-22T01:35:26.134ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17682024-06-22T01:35:26.134ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 285 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51523 req_id = ce970961-ff50-44f9-8b92-51236591c614 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17692024-06-22T01:35:26.155ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34933
17702024-06-22T01:35:26.156ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:524 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5362db8d-bb29-4e99-8d26-d1a82c174975, kind: Service { id: 97317836-790a-40be-b49a-5480f32bf256 }, name: Name("external-dns-97317836-790a-40be-b49a-5480f32bf256"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 204, 160])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: d0b869b3-003a-426a-b13e-b2c2aad51442, kind: Service { id: 4794eccf-57ac-4bf0-8ea5-3b0d68786898 }, name: Name("external-dns-4794eccf-57ac-4bf0-8ea5-3b0d68786898"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 135])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7747eb91-467b-47d6-a128-711ac1c7bf05, kind: Service { id: 515131a9-573e-47f6-bfa4-fac433bd59f0 }, name: Name("nexus-515131a9-573e-47f6-bfa4-fac433bd59f0"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 83])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 98a827f1-3762-4c1e-87c3-9167e6e76d2a, kind: Service { id: e0579974-e546-4f30-b7be-c7fca51ee278 }, name: Name("nexus-e0579974-e546-4f30-b7be-c7fca51ee278"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 160, 209])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: a2bee4b2-d860-42bc-80f8-8a229d0dcc78, kind: Service { id: 16f8da3d-c462-4156-86a4-9082477e2e5b }, name: Name("nexus-16f8da3d-c462-4156-86a4-9082477e2e5b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 223, 130])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17712024-06-22T01:35:26.156ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17722024-06-22T01:35:26.156ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17732024-06-22T01:35:26.156ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte0" rules = []
17742024-06-22T01:35:26.156ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17752024-06-22T01:35:26.156ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17762024-06-22T01:35:26.156ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17772024-06-22T01:35:26.156ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 867 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34933 req_id = 1fa3098c-34c3-4670-87dc-21817a7be652 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17782024-06-22T01:35:26.174ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64900
17792024-06-22T01:35:26.222ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 48263 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:64900 req_id = 905076d9-b14e-427e-b679-f2c23c45041f response_code = 204 uri = /switch-ports
17802024-06-22T01:35:26.222ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53698
17812024-06-22T01:35:26.265ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 42735 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:53698 req_id = c10229d9-2587-4350-b2ce-254d35750f7a response_code = 204 uri = /switch-ports
17822024-06-22T01:35:26.265ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54460
17832024-06-22T01:35:26.266ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 846 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64900 req_id = 27f0585d-fd39-4eba-9ab0-05dcb413429a response_code = 200 uri = /network-bootstore-config
17842024-06-22T01:35:26.266ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 840 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53698 req_id = 55867b44-27e1-4011-a164-24a37103b9cf response_code = 200 uri = /network-bootstore-config
17852024-06-22T01:35:26.316ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 50532 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:54460 req_id = 21f848e0-7fd5-4a8d-9681-9903049de2fa response_code = 204 uri = /switch-ports
17862024-06-22T01:35:26.317ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54460 req_id = 731b4072-ef41-4110-a0b3-94c182979e37 response_code = 200 uri = /network-bootstore-config
17872024-06-22T01:35:42.868ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 818 local_addr = [fd00:1122:3344:101::1]:65146 method = GET remote_addr = [fd00:1122:3344:101::d]:61009 req_id = 6dd318fb-16d4-4a67-9ddb-4742667c20ed response_code = 200 sled_id = 9f7cbf52-de0d-48c8-9e7d-2958552743a4 uri = /9f7cbf52-de0d-48c8-9e7d-2958552743a4
17882024-06-22T01:35:47.673ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:60212
17892024-06-22T01:35:47.674ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 83 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:60212 req_id = 54899fbf-7287-4fbc-a309-540366825b67 response_code = 200 uri = /baseboard
17902024-06-22T01:35:55.763ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39646
17912024-06-22T01:35:55.764ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 974 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39646 req_id = bb598f7e-846b-4140-9cfb-4650d2d579f2 response_code = 200 uri = /v2p
17922024-06-22T01:35:55.785ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44589
17932024-06-22T01:35:55.785ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44589 req_id = 89c688fc-2ed0-49df-aff4-1b25d14444f3 response_code = 200 uri = /v2p
17942024-06-22T01:35:55.831ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62098
17952024-06-22T01:35:55.832ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62098 req_id = d7b198e8-4adf-43e7-aa56-b36c8679b7db response_code = 200 uri = /v2p
17962024-06-22T01:35:55.882ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54894
17972024-06-22T01:35:55.932ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 49806 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:54894 req_id = dddf1eb3-9b1f-4692-8edd-870d8409e955 response_code = 204 uri = /switch-ports
17982024-06-22T01:35:55.932ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33922
17992024-06-22T01:35:55.978ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 46129 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:33922 req_id = 69300cc7-4681-48ce-a7ae-2ee2c9b2550a response_code = 204 uri = /switch-ports
18002024-06-22T01:35:55.978ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54894 req_id = 2d57bc86-2099-4745-a05d-11cac3b90b00 response_code = 200 uri = /network-bootstore-config
18012024-06-22T01:35:55.978ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33922 req_id = d6766bd8-1a59-4bc8-a97c-aa8822d22849 response_code = 200 uri = /network-bootstore-config
18022024-06-22T01:35:55.988ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62483
18032024-06-22T01:35:56.036ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 48048 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:62483 req_id = 69f7e60f-4085-4c9a-b617-b68d945f3036 response_code = 204 uri = /switch-ports
18042024-06-22T01:35:56.036ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62483 req_id = 98c5a92a-4456-460e-ab90-75f116071181 response_code = 200 uri = /network-bootstore-config
18052024-06-22T01:36:12.957ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 2181 local_addr = [fd00:1122:3344:101::1]:65146 method = GET remote_addr = [fd00:1122:3344:101::d]:61009 req_id = 686549f7-664b-4087-bad6-4a04f2e5f6a0 response_code = 200 sled_id = 9f7cbf52-de0d-48c8-9e7d-2958552743a4 uri = /9f7cbf52-de0d-48c8-9e7d-2958552743a4
18062024-06-22T01:36:17.705ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:34008
18072024-06-22T01:36:17.705ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 89 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:34008 req_id = 696043d0-9d31-4c6f-ad27-3676e757afd8 response_code = 200 uri = /baseboard
18082024-06-22T01:36:25.844ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58461
18092024-06-22T01:36:25.845ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 199 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58461 req_id = 1a19c36a-13df-466a-a829-3df95aeda0a8 response_code = 200 uri = /v2p
18102024-06-22T01:36:25.878ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60083
18112024-06-22T01:36:25.878ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60083 req_id = 7002e144-7553-4ee3-bebc-6dcddc8ba941 response_code = 200 uri = /v2p
18122024-06-22T01:36:25.958ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64812
18132024-06-22T01:36:25.959ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64812 req_id = 5d948c0c-6607-4bb8-9fe5-44598004bc7e response_code = 200 uri = /v2p
18142024-06-22T01:36:26.106ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45876
18152024-06-22T01:36:26.156ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 49251 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:45876 req_id = 15190b80-6d4e-4b77-a9f4-a9d39ce46083 response_code = 204 uri = /switch-ports
18162024-06-22T01:36:26.156ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43195
18172024-06-22T01:36:26.159ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 3516 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45876 req_id = dd35faf7-a905-4e8f-a0e9-74c31228b963 response_code = 200 uri = /network-bootstore-config
18182024-06-22T01:36:26.201ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 45595 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:43195 req_id = 1996ed19-8d55-401a-9afa-c47a2108365e response_code = 204 uri = /switch-ports
18192024-06-22T01:36:26.202ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43195 req_id = b37f4840-c55c-4543-a339-61d08da9ec20 response_code = 200 uri = /network-bootstore-config
18202024-06-22T01:36:26.222ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47024
18212024-06-22T01:36:26.266ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 44491 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:47024 req_id = 3a6ee2d3-1bd0-49a3-bb05-f0a5a8419512 response_code = 204 uri = /switch-ports
18222024-06-22T01:36:26.267ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47024 req_id = 83be728d-2583-41d0-8956-444bb9be65e9 response_code = 200 uri = /network-bootstore-config
18232024-06-22T01:36:31.482ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46750
18242024-06-22T01:36:31.482ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 212 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46750 req_id = b2f1542b-242f-4c59-af06-b58579763ec8 response_code = 200 uri = /v2p
18252024-06-22T01:36:31.482ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:631 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 247, 50, 189])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(7938441) }
18262024-06-22T01:36:31.482ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 524 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46750 req_id = cc853fa3-32b6-4045-9e9b-d58d4a58f718 response_code = 204 uri = /v2p
18272024-06-22T01:36:31.629ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59118
18282024-06-22T01:36:31.635ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:548 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: b0f89a01-5cb0-49f0-8a94-fb24408ad7fb, kind: Instance { id: b0f3f665-8a5f-42b1-8ec5-b247fe51c9e1 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 247, 50, 189])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(7938441), primary: true, slot: 0 }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: b0f89a01-5cb0-49f0-8a94-fb24408ad7fb, kind: Instance { id: b0f3f665-8a5f-42b1-8ec5-b247fe51c9e1 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 247, 50, 189])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(7938441), primary: true, slot: 0 }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: b0f89a01-5cb0-49f0-8a94-fb24408ad7fb, kind: Instance { id: b0f3f665-8a5f-42b1-8ec5-b247fe51c9e1 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 247, 50, 189])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(7938441), primary: true, slot: 0 }], filter_hosts: Some([Vpc(Vni(7938441))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: b0f89a01-5cb0-49f0-8a94-fb24408ad7fb, kind: Instance { id: b0f3f665-8a5f-42b1-8ec5-b247fe51c9e1 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 247, 50, 189])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(7938441), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-d1a65230eba", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: c9c2e059-63c5-4444-9f4d-f2d3d8376400, read_only_parent: Some(Volume { block_size: 512, id: d2358467-e69f-44f9-834e-aca09fbab93a, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 92503368-6642-4564-9d97-9b35d502488b, key: Some("weCFeBQ4ryjkQCor8x5ij4T7aU2pdwzT9TcuRwp1GCk="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::18]:19001", "[fd00:1122:3344:101::17]:19001", "[fd00:1122:3344:101::16]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: c9c2e059-63c5-4444-9f4d-f2d3d8376400, key: Some("iXCwmnb+rDEL+edEH5N11WGd6faJ5aWq9KeUZQQf/s4="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::16]:19002", "[fd00:1122:3344:101::12]:19001", "[fd00:1122:3344:101::14]:19000"] } }] } }], cloud_init_bytes: Some("6zyQTVNXSU40LjEAAgEBAAIAAioA+AEAKgBAAAAAAAAAAAAAAAApeFY0EmNpZGF0YSAgICAgRkFUMTIgICAOH75bfKwiwHQLVrQOuwcAzRBe6/Ay5M0WzRnr/lRoaXMgaXMgbm90IGEgYm9vdGFibGUgZGlzay4gIFBsZWFzZSBpbnNlcnQgYSBib290YWJsZSBmbG9wcHkgYW5kDQpwcmVzcyBhbnkga2V5IHRvIHRyeSBhZ2FpbiAuLi4gDQoAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAVar4////DwAAAAAAAAAA8P//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////D/j///8PAAAAAAAAAADw//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////8PY2lkYXRhICAgICAIAAAAAAAAAAAAAAAAAAAAAAAAAABBbQBlAHQAYQAtAA8A1GQAYQB0AGEAAAD//wAA/////01FVEEtRH4xICAgAACfjwzWWNZYAACPDNZYAgC3AAAAQXUAcwBlAHIALQAPALBkAGEAdABhAAAA//8AAP////9VU0VSLUR+MSAgIAAAn48M1ljWWAAAjwzWWAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAHsiaW5zdGFuY2UtaWQiOiJiMGYzZjY2NS04YTVmLTQyYjEtOGVjNS1iMjQ3ZmU1MWM5ZTEiLCJsb2NhbC1ob3N0bmFtZSI6ImxvY2Fsc2hhcmsiLCJwdWJsaWMta2V5cyI6WyJzc2gtZWQyNTUxOSBBQUFBQzNOemFDMWxaREkxTlRFNUFBQUFJTTZKQ3V5MzBkaGJWeEpVN1Y2RS9xV0RCSDdPOFNBVDVxRFZxQ3RqNWs5dyJdfQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA") } instance_id = b0f3f665-8a5f-42b1-8ec5-b247fe51c9e1 instance_runtime = InstanceRuntimeState { propolis_id: Some(b4528104-cd9b-4d9b-8296-611e54399af3 (propolis)), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-06-22T01:36:31.267461602Z } metadata = InstanceMetadata { silo_id: e7fbab99-3fa2-4faa-806a-c16e994c1617, project_id: 2e2f1d03-8a22-4082-90b6-e73df197fc1f } propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = b4528104-cd9b-4d9b-8296-611e54399af3 vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(1), time_updated: 2024-06-22T01:36:31.220477Z }
18292024-06-22T01:36:31.635ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:582 instance_id = b0f3f665-8a5f-42b1-8ec5-b247fe51c9e1 (instance)
18302024-06-22T01:36:31.635ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:942 instance_id = b0f3f665-8a5f-42b1-8ec5-b247fe51c9e1 propolis_id = b4528104-cd9b-4d9b-8296-611e54399af3 state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: b0f89a01-5cb0-49f0-8a94-fb24408ad7fb, kind: Instance { id: b0f3f665-8a5f-42b1-8ec5-b247fe51c9e1 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 247, 50, 189])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(7938441), primary: true, slot: 0 }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: b0f89a01-5cb0-49f0-8a94-fb24408ad7fb, kind: Instance { id: b0f3f665-8a5f-42b1-8ec5-b247fe51c9e1 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 247, 50, 189])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(7938441), primary: true, slot: 0 }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: b0f89a01-5cb0-49f0-8a94-fb24408ad7fb, kind: Instance { id: b0f3f665-8a5f-42b1-8ec5-b247fe51c9e1 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 247, 50, 189])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(7938441), primary: true, slot: 0 }], filter_hosts: Some([Vpc(Vni(7938441))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: b0f89a01-5cb0-49f0-8a94-fb24408ad7fb, kind: Instance { id: b0f3f665-8a5f-42b1-8ec5-b247fe51c9e1 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 247, 50, 189])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(7938441), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-d1a65230eba", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: c9c2e059-63c5-4444-9f4d-f2d3d8376400, read_only_parent: Some(Volume { block_size: 512, id: d2358467-e69f-44f9-834e-aca09fbab93a, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 92503368-6642-4564-9d97-9b35d502488b, key: Some("weCFeBQ4ryjkQCor8x5ij4T7aU2pdwzT9TcuRwp1GCk="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::18]:19001", "[fd00:1122:3344:101::17]:19001", "[fd00:1122:3344:101::16]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: c9c2e059-63c5-4444-9f4d-f2d3d8376400, key: Some("iXCwmnb+rDEL+edEH5N11WGd6faJ5aWq9KeUZQQf/s4="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::16]:19002", "[fd00:1122:3344:101::12]:19001", "[fd00:1122:3344:101::14]:19000"] } }] } }], cloud_init_bytes: Some("6zyQTVNXSU40LjEAAgEBAAIAAioA+AEAKgBAAAAAAAAAAAAAAAApeFY0EmNpZGF0YSAgICAgRkFUMTIgICAOH75bfKwiwHQLVrQOuwcAzRBe6/Ay5M0WzRnr/lRoaXMgaXMgbm90IGEgYm9vdGFibGUgZGlzay4gIFBsZWFzZSBpbnNlcnQgYSBib290YWJsZSBmbG9wcHkgYW5kDQpwcmVzcyBhbnkga2V5IHRvIHRyeSBhZ2FpbiAuLi4gDQoAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAVar4////DwAAAAAAAAAA8P//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////D/j///8PAAAAAAAAAADw//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////8PY2lkYXRhICAgICAIAAAAAAAAAAAAAAAAAAAAAAAAAABBbQBlAHQAYQAtAA8A1GQAYQB0AGEAAAD//wAA/////01FVEEtRH4xICAgAACfjwzWWNZYAACPDNZYAgC3AAAAQXUAcwBlAHIALQAPALBkAGEAdABhAAAA//8AAP////9VU0VSLUR+MSAgIAAAn48M1ljWWAAAjwzWWAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAHsiaW5zdGFuY2UtaWQiOiJiMGYzZjY2NS04YTVmLTQyYjEtOGVjNS1iMjQ3ZmU1MWM5ZTEiLCJsb2NhbC1ob3N0bmFtZSI6ImxvY2Fsc2hhcmsiLCJwdWJsaWMta2V5cyI6WyJzc2gtZWQyNTUxOSBBQUFBQzNOemFDMWxaREkxTlRFNUFBQUFJTTZKQ3V5MzBkaGJWeEpVN1Y2RS9xV0RCSDdPOFNBVDVxRFZxQ3RqNWs5dyJdfQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA") }, instance_runtime: InstanceRuntimeState { propolis_id: Some(b4528104-cd9b-4d9b-8296-611e54399af3 (propolis)), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-06-22T01:36:31.267461602Z }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(1), time_updated: 2024-06-22T01:36:31.220477Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400 }
18312024-06-22T01:36:31.635ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 6058 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59118 req_id = 133a58b1-5fb0-41ef-ad25-415605f4f3c4 response_code = 200 uri = /instances/b0f3f665-8a5f-42b1-8ec5-b247fe51c9e1
18322024-06-22T01:36:31.727ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51436
18332024-06-22T01:36:31.727ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 828 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51436 req_id = a03f2493-ae1d-4f61-b24f-a0df74a071e0 response_code = 200 uri = /instances/b0f3f665-8a5f-42b1-8ec5-b247fe51c9e1/state
18342024-06-22T01:36:31.752ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:393 port = Port { inner: PortInner { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 247, 50, 189]), slot: 0, vni: Vni { inner: 7938441 }, gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 }, vnic: "vopte6" } }
18352024-06-22T01:36:31.752ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
18362024-06-22T01:36:31.791ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_b4528104-cd9b-4d9b-8296-611e54399af3 file = illumos-utils/src/zone.rs:315 instance_id = b0f3f665-8a5f-42b1-8ec5-b247fe51c9e1
18372024-06-22T01:36:31.814ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_b4528104-cd9b-4d9b-8296-611e54399af3 file = illumos-utils/src/zone.rs:354 instance_id = b0f3f665-8a5f-42b1-8ec5-b247fe51c9e1
18382024-06-22T01:36:32.989ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_b4528104-cd9b-4d9b-8296-611e54399af3: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlInstance0"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::1:0"/> <propval type="astring" name="listen_port" value="12400"/> <propval type="astring" name="metric_addr" value="[fd00:1122:3344:101::b]:12221"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = b0f3f665-8a5f-42b1-8ec5-b247fe51c9e1
18392024-06-22T01:36:32.989ZINFOSledAgent (InstanceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 instance_id = b0f3f665-8a5f-42b1-8ec5-b247fe51c9e1 zone = oxz_propolis-server_b4528104-cd9b-4d9b-8296-611e54399af3
18402024-06-22T01:36:33.179ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_b4528104-cd9b-4d9b-8296-611e54399af3") failed: Property not found. retry in 72.92232ms file = illumos-utils/src/svc.rs:36 instance_id = b0f3f665-8a5f-42b1-8ec5-b247fe51c9e1 zone = oxz_propolis-server_b4528104-cd9b-4d9b-8296-611e54399af3
18412024-06-22T01:36:33.265ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_b4528104-cd9b-4d9b-8296-611e54399af3") failed: Property not found. retry in 66.773023ms file = illumos-utils/src/svc.rs:36 instance_id = b0f3f665-8a5f-42b1-8ec5-b247fe51c9e1 zone = oxz_propolis-server_b4528104-cd9b-4d9b-8296-611e54399af3
18422024-06-22T01:36:33.374ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_b4528104-cd9b-4d9b-8296-611e54399af3") failed: Property not found. retry in 288.274721ms file = illumos-utils/src/svc.rs:36 instance_id = b0f3f665-8a5f-42b1-8ec5-b247fe51c9e1 zone = oxz_propolis-server_b4528104-cd9b-4d9b-8296-611e54399af3
18432024-06-22T01:36:33.683ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_b4528104-cd9b-4d9b-8296-611e54399af3") failed: Property not found. retry in 209.136374ms file = illumos-utils/src/svc.rs:36 instance_id = b0f3f665-8a5f-42b1-8ec5-b247fe51c9e1 zone = oxz_propolis-server_b4528104-cd9b-4d9b-8296-611e54399af3
18442024-06-22T01:36:33.904ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_b4528104-cd9b-4d9b-8296-611e54399af3") failed: Property not found. retry in 656.348296ms file = illumos-utils/src/svc.rs:36 instance_id = b0f3f665-8a5f-42b1-8ec5-b247fe51c9e1 zone = oxz_propolis-server_b4528104-cd9b-4d9b-8296-611e54399af3
18452024-06-22T01:36:34.570ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_b4528104-cd9b-4d9b-8296-611e54399af3") failed: Property not found. retry in 711.768351ms file = illumos-utils/src/svc.rs:36 instance_id = b0f3f665-8a5f-42b1-8ec5-b247fe51c9e1 zone = oxz_propolis-server_b4528104-cd9b-4d9b-8296-611e54399af3
18462024-06-22T01:36:35.292ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_b4528104-cd9b-4d9b-8296-611e54399af3") failed: Property not found. retry in 642.230949ms file = illumos-utils/src/svc.rs:36 instance_id = b0f3f665-8a5f-42b1-8ec5-b247fe51c9e1 zone = oxz_propolis-server_b4528104-cd9b-4d9b-8296-611e54399af3
18472024-06-22T01:36:35.945ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_b4528104-cd9b-4d9b-8296-611e54399af3") failed: Property not found. retry in 1.05539137s file = illumos-utils/src/svc.rs:36 instance_id = b0f3f665-8a5f-42b1-8ec5-b247fe51c9e1 zone = oxz_propolis-server_b4528104-cd9b-4d9b-8296-611e54399af3
18482024-06-22T01:36:37.010ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_b4528104-cd9b-4d9b-8296-611e54399af3") failed: Property not found. retry in 874.661224ms file = illumos-utils/src/svc.rs:36 instance_id = b0f3f665-8a5f-42b1-8ec5-b247fe51c9e1 zone = oxz_propolis-server_b4528104-cd9b-4d9b-8296-611e54399af3
18492024-06-22T01:36:37.912ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_b4528104-cd9b-4d9b-8296-611e54399af3 file = sled-agent/src/instance.rs:1427 instance_id = b0f3f665-8a5f-42b1-8ec5-b247fe51c9e1
18502024-06-22T01:36:37.920ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_b4528104-cd9b-4d9b-8296-611e54399af3") failed: Property not found. retry in 62.559149ms file = illumos-utils/src/svc.rs:36 instance_id = b0f3f665-8a5f-42b1-8ec5-b247fe51c9e1
18512024-06-22T01:36:37.993ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_b4528104-cd9b-4d9b-8296-611e54399af3") failed: Property not found. retry in 64.669175ms file = illumos-utils/src/svc.rs:36 instance_id = b0f3f665-8a5f-42b1-8ec5-b247fe51c9e1
18522024-06-22T01:36:38.068ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_b4528104-cd9b-4d9b-8296-611e54399af3") failed: Property not found. retry in 262.946013ms file = illumos-utils/src/svc.rs:36 instance_id = b0f3f665-8a5f-42b1-8ec5-b247fe51c9e1
18532024-06-22T01:36:38.342ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_b4528104-cd9b-4d9b-8296-611e54399af3") failed: Property not found. retry in 484.721916ms file = illumos-utils/src/svc.rs:36 instance_id = b0f3f665-8a5f-42b1-8ec5-b247fe51c9e1
18542024-06-22T01:36:38.839ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:1436 instance_id = b0f3f665-8a5f-42b1-8ec5-b247fe51c9e1
18552024-06-22T01:36:38.875ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:1450 instance_id = b0f3f665-8a5f-42b1-8ec5-b247fe51c9e1
18562024-06-22T01:36:38.877ZINFOSledAgent (InstanceManager): Sending ensure request to propolis: InstanceEnsureRequest { cloud_init_bytes: Some("6zyQTVNXSU40LjEAAgEBAAIAAioA+AEAKgBAAAAAAAAAAAAAAAApeFY0EmNpZGF0YSAgICAgRkFUMTIgICAOH75bfKwiwHQLVrQOuwcAzRBe6/Ay5M0WzRnr/lRoaXMgaXMgbm90IGEgYm9vdGFibGUgZGlzay4gIFBsZWFzZSBpbnNlcnQgYSBib290YWJsZSBmbG9wcHkgYW5kDQpwcmVzcyBhbnkga2V5IHRvIHRyeSBhZ2FpbiAuLi4gDQoAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAVar4////DwAAAAAAAAAA8P//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////D/j///8PAAAAAAAAAADw//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////8PY2lkYXRhICAgICAIAAAAAAAAAAAAAAAAAAAAAAAAAABBbQBlAHQAYQAtAA8A1GQAYQB0AGEAAAD//wAA/////01FVEEtRH4xICAgAACfjwzWWNZYAACPDNZYAgC3AAAAQXUAcwBlAHIALQAPALBkAGEAdABhAAAA//8AAP////9VU0VSLUR+MSAgIAAAn48M1ljWWAAAjwzWWAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAHsiaW5zdGFuY2UtaWQiOiJiMGYzZjY2NS04YTVmLTQyYjEtOGVjNS1iMjQ3ZmU1MWM5ZTEiLCJsb2NhbC1ob3N0bmFtZSI6ImxvY2Fsc2hhcmsiLCJwdWJsaWMta2V5cyI6WyJzc2gtZWQyNTUxOSBBQUFBQzNOemFDMWxaREkxTlRFNUFBQUFJTTZKQ3V5MzBkaGJWeEpVN1Y2RS9xV0RCSDdPOFNBVDVxRFZxQ3RqNWs5dyJdfQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA"), disks: [DiskRequest { device: "nvme", name: "disk-d1a65230eba", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: c9c2e059-63c5-4444-9f4d-f2d3d8376400, read_only_parent: Some(Volume { block_size: 512, id: d2358467-e69f-44f9-834e-aca09fbab93a, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 92503368-6642-4564-9d97-9b35d502488b, key: Some("weCFeBQ4ryjkQCor8x5ij4T7aU2pdwzT9TcuRwp1GCk="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::18]:19001", "[fd00:1122:3344:101::17]:19001", "[fd00:1122:3344:101::16]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: c9c2e059-63c5-4444-9f4d-f2d3d8376400, key: Some("iXCwmnb+rDEL+edEH5N11WGd6faJ5aWq9KeUZQQf/s4="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::16]:19002", "[fd00:1122:3344:101::12]:19001", "[fd00:1122:3344:101::14]:19000"] } }] } }], migrate: None, nics: [NetworkInterfaceRequest { name: "vopte6", slot: Slot(0) }], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Test description", id: b0f3f665-8a5f-42b1-8ec5-b247fe51c9e1, image_id: 00000000-0000-0000-0000-000000000000, memory: 1024, metadata: InstanceMetadata { project_id: 2e2f1d03-8a22-4082-90b6-e73df197fc1f, silo_id: e7fbab99-3fa2-4faa-806a-c16e994c1617 }, name: "localshark", vcpus: 2 } } file = sled-agent/src/instance.rs:689 instance_id = b0f3f665-8a5f-42b1-8ec5-b247fe51c9e1
18572024-06-22T01:36:38.990ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:691 instance_id = b0f3f665-8a5f-42b1-8ec5-b247fe51c9e1
18582024-06-22T01:36:38.991ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Starting), migration_status: NoMigration, time: 2024-06-22T01:36:38.991265504Z } file = sled-agent/src/instance.rs:573 instance_id = b0f3f665-8a5f-42b1-8ec5-b247fe51c9e1
18592024-06-22T01:36:38.991ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:595 instance_id = b0f3f665-8a5f-42b1-8ec5-b247fe51c9e1 new_instance_state = InstanceRuntimeState { propolis_id: Some(b4528104-cd9b-4d9b-8296-611e54399af3 (propolis)), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-06-22T01:36:31.267461602Z } new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-06-22T01:36:38.991265504Z } propolis_id = b4528104-cd9b-4d9b-8296-611e54399af3
18602024-06-22T01:36:38.991ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:492 instance_id = b0f3f665-8a5f-42b1-8ec5-b247fe51c9e1 state = SledInstanceState { instance_state: InstanceRuntimeState { propolis_id: Some(b4528104-cd9b-4d9b-8296-611e54399af3 (propolis)), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-06-22T01:36:31.267461602Z }, propolis_id: b4528104-cd9b-4d9b-8296-611e54399af3 (propolis), vmm_state: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-06-22T01:36:38.991265504Z }, migration_state: None }
18612024-06-22T01:36:39.068ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_status: NoMigration, time: 2024-06-22T01:36:39.068296473Z } file = sled-agent/src/instance.rs:573 instance_id = b0f3f665-8a5f-42b1-8ec5-b247fe51c9e1
18622024-06-22T01:36:39.068ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:595 instance_id = b0f3f665-8a5f-42b1-8ec5-b247fe51c9e1 new_instance_state = InstanceRuntimeState { propolis_id: Some(b4528104-cd9b-4d9b-8296-611e54399af3 (propolis)), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-06-22T01:36:31.267461602Z } new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(3), time_updated: 2024-06-22T01:36:39.068296473Z } propolis_id = b4528104-cd9b-4d9b-8296-611e54399af3
18632024-06-22T01:36:39.068ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:492 instance_id = b0f3f665-8a5f-42b1-8ec5-b247fe51c9e1 state = SledInstanceState { instance_state: InstanceRuntimeState { propolis_id: Some(b4528104-cd9b-4d9b-8296-611e54399af3 (propolis)), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-06-22T01:36:31.267461602Z }, propolis_id: b4528104-cd9b-4d9b-8296-611e54399af3 (propolis), vmm_state: VmmRuntimeState { state: Running, gen: Generation(3), time_updated: 2024-06-22T01:36:39.068296473Z }, migration_state: None }
18642024-06-22T01:36:42.957ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1271 local_addr = [fd00:1122:3344:101::1]:65146 method = GET remote_addr = [fd00:1122:3344:101::d]:61009 req_id = 9c46adaa-4104-4427-83e0-8e63efac1123 response_code = 200 sled_id = 9f7cbf52-de0d-48c8-9e7d-2958552743a4 uri = /9f7cbf52-de0d-48c8-9e7d-2958552743a4
18652024-06-22T01:36:47.739ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:36889
18662024-06-22T01:36:47.739ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 154 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:36889 req_id = 542cba4b-1f21-4cd1-9909-770a0f397628 response_code = 200 uri = /baseboard
18672024-06-22T01:36:48.903ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50297
18682024-06-22T01:36:48.904ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 596 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50297 req_id = c15382eb-d609-4899-9f14-ecfbd6cdba06 response_code = 200 uri = /instances/b0f3f665-8a5f-42b1-8ec5-b247fe51c9e1/state
18692024-06-22T01:36:48.904ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_status: NoMigration, time: 2024-06-22T01:36:48.904638058Z } file = sled-agent/src/instance.rs:573 instance_id = b0f3f665-8a5f-42b1-8ec5-b247fe51c9e1
18702024-06-22T01:36:48.904ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:595 instance_id = b0f3f665-8a5f-42b1-8ec5-b247fe51c9e1 new_instance_state = InstanceRuntimeState { propolis_id: Some(b4528104-cd9b-4d9b-8296-611e54399af3 (propolis)), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-06-22T01:36:31.267461602Z } new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(5), time_updated: 2024-06-22T01:36:48.904638058Z } propolis_id = b4528104-cd9b-4d9b-8296-611e54399af3
18712024-06-22T01:36:48.904ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:492 instance_id = b0f3f665-8a5f-42b1-8ec5-b247fe51c9e1 state = SledInstanceState { instance_state: InstanceRuntimeState { propolis_id: Some(b4528104-cd9b-4d9b-8296-611e54399af3 (propolis)), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-06-22T01:36:31.267461602Z }, propolis_id: b4528104-cd9b-4d9b-8296-611e54399af3 (propolis), vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(5), time_updated: 2024-06-22T01:36:48.904638058Z }, migration_state: None }
18722024-06-22T01:36:48.924ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_status: NoMigration, time: 2024-06-22T01:36:48.924047679Z } file = sled-agent/src/instance.rs:573 instance_id = b0f3f665-8a5f-42b1-8ec5-b247fe51c9e1
18732024-06-22T01:36:48.924ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:595 instance_id = b0f3f665-8a5f-42b1-8ec5-b247fe51c9e1 new_instance_state = InstanceRuntimeState { propolis_id: None, dst_propolis_id: None, migration_id: None, gen: Generation(5), time_updated: 2024-06-22T01:36:48.924047679Z } new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(6), time_updated: 2024-06-22T01:36:48.924047679Z } propolis_id = b4528104-cd9b-4d9b-8296-611e54399af3
18742024-06-22T01:36:48.924ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:610 instance_id = b0f3f665-8a5f-42b1-8ec5-b247fe51c9e1
18752024-06-22T01:36:48.924ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
18762024-06-22T01:36:48.925ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
18772024-06-22T01:36:48.925ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/3e31f9bf-741c-4ad6-aa69-e523a333a2d2/debug/bundle/zone", "/pool/int/9b2f2513-2520-480a-aa3a-397437db476d/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/fd49fe38-f2ec-424b-a36d-fe54014bb3a5/crypt/debug", "/pool/ext/c9d3163d-8113-4008-b362-43292ae5be54/crypt/debug", "/pool/ext/8c04dded-f22c-49d5-9c59-b5b4be2cf536/crypt/debug", "/pool/ext/a9e6c25d-f1e0-4d21-b66f-63e2ac90bcb3/crypt/debug", "/pool/ext/b14a31e4-ac90-49a4-967f-505e8d513a31/crypt/debug", "/pool/ext/12d1cb28-982b-440a-a40d-fd94d1ea8903/crypt/debug", "/pool/ext/f6ed7191-8358-44ad-bdc5-56e8c623c8b8/crypt/debug", "/pool/ext/870c10b7-1cc9-4791-bad3-d7dbfc885d9d/crypt/debug", "/pool/ext/4deb6b88-4ed5-4c48-8332-5170c17d8ee2/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:437 zone_name = oxz_propolis-server_b4528104-cd9b-4d9b-8296-611e54399af3
18782024-06-22T01:36:49.561ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1230 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_b4528104-cd9b-4d9b-8296-611e54399af3", bundle_id: b7f4cad8-f654-4211-be70-6aabc63efa81 }, time_created: 2024-06-22T01:36:48.925786531Z, version: 0, cause: TerminatedInstance }
18792024-06-22T01:36:49.561ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_b4528104-cd9b-4d9b-8296-611e54399af3 file = sled-agent/src/instance.rs:784 instance_id = b0f3f665-8a5f-42b1-8ec5-b247fe51c9e1
18802024-06-22T01:36:51.306ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:269 instance_id = b0f3f665-8a5f-42b1-8ec5-b247fe51c9e1
18812024-06-22T01:36:51.334ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:492 instance_id = b0f3f665-8a5f-42b1-8ec5-b247fe51c9e1 state = SledInstanceState { instance_state: InstanceRuntimeState { propolis_id: None, dst_propolis_id: None, migration_id: None, gen: Generation(5), time_updated: 2024-06-22T01:36:48.924047679Z }, propolis_id: b4528104-cd9b-4d9b-8296-611e54399af3 (propolis), vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-06-22T01:36:51.334387802Z }, migration_state: None }
18822024-06-22T01:36:51.430ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50917
18832024-06-22T01:36:51.431ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 300 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50917 req_id = e51de300-e81d-4ef2-9460-7e3741a7ceec response_code = 200 uri = /v2p
18842024-06-22T01:36:51.431ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:631 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 247, 50, 189])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(7938441) }
18852024-06-22T01:36:51.431ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50917 req_id = 9ddc068f-0449-47f2-a552-a355088b45dc response_code = 204 uri = /v2p
18862024-06-22T01:36:51.617ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:492 instance_id = b0f3f665-8a5f-42b1-8ec5-b247fe51c9e1 state = SledInstanceState { instance_state: InstanceRuntimeState { propolis_id: None, dst_propolis_id: None, migration_id: None, gen: Generation(5), time_updated: 2024-06-22T01:36:48.924047679Z }, propolis_id: b4528104-cd9b-4d9b-8296-611e54399af3 (propolis), vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-06-22T01:36:51.334387802Z }, migration_state: None }
18872024-06-22T01:36:51.621ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:727 instance_id = b0f3f665-8a5f-42b1-8ec5-b247fe51c9e1
18882024-06-22T01:36:51.835ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64667
18892024-06-22T01:36:51.835ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64667 req_id = 3707d57c-c977-4909-a5d8-ae01d0ba1df8 response_code = 200 uri = /v2p
18902024-06-22T01:36:51.835ZINFOSledAgent (PortManager): Clearing mapping of virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:671 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 247, 50, 189])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(7938441) }
18912024-06-22T01:36:51.835ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:64667 req_id = aa15e800-39c7-40f9-b0dc-0e1fd6aacdf0 response_code = 204 uri = /v2p