Max level shown:
1 [ May 10 21:20:24 Enabled. ]
2 [ May 10 21:20:24 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ May 10 21:20:24 Method "start" exited with status 0. ]
4 [ May 10 21:20:24 Rereading configuration. ]
5 [ May 10 21:20:24 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72024-05-10T21:20:24.147ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:163
82024-05-10T21:20:24.147ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92024-05-10T21:20:24.201ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102024-05-10T21:20:24.201ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112024-05-10T21:20:24.316ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122024-05-10T21:20:24.326ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132024-05-10T21:20:24.333ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142024-05-10T21:20:24.934ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:87 prefix = Ipv6Prefix { addr: fdb0:18c0:4d0d:a02a::, len: 64 }
152024-05-10T21:20:25.070ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:119
162024-05-10T21:20:25.070ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:131
172024-05-10T21:20:25.070ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:141
182024-05-10T21:20:25.070ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:162 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192024-05-10T21:20:25.070ZINFOSledAgent (DumpSetup-archival): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:291
202024-05-10T21:20:25.070ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:625
212024-05-10T21:20:25.071ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:801
222024-05-10T21:20:25.074ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "sock", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:535
232024-05-10T21:20:25.074ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:674
242024-05-10T21:20:25.074ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:176
252024-05-10T21:20:25.074ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:733
262024-05-10T21:20:25.074ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/m2_0.vdev
272024-05-10T21:20:25.074ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:262 underlay_network_info = None
282024-05-10T21:20:25.074ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" }, variant: M2, slot: 1024 }), tx: ... } file = sled-storage/src/manager.rs:381
292024-05-10T21:20:25.074ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" }
302024-05-10T21:20:25.074ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:112 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" } path = /scratch/m2_0.vdev
312024-05-10T21:20:25.086ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:304
322024-05-10T21:20:25.086ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:315 id = 6742bbd6-6bec-4f6b-94f3-002a53fc9f01 (zpool)
332024-05-10T21:20:25.213ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: 6742bbd6-6bec-4f6b-94f3-002a53fc9f01 (zpool), kind: Internal }
342024-05-10T21:20:25.453ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:381
352024-05-10T21:20:25.453ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/m2_1.vdev
362024-05-10T21:20:25.453ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" }
372024-05-10T21:20:25.453ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" }
382024-05-10T21:20:25.453ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-M2" }, variant: M2, slot: 1025 }), tx: ... } file = sled-storage/src/manager.rs:381
392024-05-10T21:20:25.453ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-M2" }
402024-05-10T21:20:25.453ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:112 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-M2" } path = /scratch/m2_1.vdev
412024-05-10T21:20:25.462ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:304
422024-05-10T21:20:25.462ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:315 id = 8becec77-7597-498a-9704-3ae75204e470 (zpool)
432024-05-10T21:20:25.577ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-M2" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: 8becec77-7597-498a-9704-3ae75204e470 (zpool), kind: Internal }
442024-05-10T21:20:25.808ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_0.vdev
452024-05-10T21:20:25.808ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 6742bbd6-6bec-4f6b-94f3-002a53fc9f01 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-M2" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-M2" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: 8becec77-7597-498a-9704-3ae75204e470 (zpool), kind: Internal } }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
462024-05-10T21:20:25.808ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" }, variant: U2, slot: 1026 }), tx: ... } file = sled-storage/src/manager.rs:381
472024-05-10T21:20:25.808ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" }
482024-05-10T21:20:25.808ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_1.vdev
492024-05-10T21:20:25.808ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" }, variant: U2, slot: 1027 }), tx: ... } file = sled-storage/src/manager.rs:381
502024-05-10T21:20:25.808ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" }
512024-05-10T21:20:25.808ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 6742bbd6-6bec-4f6b-94f3-002a53fc9f01 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" }, variant: U2, slot: 1026 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-M2" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-M2" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: 8becec77-7597-498a-9704-3ae75204e470 (zpool), kind: Internal } }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
522024-05-10T21:20:25.808ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_2.vdev
532024-05-10T21:20:25.808ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" }, variant: U2, slot: 1028 }), tx: ... } file = sled-storage/src/manager.rs:381
542024-05-10T21:20:25.808ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" }
552024-05-10T21:20:25.809ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 6742bbd6-6bec-4f6b-94f3-002a53fc9f01 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" }, variant: U2, slot: 1026 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-M2" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-M2" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: 8becec77-7597-498a-9704-3ae75204e470 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" }, variant: U2, slot: 1027 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
562024-05-10T21:20:25.809ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_3.vdev
572024-05-10T21:20:25.809ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" }, variant: U2, slot: 1029 }), tx: ... } file = sled-storage/src/manager.rs:381
582024-05-10T21:20:25.809ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 6742bbd6-6bec-4f6b-94f3-002a53fc9f01 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" }, variant: U2, slot: 1026 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-M2" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-M2" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: 8becec77-7597-498a-9704-3ae75204e470 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" }, variant: U2, slot: 1027 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" }, variant: U2, slot: 1028 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
592024-05-10T21:20:25.809ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" }
602024-05-10T21:20:25.809ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_4.vdev
612024-05-10T21:20:25.809ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2" }, variant: U2, slot: 1030 }), tx: ... } file = sled-storage/src/manager.rs:381
622024-05-10T21:20:25.809ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2" }
632024-05-10T21:20:25.809ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 6742bbd6-6bec-4f6b-94f3-002a53fc9f01 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" }, variant: U2, slot: 1026 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-M2" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-M2" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: 8becec77-7597-498a-9704-3ae75204e470 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" }, variant: U2, slot: 1027 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" }, variant: U2, slot: 1028 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" }, variant: U2, slot: 1029 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
642024-05-10T21:20:25.809ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_5.vdev
652024-05-10T21:20:25.809ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2" }, variant: U2, slot: 1031 }), tx: ... } file = sled-storage/src/manager.rs:381
662024-05-10T21:20:25.809ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2" }
672024-05-10T21:20:25.809ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 6742bbd6-6bec-4f6b-94f3-002a53fc9f01 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" }, variant: U2, slot: 1026 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-M2" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-M2" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: 8becec77-7597-498a-9704-3ae75204e470 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" }, variant: U2, slot: 1027 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" }, variant: U2, slot: 1028 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" }, variant: U2, slot: 1029 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2" }, variant: U2, slot: 1030 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
682024-05-10T21:20:25.809ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_6.vdev
692024-05-10T21:20:25.809ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-6", model: "synthetic-model-U2" }, variant: U2, slot: 1032 }), tx: ... } file = sled-storage/src/manager.rs:381
702024-05-10T21:20:25.809ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-6", model: "synthetic-model-U2" }
712024-05-10T21:20:25.809ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 6742bbd6-6bec-4f6b-94f3-002a53fc9f01 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" }, variant: U2, slot: 1026 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-M2" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-M2" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: 8becec77-7597-498a-9704-3ae75204e470 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" }, variant: U2, slot: 1027 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" }, variant: U2, slot: 1028 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" }, variant: U2, slot: 1029 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2" }, variant: U2, slot: 1030 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2" }, variant: U2, slot: 1031 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
722024-05-10T21:20:25.809ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_7.vdev
732024-05-10T21:20:25.809ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-7", model: "synthetic-model-U2" }, variant: U2, slot: 1033 }), tx: ... } file = sled-storage/src/manager.rs:381
742024-05-10T21:20:25.809ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-7", model: "synthetic-model-U2" }
752024-05-10T21:20:25.809ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 6742bbd6-6bec-4f6b-94f3-002a53fc9f01 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" }, variant: U2, slot: 1026 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-M2" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-M2" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: 8becec77-7597-498a-9704-3ae75204e470 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" }, variant: U2, slot: 1027 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" }, variant: U2, slot: 1028 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" }, variant: U2, slot: 1029 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2" }, variant: U2, slot: 1030 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2" }, variant: U2, slot: 1031 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-6", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-6", model: "synthetic-model-U2" }, variant: U2, slot: 1032 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
762024-05-10T21:20:25.809ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_8.vdev
772024-05-10T21:20:25.809ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-8", model: "synthetic-model-U2" }, variant: U2, slot: 1034 }), tx: ... } file = sled-storage/src/manager.rs:381
782024-05-10T21:20:25.809ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-8", model: "synthetic-model-U2" }
792024-05-10T21:20:25.809ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:91
802024-05-10T21:20:25.809ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 6742bbd6-6bec-4f6b-94f3-002a53fc9f01 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" }, variant: U2, slot: 1026 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-M2" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-M2" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: 8becec77-7597-498a-9704-3ae75204e470 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" }, variant: U2, slot: 1027 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" }, variant: U2, slot: 1028 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" }, variant: U2, slot: 1029 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2" }, variant: U2, slot: 1030 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2" }, variant: U2, slot: 1031 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-6", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-6", model: "synthetic-model-U2" }, variant: U2, slot: 1032 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-7", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-7", model: "synthetic-model-U2" }, variant: U2, slot: 1033 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
812024-05-10T21:20:25.809ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" } file = sled-agent/src/long_running_tasks.rs:93
822024-05-10T21:20:25.809ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
832024-05-10T21:20:25.809ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 6742bbd6-6bec-4f6b-94f3-002a53fc9f01 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" }, variant: U2, slot: 1026 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-M2" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-M2" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: 8becec77-7597-498a-9704-3ae75204e470 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" }, variant: U2, slot: 1027 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" }, variant: U2, slot: 1028 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" }, variant: U2, slot: 1029 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2" }, variant: U2, slot: 1030 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2" }, variant: U2, slot: 1031 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-6", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-6", model: "synthetic-model-U2" }, variant: U2, slot: 1032 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-7", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-7", model: "synthetic-model-U2" }, variant: U2, slot: 1033 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-8", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-8", model: "synthetic-model-U2" }, variant: U2, slot: 1034 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
842024-05-10T21:20:25.809ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:200
852024-05-10T21:20:25.809ZINFOSledAgent (bootstore): No ledger in /pool/int/6742bbd6-6bec-4f6b-94f3-002a53fc9f01/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
862024-05-10T21:20:25.809ZINFOSledAgent (bootstore): No ledger in /pool/int/8becec77-7597-498a-9704-3ae75204e470/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
872024-05-10T21:20:25.809ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-sock-i86pc
882024-05-10T21:20:25.809ZINFOSledAgent (bootstore): No ledger in /pool/int/6742bbd6-6bec-4f6b-94f3-002a53fc9f01/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
892024-05-10T21:20:25.809ZINFOSledAgent (bootstore): No ledger in /pool/int/8becec77-7597-498a-9704-3ae75204e470/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
902024-05-10T21:20:25.809ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-sock-i86pc
912024-05-10T21:20:25.809ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:205
922024-05-10T21:20:25.809ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:220
932024-05-10T21:20:25.819ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:711
942024-05-10T21:20:25.819ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:289 next_cleanup = Instant { tv_sec: 1717, tv_nsec: 58447458 } time_to_next_cleanup = 599.999933288s
952024-05-10T21:20:25.819ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3617
962024-05-10T21:20:25.819ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
972024-05-10T21:20:25.822ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/6742bbd6-6bec-4f6b-94f3-002a53fc9f01/config/sled-agent-request.json file = common/src/ledger.rs:188
982024-05-10T21:20:25.822ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/8becec77-7597-498a-9704-3ae75204e470/config/sled-agent-request.json file = common/src/ledger.rs:188
992024-05-10T21:20:25.822ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:195 local_addr = [fdb0:18c0:4d0d:a02a::1]:80
1002024-05-10T21:20:25.822ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:44 local_addr = [fdb0:18c0:4d0d:a02a::1]:12346
1012024-05-10T21:20:25.822ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.2.164, last: 10.151.2.173, }, ), ], external_dns_ips: [ 10.151.2.164, 10.151.2.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV1 { rack_subnet: Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56, }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV1 { routes: [ RouteConfig { destination: V4( Ipv4Network { addr: 0.0.0.0, prefix: 0, }, ), nexthop: 10.151.2.100, vlan_id: None, }, ], addresses: [ V4( Ipv4Network { addr: 10.151.2.174, prefix: 24, }, ), ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: None, bgp_peers: [], autoneg: false, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1002
1022024-05-10T21:20:25.822ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:60
1032024-05-10T21:20:25.823ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
1042024-05-10T21:20:25.823ZINFOSledAgent (RSS): No ledger in /pool/int/6742bbd6-6bec-4f6b-94f3-002a53fc9f01/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1052024-05-10T21:20:25.823ZINFOSledAgent (RSS): No ledger in /pool/int/8becec77-7597-498a-9704-3ae75204e470/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1062024-05-10T21:20:25.823ZINFOSledAgent (RSS): RSS configuration has not been fully applied yet file = sled-agent/src/rack_setup/service.rs:1062
1072024-05-10T21:20:25.823ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
1082024-05-10T21:20:25.823ZINFOSledAgent (RSS): No ledger in /pool/int/6742bbd6-6bec-4f6b-94f3-002a53fc9f01/config/rss-sled-plan.json file = common/src/ledger.rs:188
1092024-05-10T21:20:25.823ZINFOSledAgent (RSS): No ledger in /pool/int/8becec77-7597-498a-9704-3ae75204e470/config/rss-sled-plan.json file = common/src/ledger.rs:188
1102024-05-10T21:20:25.823ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1103
1112024-05-10T21:20:25.823ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:118
1122024-05-10T21:20:25.823ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:a02a::1 file = sled-agent/src/rack_setup/plan/sled.rs:91
1132024-05-10T21:20:25.823ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
1142024-05-10T21:20:25.823ZINFOSledAgent (RSS): Writing ledger to /pool/int/6742bbd6-6bec-4f6b-94f3-002a53fc9f01/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:199
1152024-05-10T21:20:25.823ZINFOSledAgent (RSS): Writing ledger to /pool/int/8becec77-7597-498a-9704-3ae75204e470/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:199
1162024-05-10T21:20:25.823ZINFOSledAgent (RSS): Sled plan written to storage file = sled-agent/src/rack_setup/plan/sled.rs:138
1172024-05-10T21:20:25.823ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1136
1182024-05-10T21:20:25.823ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
1192024-05-10T21:20:25.823ZINFOSledAgent (bootstore): Writing ledger to /pool/int/6742bbd6-6bec-4f6b-94f3-002a53fc9f01/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1202024-05-10T21:20:25.823ZINFOSledAgent (bootstore): Writing ledger to /pool/int/8becec77-7597-498a-9704-3ae75204e470/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1212024-05-10T21:20:25.824ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
1222024-05-10T21:20:25.824ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:217 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 3ae06dcf-597c-4d18-b2d7-37c1f02096d7, rack_id: 58769e48-4e3f-40ad-a95a-fd916e51fe8a, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net(Ipv6Network { addr: fd00:1122:3344:101::, prefix: 64 }) } } } target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
1232024-05-10T21:20:25.824ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:66 remote_addr = [fdb0:18c0:4d0d:a02a::1]:34104
1242024-05-10T21:20:25.824ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 3ae06dcf-597c-4d18-b2d7-37c1f02096d7, rack_id: 58769e48-4e3f-40ad-a95a-fd916e51fe8a, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net(Ipv6Network { addr: fd00:1122:3344:101::, prefix: 64 }) } } } file = sled-agent/src/bootstrap/server.rs:360
1252024-05-10T21:20:25.824ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:375
1262024-05-10T21:20:25.824ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1272024-05-10T21:20:25.824ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:381
1282024-05-10T21:20:25.824ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:530
1292024-05-10T21:20:25.824ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:60
1302024-05-10T21:20:25.824ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:87 prefix = Ipv6Prefix { addr: fd00:1122:3344:101::, len: 64 }
1312024-05-10T21:20:25.824ZINFOSledAgent (StorageManager): No ledger in /pool/int/6742bbd6-6bec-4f6b-94f3-002a53fc9f01/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_ledger
1322024-05-10T21:20:25.824ZINFOSledAgent (StorageManager): No ledger in /pool/int/8becec77-7597-498a-9704-3ae75204e470/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_ledger
1332024-05-10T21:20:25.824ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:519
1342024-05-10T21:20:25.824ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:547
1352024-05-10T21:20:25.827ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:3849
1362024-05-10T21:20:25.834ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" }
1372024-05-10T21:20:25.844ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" }
1382024-05-10T21:20:25.853ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" }
1392024-05-10T21:20:25.863ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" }
1402024-05-10T21:20:25.871ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2" }
1412024-05-10T21:20:25.880ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2" }
1422024-05-10T21:20:25.888ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-6", model: "synthetic-model-U2" }
1432024-05-10T21:20:25.895ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:355 sled_id = 3ae06dcf-597c-4d18-b2d7-37c1f02096d7
1442024-05-10T21:20:25.895ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:164
1452024-05-10T21:20:25.896ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 87.666431ms DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "fb25e027-70c1-41f6-b1e1-667c768606c6", "content-length": "124", "date": "Fri, 10 May 2024 21:20:24 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "fb25e027-70c1-41f6-b1e1-667c768606c6" } file = clients/ddm-admin-client/src/lib.rs:178
1462024-05-10T21:20:25.897ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-7", model: "synthetic-model-U2" }
1472024-05-10T21:20:25.905ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-8", model: "synthetic-model-U2" }
1482024-05-10T21:20:25.905ZINFOSledAgent (StorageManager): No disks to be automatically managed file = sled-storage/src/manager.rs:558
1492024-05-10T21:20:25.905ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:370
1502024-05-10T21:20:25.905ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:339
1512024-05-10T21:20:25.905ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:449 result = DisksManagementResult { status: [] }
1522024-05-10T21:20:25.905ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
1532024-05-10T21:20:25.905ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
1542024-05-10T21:20:25.905ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:367 sled_id = 3ae06dcf-597c-4d18-b2d7-37c1f02096d7
1552024-05-10T21:20:25.917ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_6742bbd6-6bec-4f6b-94f3-002a53fc9f01/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1562024-05-10T21:20:25.929ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:315
1572024-05-10T21:20:25.945ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:354
1582024-05-10T21:20:25.947ZINFOSledAgent: successfully created encrypted zvol: name="oxi_6742bbd6-6bec-4f6b-94f3-002a53fc9f01/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1592024-05-10T21:20:25.947ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_6742bbd6-6bec-4f6b-94f3-002a53fc9f01/swap" file = sled-agent/src/swap_device.rs:96
1602024-05-10T21:20:25.952ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:382 sled_id = 3ae06dcf-597c-4d18-b2d7-37c1f02096d7
1612024-05-10T21:20:25.952ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:126
1622024-05-10T21:20:25.952ZINFOSledAgent (BackingFs): Ensuring dataset oxi_6742bbd6-6bec-4f6b-94f3-002a53fc9f01/backing/fmd file = sled-agent/src/backing_fs.rs:136
1632024-05-10T21:20:25.985ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:164
1642024-05-10T21:20:25.987ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 169.843356ms DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "0780c5b1-3d8e-49aa-a8d8-158e3c7ac967", "content-length": "124", "date": "Fri, 10 May 2024 21:20:25 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "0780c5b1-3d8e-49aa-a8d8-158e3c7ac967" } file = clients/ddm-admin-client/src/lib.rs:178
1652024-05-10T21:20:26.030ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:170
1662024-05-10T21:20:26.158ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:164
1672024-05-10T21:20:26.158ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 164.354476ms DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "f9008f53-9284-48b2-996d-e396525b8652", "content-length": "124", "date": "Fri, 10 May 2024 21:20:25 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "f9008f53-9284-48b2-996d-e396525b8652" } file = clients/ddm-admin-client/src/lib.rs:178
1682024-05-10T21:20:26.248ZINFOSledAgent (BackingFs): Mounting oxi_6742bbd6-6bec-4f6b-94f3-002a53fc9f01/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:178
1692024-05-10T21:20:26.262ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:186
1702024-05-10T21:20:26.262ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:186
1712024-05-10T21:20:26.262ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:186
1722024-05-10T21:20:26.262ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:192
1732024-05-10T21:20:26.324ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:164
1742024-05-10T21:20:26.325ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 89.769284ms DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "c0fd820c-5fa6-4698-89ad-e9217ba28da7", "content-length": "124", "date": "Fri, 10 May 2024 21:20:25 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "c0fd820c-5fa6-4698-89ad-e9217ba28da7" } file = clients/ddm-admin-client/src/lib.rs:178
1752024-05-10T21:20:26.416ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:164
1762024-05-10T21:20:26.417ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 137.545333ms DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "d8a3e80a-6b19-4538-9567-983d5e1b1089", "content-length": "124", "date": "Fri, 10 May 2024 21:20:25 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "d8a3e80a-6b19-4538-9567-983d5e1b1089" } file = clients/ddm-admin-client/src/lib.rs:178
1772024-05-10T21:20:26.556ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:164
1782024-05-10T21:20:26.556ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 214.843119ms DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "66938b97-cef6-4e73-954b-7db92ec29e98", "content-length": "124", "date": "Fri, 10 May 2024 21:20:25 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "66938b97-cef6-4e73-954b-7db92ec29e98" } file = clients/ddm-admin-client/src/lib.rs:178
1792024-05-10T21:20:26.772ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:164
1802024-05-10T21:20:26.773ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 425.563319ms DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "85ebdf9c-ed20-4eb6-beb2-e6fb40ceadc9", "content-length": "124", "date": "Fri, 10 May 2024 21:20:25 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "85ebdf9c-ed20-4eb6-beb2-e6fb40ceadc9" } file = clients/ddm-admin-client/src/lib.rs:178
1812024-05-10T21:20:27.012ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:90 sled_id = 3ae06dcf-597c-4d18-b2d7-37c1f02096d7
1822024-05-10T21:20:27.013ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:195 local_addr = [fd00:1122:3344:101::1]:52284 sled_id = 3ae06dcf-597c-4d18-b2d7-37c1f02096d7
1832024-05-10T21:20:27.013ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:60 sled_id = 3ae06dcf-597c-4d18-b2d7-37c1f02096d7
1842024-05-10T21:20:27.013ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:52284 file = oximeter/producer/src/lib.rs:284 interval = 30s producer_id = 3ae06dcf-597c-4d18-b2d7-37c1f02096d7 route = //3ae06dcf-597c-4d18-b2d7-37c1f02096d7 sled_id = 3ae06dcf-597c-4d18-b2d7-37c1f02096d7
1852024-05-10T21:20:27.020ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 221.999611ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:393 sled_id = 3ae06dcf-597c-4d18-b2d7-37c1f02096d7
1862024-05-10T21:20:27.060ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = 3ae06dcf-597c-4d18-b2d7-37c1f02096d7
1872024-05-10T21:20:27.060ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = 3ae06dcf-597c-4d18-b2d7-37c1f02096d7
1882024-05-10T21:20:27.061ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:993 underlay_address = fd00:1122:3344:101::1
1892024-05-10T21:20:27.061ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:60
1902024-05-10T21:20:27.061ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:195 local_addr = [fd00:1122:3344:101::1]:12345
1912024-05-10T21:20:27.061ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:430
1922024-05-10T21:20:27.061ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
1932024-05-10T21:20:27.061ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/6742bbd6-6bec-4f6b-94f3-002a53fc9f01/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
1942024-05-10T21:20:27.062ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/8becec77-7597-498a-9704-3ae75204e470/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
1952024-05-10T21:20:27.062ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
1962024-05-10T21:20:27.062ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:262 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV1 { rack_subnet: Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [PortConfigV1 { routes: [RouteConfig { destination: V4(Ipv4Network { addr: 0.0.0.0, prefix: 0 }), nexthop: 10.151.2.100, vlan_id: None }], addresses: [V4(Ipv4Network { addr: 10.151.2.174, prefix: 24 })], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: None, bgp_peers: [], autoneg: false }], bgp: [], bfd: [] })))
1972024-05-10T21:20:27.062ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3617
1982024-05-10T21:20:27.062ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:73 remote_addr = [fdb0:18c0:4d0d:a02a::1]:34104
1992024-05-10T21:20:27.244ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:164
2002024-05-10T21:20:27.245ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:108 peer = [fdb0:18c0:4d0d:a02a::1]:12346
2012024-05-10T21:20:27.245ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:232 target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
2022024-05-10T21:20:27.246ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
2032024-05-10T21:20:27.246ZINFOSledAgent (RSS): No ledger in /pool/int/6742bbd6-6bec-4f6b-94f3-002a53fc9f01/config/rss-service-plan-v3.json file = common/src/ledger.rs:188
2042024-05-10T21:20:27.246ZINFOSledAgent (RSS): No ledger in /pool/int/8becec77-7597-498a-9704-3ae75204e470/config/rss-service-plan-v3.json file = common/src/ledger.rs:188
2052024-05-10T21:20:27.246ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
2062024-05-10T21:20:27.246ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
2072024-05-10T21:20:27.246ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 657.733883ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:393 sled_id = 3ae06dcf-597c-4d18-b2d7-37c1f02096d7
2082024-05-10T21:20:27.251ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/3ae06dcf-597c-4d18-b2d7-37c1f02096d7): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:619 sled_id = 3ae06dcf-597c-4d18-b2d7-37c1f02096d7
2092024-05-10T21:20:27.278ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35559
2102024-05-10T21:20:27.278ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
2112024-05-10T21:20:27.278ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 201 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:35559 req_id = e8df25c3-45d5-48b4-859a-de97d800a4d3 response_code = 200 uri = /inventory
2122024-05-10T21:20:27.309ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45107
2132024-05-10T21:20:27.309ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:45107 req_id = 56cd3adb-0efe-4947-bee2-07efa67c2a05 response_code = 200 uri = /sled-role
2142024-05-10T21:20:27.309ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
2152024-05-10T21:20:27.309ZINFOSledAgent (RSS): Writing ledger to /pool/int/6742bbd6-6bec-4f6b-94f3-002a53fc9f01/config/.rss-service-plan-v3.json.tmp file = common/src/ledger.rs:199
2162024-05-10T21:20:27.310ZINFOSledAgent (RSS): Writing ledger to /pool/int/8becec77-7597-498a-9704-3ae75204e470/config/.rss-service-plan-v3.json.tmp file = common/src/ledger.rs:199
2172024-05-10T21:20:27.310ZINFOSledAgent (RSS): Service plan written to storage file = sled-agent/src/rack_setup/plan/service.rs:815
2182024-05-10T21:20:27.342ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { disks: [OmicronPhysicalDiskConfig { id: 22a5a9c0-aef1-4109-9187-218a893d9cf1, identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" }, pool_id: d7867297-5592-4803-bd09-620387b7253d (zpool) }, OmicronPhysicalDiskConfig { id: 294f172b-c607-4b34-8c88-7e1a1e32111b, identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" }, pool_id: 7482ebc0-5237-4ab2-bef7-e62e772ad207 (zpool) }, OmicronPhysicalDiskConfig { id: bd056469-89d9-4d8f-858c-0bed60cdf74d, identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" }, pool_id: 4a2a1aac-5879-491f-b914-3e863f8ce4c3 (zpool) }, OmicronPhysicalDiskConfig { id: 748bc17f-0815-47cd-ac48-ad497b0cac4e, identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" }, pool_id: c20ef2f7-458a-4b20-ab01-0ef15666a084 (zpool) }, OmicronPhysicalDiskConfig { id: 1c73e432-165d-449a-a42a-f9da468b664c, identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2" }, pool_id: c78aa9ff-15c2-42ef-a938-4f9e1a276bc9 (zpool) }, OmicronPhysicalDiskConfig { id: 89dc3e2c-c464-4810-babf-3ee764df01bc, identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2" }, pool_id: b315123f-de7f-4c95-94ec-6ebbaf4bb37f (zpool) }, OmicronPhysicalDiskConfig { id: 1a038e9d-ee6b-425b-8397-12cc73e1cc4c, identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-6", model: "synthetic-model-U2" }, pool_id: be007fc9-c18b-4eb9-b039-d1acd6258caa (zpool) }, OmicronPhysicalDiskConfig { id: ff2f0f9c-68cb-495d-866c-22a93586ccb6, identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-7", model: "synthetic-model-U2" }, pool_id: d1ca4b9b-c237-46f9-b5f2-dacd6333114b (zpool) }, OmicronPhysicalDiskConfig { id: 4f209ee9-7dfc-4ef6-8032-6a026622ab7c, identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-8", model: "synthetic-model-U2" }, pool_id: 6827078d-a479-42be-8ba6-18589f19cebd (zpool) }], generation: Generation(1) } file = sled-agent/src/rack_setup/service.rs:346 sled_address = [fd00:1122:3344:101::1]:12345
2192024-05-10T21:20:27.342ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51366
2202024-05-10T21:20:27.342ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(1), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" }, id: 22a5a9c0-aef1-4109-9187-218a893d9cf1, pool_id: d7867297-5592-4803-bd09-620387b7253d (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" }, id: 294f172b-c607-4b34-8c88-7e1a1e32111b, pool_id: 7482ebc0-5237-4ab2-bef7-e62e772ad207 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" }, id: bd056469-89d9-4d8f-858c-0bed60cdf74d, pool_id: 4a2a1aac-5879-491f-b914-3e863f8ce4c3 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" }, id: 748bc17f-0815-47cd-ac48-ad497b0cac4e, pool_id: c20ef2f7-458a-4b20-ab01-0ef15666a084 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2" }, id: 1c73e432-165d-449a-a42a-f9da468b664c, pool_id: c78aa9ff-15c2-42ef-a938-4f9e1a276bc9 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2" }, id: 89dc3e2c-c464-4810-babf-3ee764df01bc, pool_id: b315123f-de7f-4c95-94ec-6ebbaf4bb37f (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-6", model: "synthetic-model-U2" }, id: 1a038e9d-ee6b-425b-8397-12cc73e1cc4c, pool_id: be007fc9-c18b-4eb9-b039-d1acd6258caa (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-7", model: "synthetic-model-U2" }, id: ff2f0f9c-68cb-495d-866c-22a93586ccb6, pool_id: d1ca4b9b-c237-46f9-b5f2-dacd6333114b (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-8", model: "synthetic-model-U2" }, id: 4f209ee9-7dfc-4ef6-8032-6a026622ab7c, pool_id: 6827078d-a479-42be-8ba6-18589f19cebd (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:381
2212024-05-10T21:20:27.342ZINFOSledAgent (StorageManager): No ledger in /pool/int/6742bbd6-6bec-4f6b-94f3-002a53fc9f01/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2222024-05-10T21:20:27.342ZINFOSledAgent (StorageManager): No ledger in /pool/int/8becec77-7597-498a-9704-3ae75204e470/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2232024-05-10T21:20:27.342ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:681 request = omicron_physical_disks_ensure
2242024-05-10T21:20:27.342ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:339
2252024-05-10T21:20:27.342ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" } file = sled-storage/src/resources.rs:379
2262024-05-10T21:20:27.342ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
2272024-05-10T21:20:27.342ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:112 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" } path = /scratch/u2_0.vdev
2282024-05-10T21:20:27.440ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:304
2292024-05-10T21:20:27.440ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:310 id = d7867297-5592-4803-bd09-620387b7253d (zpool)
2302024-05-10T21:20:28.019ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 726.992691ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:393 sled_id = 3ae06dcf-597c-4d18-b2d7-37c1f02096d7
2312024-05-10T21:20:28.184ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/3ae06dcf-597c-4d18-b2d7-37c1f02096d7): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = 3ae06dcf-597c-4d18-b2d7-37c1f02096d7
2322024-05-10T21:20:28.374ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: d7867297-5592-4803-bd09-620387b7253d (zpool), kind: External }
2332024-05-10T21:20:28.570ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" } file = sled-storage/src/dataset.rs:332
2342024-05-10T21:20:28.570ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" } epoch = 0 file = sled-storage/src/dataset.rs:334
2352024-05-10T21:20:28.570ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" } epoch = 0 file = sled-storage/src/dataset.rs:338
2362024-05-10T21:20:28.570ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" } epoch = 0 file = sled-storage/src/dataset.rs:340
2372024-05-10T21:20:28.570ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2382024-05-10T21:20:28.570ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2392024-05-10T21:20:28.570ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
2402024-05-10T21:20:28.804ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.859783301s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:393 sled_id = 3ae06dcf-597c-4d18-b2d7-37c1f02096d7
2412024-05-10T21:20:29.140ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2422024-05-10T21:20:29.326ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_switch
2432024-05-10T21:20:29.496ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_d7867297-5592-4803-bd09-620387b7253d/crypt/zone file = sled-storage/src/dataset.rs:395
2442024-05-10T21:20:30.084ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/3ae06dcf-597c-4d18-b2d7-37c1f02096d7): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = 3ae06dcf-597c-4d18-b2d7-37c1f02096d7
2452024-05-10T21:20:30.084ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/3ae06dcf-597c-4d18-b2d7-37c1f02096d7): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:619 sled_id = 3ae06dcf-597c-4d18-b2d7-37c1f02096d7
2462024-05-10T21:20:30.084ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 62.453566ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2472024-05-10T21:20:30.606ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 87.459564ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2482024-05-10T21:20:31.242ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 3.589825218s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:393 sled_id = 3ae06dcf-597c-4d18-b2d7-37c1f02096d7
2492024-05-10T21:20:31.242ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/3ae06dcf-597c-4d18-b2d7-37c1f02096d7): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = 3ae06dcf-597c-4d18-b2d7-37c1f02096d7
2502024-05-10T21:20:31.242ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 128.517041ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2512024-05-10T21:20:31.806ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 547.620284ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2522024-05-10T21:20:31.808ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/3ae06dcf-597c-4d18-b2d7-37c1f02096d7): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:619 sled_id = 3ae06dcf-597c-4d18-b2d7-37c1f02096d7
2532024-05-10T21:20:32.294ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/3ae06dcf-597c-4d18-b2d7-37c1f02096d7): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = 3ae06dcf-597c-4d18-b2d7-37c1f02096d7
2542024-05-10T21:20:32.305ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_d7867297-5592-4803-bd09-620387b7253d file = sled-storage/src/dataset.rs:480
2552024-05-10T21:20:32.767ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" } file = sled-storage/src/resources.rs:477
2562024-05-10T21:20:32.767ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" } file = sled-storage/src/resources.rs:394
2572024-05-10T21:20:32.767ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" } file = sled-storage/src/resources.rs:379
2582024-05-10T21:20:32.767ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
2592024-05-10T21:20:32.767ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:112 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" } path = /scratch/u2_1.vdev
2602024-05-10T21:20:32.998ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 915.259082ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2612024-05-10T21:20:33.006ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:304
2622024-05-10T21:20:33.006ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:310 id = 7482ebc0-5237-4ab2-bef7-e62e772ad207 (zpool)
2632024-05-10T21:20:33.449ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/3ae06dcf-597c-4d18-b2d7-37c1f02096d7): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = 3ae06dcf-597c-4d18-b2d7-37c1f02096d7
2642024-05-10T21:20:34.400ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/3ae06dcf-597c-4d18-b2d7-37c1f02096d7): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:619 sled_id = 3ae06dcf-597c-4d18-b2d7-37c1f02096d7
2652024-05-10T21:20:34.400ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.327116925s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2662024-05-10T21:20:34.415ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: 7482ebc0-5237-4ab2-bef7-e62e772ad207 (zpool), kind: External }
2672024-05-10T21:20:34.634ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/3ae06dcf-597c-4d18-b2d7-37c1f02096d7): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = 3ae06dcf-597c-4d18-b2d7-37c1f02096d7
2682024-05-10T21:20:34.640ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" } file = sled-storage/src/dataset.rs:332
2692024-05-10T21:20:34.640ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" } epoch = 0 file = sled-storage/src/dataset.rs:334
2702024-05-10T21:20:34.640ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" } epoch = 0 file = sled-storage/src/dataset.rs:338
2712024-05-10T21:20:34.640ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" } epoch = 0 file = sled-storage/src/dataset.rs:340
2722024-05-10T21:20:34.640ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2732024-05-10T21:20:34.640ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2742024-05-10T21:20:34.641ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
2752024-05-10T21:20:34.890ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 8.59132045s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:393 sled_id = 3ae06dcf-597c-4d18-b2d7-37c1f02096d7
2762024-05-10T21:20:35.385ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2772024-05-10T21:20:35.643ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/3ae06dcf-597c-4d18-b2d7-37c1f02096d7): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = 3ae06dcf-597c-4d18-b2d7-37c1f02096d7
2782024-05-10T21:20:35.650ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_7482ebc0-5237-4ab2-bef7-e62e772ad207/crypt/zone file = sled-storage/src/dataset.rs:395
2792024-05-10T21:20:37.298ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = 3ae06dcf-597c-4d18-b2d7-37c1f02096d7
2802024-05-10T21:20:37.300ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/3ae06dcf-597c-4d18-b2d7-37c1f02096d7): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:619 sled_id = 3ae06dcf-597c-4d18-b2d7-37c1f02096d7
2812024-05-10T21:20:37.300ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/3ae06dcf-597c-4d18-b2d7-37c1f02096d7): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = 3ae06dcf-597c-4d18-b2d7-37c1f02096d7
2822024-05-10T21:20:37.397ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_7482ebc0-5237-4ab2-bef7-e62e772ad207 file = sled-storage/src/dataset.rs:480
2832024-05-10T21:20:37.406ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" } file = sled-storage/src/resources.rs:477
2842024-05-10T21:20:37.406ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" } file = sled-storage/src/resources.rs:394
2852024-05-10T21:20:37.406ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" } file = sled-storage/src/resources.rs:379
2862024-05-10T21:20:37.406ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
2872024-05-10T21:20:37.406ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:112 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" } path = /scratch/u2_2.vdev
2882024-05-10T21:20:37.416ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:304
2892024-05-10T21:20:37.416ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:310 id = 4a2a1aac-5879-491f-b914-3e863f8ce4c3 (zpool)
2902024-05-10T21:20:37.530ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: 4a2a1aac-5879-491f-b914-3e863f8ce4c3 (zpool), kind: External }
2912024-05-10T21:20:37.539ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" } file = sled-storage/src/dataset.rs:332
2922024-05-10T21:20:37.539ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" } epoch = 0 file = sled-storage/src/dataset.rs:334
2932024-05-10T21:20:37.539ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" } epoch = 0 file = sled-storage/src/dataset.rs:338
2942024-05-10T21:20:37.539ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" } epoch = 0 file = sled-storage/src/dataset.rs:340
2952024-05-10T21:20:37.539ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
2962024-05-10T21:20:37.539ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
2972024-05-10T21:20:37.539ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
2982024-05-10T21:20:37.581ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2992024-05-10T21:20:37.589ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_4a2a1aac-5879-491f-b914-3e863f8ce4c3/crypt/zone file = sled-storage/src/dataset.rs:395
3002024-05-10T21:20:37.728ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_4a2a1aac-5879-491f-b914-3e863f8ce4c3 file = sled-storage/src/dataset.rs:480
3012024-05-10T21:20:37.736ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" } file = sled-storage/src/resources.rs:477
3022024-05-10T21:20:37.736ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" } file = sled-storage/src/resources.rs:394
3032024-05-10T21:20:37.736ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" } file = sled-storage/src/resources.rs:379
3042024-05-10T21:20:37.736ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
3052024-05-10T21:20:37.736ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:112 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" } path = /scratch/u2_3.vdev
3062024-05-10T21:20:37.746ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:304
3072024-05-10T21:20:37.746ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:310 id = c20ef2f7-458a-4b20-ab01-0ef15666a084 (zpool)
3082024-05-10T21:20:37.856ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: c20ef2f7-458a-4b20-ab01-0ef15666a084 (zpool), kind: External }
3092024-05-10T21:20:37.863ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" } file = sled-storage/src/dataset.rs:332
3102024-05-10T21:20:37.863ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" } epoch = 0 file = sled-storage/src/dataset.rs:334
3112024-05-10T21:20:37.863ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" } epoch = 0 file = sled-storage/src/dataset.rs:338
3122024-05-10T21:20:37.863ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" } epoch = 0 file = sled-storage/src/dataset.rs:340
3132024-05-10T21:20:37.863ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3142024-05-10T21:20:37.863ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3152024-05-10T21:20:37.863ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
3162024-05-10T21:20:37.905ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3172024-05-10T21:20:37.912ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_c20ef2f7-458a-4b20-ab01-0ef15666a084/crypt/zone file = sled-storage/src/dataset.rs:395
3182024-05-10T21:20:38.047ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_c20ef2f7-458a-4b20-ab01-0ef15666a084 file = sled-storage/src/dataset.rs:480
3192024-05-10T21:20:38.055ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" } file = sled-storage/src/resources.rs:477
3202024-05-10T21:20:38.056ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" } file = sled-storage/src/resources.rs:394
3212024-05-10T21:20:38.056ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2" } file = sled-storage/src/resources.rs:379
3222024-05-10T21:20:38.056ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
3232024-05-10T21:20:38.056ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:112 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2" } path = /scratch/u2_4.vdev
3242024-05-10T21:20:38.065ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:304
3252024-05-10T21:20:38.065ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:310 id = c78aa9ff-15c2-42ef-a938-4f9e1a276bc9 (zpool)
3262024-05-10T21:20:38.175ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: c78aa9ff-15c2-42ef-a938-4f9e1a276bc9 (zpool), kind: External }
3272024-05-10T21:20:38.181ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2" } file = sled-storage/src/dataset.rs:332
3282024-05-10T21:20:38.181ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2" } epoch = 0 file = sled-storage/src/dataset.rs:334
3292024-05-10T21:20:38.181ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2" } epoch = 0 file = sled-storage/src/dataset.rs:338
3302024-05-10T21:20:38.181ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2" } epoch = 0 file = sled-storage/src/dataset.rs:340
3312024-05-10T21:20:38.181ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3322024-05-10T21:20:38.181ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3332024-05-10T21:20:38.181ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
3342024-05-10T21:20:38.224ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3352024-05-10T21:20:38.232ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_c78aa9ff-15c2-42ef-a938-4f9e1a276bc9/crypt/zone file = sled-storage/src/dataset.rs:395
3362024-05-10T21:20:38.303ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/3ae06dcf-597c-4d18-b2d7-37c1f02096d7): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = 3ae06dcf-597c-4d18-b2d7-37c1f02096d7
3372024-05-10T21:20:38.373ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_c78aa9ff-15c2-42ef-a938-4f9e1a276bc9 file = sled-storage/src/dataset.rs:480
3382024-05-10T21:20:38.381ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2" } file = sled-storage/src/resources.rs:477
3392024-05-10T21:20:38.381ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2" } file = sled-storage/src/resources.rs:394
3402024-05-10T21:20:38.381ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2" } file = sled-storage/src/resources.rs:379
3412024-05-10T21:20:38.381ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
3422024-05-10T21:20:38.381ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:112 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2" } path = /scratch/u2_5.vdev
3432024-05-10T21:20:38.390ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:304
3442024-05-10T21:20:38.390ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:310 id = b315123f-de7f-4c95-94ec-6ebbaf4bb37f (zpool)
3452024-05-10T21:20:38.505ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: b315123f-de7f-4c95-94ec-6ebbaf4bb37f (zpool), kind: External }
3462024-05-10T21:20:38.512ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2" } file = sled-storage/src/dataset.rs:332
3472024-05-10T21:20:38.512ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2" } epoch = 0 file = sled-storage/src/dataset.rs:334
3482024-05-10T21:20:38.512ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2" } epoch = 0 file = sled-storage/src/dataset.rs:338
3492024-05-10T21:20:38.513ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2" } epoch = 0 file = sled-storage/src/dataset.rs:340
3502024-05-10T21:20:38.513ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3512024-05-10T21:20:38.513ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3522024-05-10T21:20:38.513ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
3532024-05-10T21:20:38.552ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3542024-05-10T21:20:38.559ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_b315123f-de7f-4c95-94ec-6ebbaf4bb37f/crypt/zone file = sled-storage/src/dataset.rs:395
3552024-05-10T21:20:38.696ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_b315123f-de7f-4c95-94ec-6ebbaf4bb37f file = sled-storage/src/dataset.rs:480
3562024-05-10T21:20:38.704ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2" } file = sled-storage/src/resources.rs:477
3572024-05-10T21:20:38.704ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2" } file = sled-storage/src/resources.rs:394
3582024-05-10T21:20:38.704ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-6", model: "synthetic-model-U2" } file = sled-storage/src/resources.rs:379
3592024-05-10T21:20:38.704ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
3602024-05-10T21:20:38.704ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:112 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-6", model: "synthetic-model-U2" } path = /scratch/u2_6.vdev
3612024-05-10T21:20:38.714ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:304
3622024-05-10T21:20:38.714ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:310 id = be007fc9-c18b-4eb9-b039-d1acd6258caa (zpool)
3632024-05-10T21:20:38.834ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-6", model: "synthetic-model-U2" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: be007fc9-c18b-4eb9-b039-d1acd6258caa (zpool), kind: External }
3642024-05-10T21:20:38.842ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-6", model: "synthetic-model-U2" } file = sled-storage/src/dataset.rs:332
3652024-05-10T21:20:38.842ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-6", model: "synthetic-model-U2" } epoch = 0 file = sled-storage/src/dataset.rs:334
3662024-05-10T21:20:38.842ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-6", model: "synthetic-model-U2" } epoch = 0 file = sled-storage/src/dataset.rs:338
3672024-05-10T21:20:38.842ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-6", model: "synthetic-model-U2" } epoch = 0 file = sled-storage/src/dataset.rs:340
3682024-05-10T21:20:38.842ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3692024-05-10T21:20:38.842ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3702024-05-10T21:20:38.842ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
3712024-05-10T21:20:38.846ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/3ae06dcf-597c-4d18-b2d7-37c1f02096d7): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:619 sled_id = 3ae06dcf-597c-4d18-b2d7-37c1f02096d7
3722024-05-10T21:20:38.883ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3732024-05-10T21:20:38.891ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_be007fc9-c18b-4eb9-b039-d1acd6258caa/crypt/zone file = sled-storage/src/dataset.rs:395
3742024-05-10T21:20:39.041ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_be007fc9-c18b-4eb9-b039-d1acd6258caa file = sled-storage/src/dataset.rs:480
3752024-05-10T21:20:39.050ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-6", model: "synthetic-model-U2" } file = sled-storage/src/resources.rs:477
3762024-05-10T21:20:39.050ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-6", model: "synthetic-model-U2" } file = sled-storage/src/resources.rs:394
3772024-05-10T21:20:39.050ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-7", model: "synthetic-model-U2" } file = sled-storage/src/resources.rs:379
3782024-05-10T21:20:39.050ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
3792024-05-10T21:20:39.050ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:112 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-7", model: "synthetic-model-U2" } path = /scratch/u2_7.vdev
3802024-05-10T21:20:39.060ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:304
3812024-05-10T21:20:39.060ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:310 id = d1ca4b9b-c237-46f9-b5f2-dacd6333114b (zpool)
3822024-05-10T21:20:39.179ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-7", model: "synthetic-model-U2" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: d1ca4b9b-c237-46f9-b5f2-dacd6333114b (zpool), kind: External }
3832024-05-10T21:20:39.187ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-7", model: "synthetic-model-U2" } file = sled-storage/src/dataset.rs:332
3842024-05-10T21:20:39.187ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-7", model: "synthetic-model-U2" } epoch = 0 file = sled-storage/src/dataset.rs:334
3852024-05-10T21:20:39.187ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-7", model: "synthetic-model-U2" } epoch = 0 file = sled-storage/src/dataset.rs:338
3862024-05-10T21:20:39.187ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-7", model: "synthetic-model-U2" } epoch = 0 file = sled-storage/src/dataset.rs:340
3872024-05-10T21:20:39.187ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
3882024-05-10T21:20:39.187ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
3892024-05-10T21:20:39.187ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
3902024-05-10T21:20:39.229ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3912024-05-10T21:20:39.238ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_d1ca4b9b-c237-46f9-b5f2-dacd6333114b/crypt/zone file = sled-storage/src/dataset.rs:395
3922024-05-10T21:20:39.305ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/3ae06dcf-597c-4d18-b2d7-37c1f02096d7): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = 3ae06dcf-597c-4d18-b2d7-37c1f02096d7
3932024-05-10T21:20:39.380ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_d1ca4b9b-c237-46f9-b5f2-dacd6333114b file = sled-storage/src/dataset.rs:480
3942024-05-10T21:20:39.388ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-7", model: "synthetic-model-U2" } file = sled-storage/src/resources.rs:477
3952024-05-10T21:20:39.388ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-7", model: "synthetic-model-U2" } file = sled-storage/src/resources.rs:394
3962024-05-10T21:20:39.388ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-8", model: "synthetic-model-U2" } file = sled-storage/src/resources.rs:379
3972024-05-10T21:20:39.388ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
3982024-05-10T21:20:39.388ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:112 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-8", model: "synthetic-model-U2" } path = /scratch/u2_8.vdev
3992024-05-10T21:20:39.398ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:304
4002024-05-10T21:20:39.398ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:310 id = 6827078d-a479-42be-8ba6-18589f19cebd (zpool)
4012024-05-10T21:20:39.510ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-8", model: "synthetic-model-U2" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: 6827078d-a479-42be-8ba6-18589f19cebd (zpool), kind: External }
4022024-05-10T21:20:39.518ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-8", model: "synthetic-model-U2" } file = sled-storage/src/dataset.rs:332
4032024-05-10T21:20:39.518ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-8", model: "synthetic-model-U2" } epoch = 0 file = sled-storage/src/dataset.rs:334
4042024-05-10T21:20:39.518ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-8", model: "synthetic-model-U2" } epoch = 0 file = sled-storage/src/dataset.rs:338
4052024-05-10T21:20:39.518ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-8", model: "synthetic-model-U2" } epoch = 0 file = sled-storage/src/dataset.rs:340
4062024-05-10T21:20:39.518ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4072024-05-10T21:20:39.518ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4082024-05-10T21:20:39.518ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
4092024-05-10T21:20:39.560ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4102024-05-10T21:20:39.567ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_6827078d-a479-42be-8ba6-18589f19cebd/crypt/zone file = sled-storage/src/dataset.rs:395
4112024-05-10T21:20:39.706ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_6827078d-a479-42be-8ba6-18589f19cebd file = sled-storage/src/dataset.rs:480
4122024-05-10T21:20:39.715ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-8", model: "synthetic-model-U2" } file = sled-storage/src/resources.rs:477
4132024-05-10T21:20:39.715ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-8", model: "synthetic-model-U2" } file = sled-storage/src/resources.rs:394
4142024-05-10T21:20:39.715ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/6742bbd6-6bec-4f6b-94f3-002a53fc9f01/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4152024-05-10T21:20:39.715ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 6742bbd6-6bec-4f6b-94f3-002a53fc9f01 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" }, variant: U2, slot: 1026 }, zpool_name: ZpoolName { id: d7867297-5592-4803-bd09-620387b7253d (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-M2" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-M2" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: 8becec77-7597-498a-9704-3ae75204e470 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" }, variant: U2, slot: 1027 }, zpool_name: ZpoolName { id: 7482ebc0-5237-4ab2-bef7-e62e772ad207 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" }, variant: U2, slot: 1028 }, zpool_name: ZpoolName { id: 4a2a1aac-5879-491f-b914-3e863f8ce4c3 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" }, variant: U2, slot: 1029 }, zpool_name: ZpoolName { id: c20ef2f7-458a-4b20-ab01-0ef15666a084 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2" }, variant: U2, slot: 1030 }, zpool_name: ZpoolName { id: c78aa9ff-15c2-42ef-a938-4f9e1a276bc9 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2" }, variant: U2, slot: 1031 }, zpool_name: ZpoolName { id: b315123f-de7f-4c95-94ec-6ebbaf4bb37f (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-6", model: "synthetic-model-U2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-6", model: "synthetic-model-U2" }, variant: U2, slot: 1032 }, zpool_name: ZpoolName { id: be007fc9-c18b-4eb9-b039-d1acd6258caa (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-7", model: "synthetic-model-U2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-7", model: "synthetic-model-U2" }, variant: U2, slot: 1033 }, zpool_name: ZpoolName { id: d1ca4b9b-c237-46f9-b5f2-dacd6333114b (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-8", model: "synthetic-model-U2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-8", model: "synthetic-model-U2" }, variant: U2, slot: 1034 }, zpool_name: ZpoolName { id: 6827078d-a479-42be-8ba6-18589f19cebd (zpool), kind: External } }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
4162024-05-10T21:20:39.715ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/8becec77-7597-498a-9704-3ae75204e470/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4172024-05-10T21:20:39.715ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 12373312 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:51366 req_id = 8203d3e5-5243-4e61-b565-a973d0be2566 response_code = 200 uri = /omicron-physical-disks
4182024-05-10T21:20:39.746ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: 44b8a2e7-6078-49de-bb34-f1cd8770385e, underlay_address: fd00:1122:3344:1::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d7867297-5592-4803-bd09-620387b7253d (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 8749ab70-ffc4-4a3c-a81f-43992c9390ce, underlay_address: fd00:1122:3344:2::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7482ebc0-5237-4ab2-bef7-e62e772ad207 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: e564d557-0b19-497f-baac-984106980347, underlay_address: fd00:1122:3344:3::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 4a2a1aac-5879-491f-b914-3e863f8ce4c3 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:429 sled_address = [fd00:1122:3344:101::1]:12345
4192024-05-10T21:20:39.746ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49411
4202024-05-10T21:20:39.746ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 44b8a2e7-6078-49de-bb34-f1cd8770385e, dataset_name: DatasetName { pool_name: ZpoolName { id: d7867297-5592-4803-bd09-620387b7253d (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
4212024-05-10T21:20:39.746ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 44b8a2e7-6078-49de-bb34-f1cd8770385e, dataset_name: DatasetName { pool_name: ZpoolName { id: d7867297-5592-4803-bd09-620387b7253d (zpool), kind: External }, kind: InternalDns }, responder: ... }
4222024-05-10T21:20:39.804ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 8749ab70-ffc4-4a3c-a81f-43992c9390ce, dataset_name: DatasetName { pool_name: ZpoolName { id: 7482ebc0-5237-4ab2-bef7-e62e772ad207 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
4232024-05-10T21:20:39.804ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 8749ab70-ffc4-4a3c-a81f-43992c9390ce, dataset_name: DatasetName { pool_name: ZpoolName { id: 7482ebc0-5237-4ab2-bef7-e62e772ad207 (zpool), kind: External }, kind: InternalDns }, responder: ... }
4242024-05-10T21:20:39.862ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e564d557-0b19-497f-baac-984106980347, dataset_name: DatasetName { pool_name: ZpoolName { id: 4a2a1aac-5879-491f-b914-3e863f8ce4c3 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
4252024-05-10T21:20:39.862ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: e564d557-0b19-497f-baac-984106980347, dataset_name: DatasetName { pool_name: ZpoolName { id: 4a2a1aac-5879-491f-b914-3e863f8ce4c3 (zpool), kind: External }, kind: InternalDns }, responder: ... }
4262024-05-10T21:20:39.920ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
4272024-05-10T21:20:39.920ZINFOSledAgent (ServiceManager): No ledger in /pool/int/6742bbd6-6bec-4f6b-94f3-002a53fc9f01/config/omicron-zones.json file = common/src/ledger.rs:188
4282024-05-10T21:20:39.920ZINFOSledAgent (ServiceManager): No ledger in /pool/int/8becec77-7597-498a-9704-3ae75204e470/config/omicron-zones.json file = common/src/ledger.rs:188
4292024-05-10T21:20:39.920ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
4302024-05-10T21:20:39.966ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
4312024-05-10T21:20:39.966ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
4322024-05-10T21:20:39.966ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
4332024-05-10T21:20:40.017ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_e564d557-0b19-497f-baac-984106980347 file = illumos-utils/src/zone.rs:315
4342024-05-10T21:20:40.021ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_44b8a2e7-6078-49de-bb34-f1cd8770385e file = illumos-utils/src/zone.rs:315
4352024-05-10T21:20:40.025ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_8749ab70-ffc4-4a3c-a81f-43992c9390ce file = illumos-utils/src/zone.rs:315
4362024-05-10T21:20:40.037ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_e564d557-0b19-497f-baac-984106980347 file = illumos-utils/src/zone.rs:354
4372024-05-10T21:20:40.042ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_44b8a2e7-6078-49de-bb34-f1cd8770385e file = illumos-utils/src/zone.rs:354
4382024-05-10T21:20:40.046ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_8749ab70-ffc4-4a3c-a81f-43992c9390ce file = illumos-utils/src/zone.rs:354
4392024-05-10T21:20:40.308ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/3ae06dcf-597c-4d18-b2d7-37c1f02096d7): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = 3ae06dcf-597c-4d18-b2d7-37c1f02096d7
4402024-05-10T21:20:40.844ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/3ae06dcf-597c-4d18-b2d7-37c1f02096d7): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:619 sled_id = 3ae06dcf-597c-4d18-b2d7-37c1f02096d7
4412024-05-10T21:20:40.956ZINFOSledAgent (ServiceManager): Ensuring tfportrear0_0/ll exists in zone file = sled-agent/src/services.rs:2303
4422024-05-10T21:20:41.554ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_e564d557-0b19-497f-baac-984106980347: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService1"/> <propval type="astring" name="gateway" value="fd00:1122:3344:3::2"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:3::1"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value="[fd00:1122:3344:3::1]:5353"/> <propval type="astring" name="dns_address" value="[fd00:1122:3344:3::1]:53"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
4432024-05-10T21:20:41.554ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:87 prefix = Ipv6Prefix { addr: fd00:1122:3344:3::, len: 64 }
4442024-05-10T21:20:41.555ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_internal_dns_e564d557-0b19-497f-baac-984106980347
4452024-05-10T21:20:42.039ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_44b8a2e7-6078-49de-bb34-f1cd8770385e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService2"/> <propval type="astring" name="gateway" value="fd00:1122:3344:1::2"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:1::1"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value="[fd00:1122:3344:1::1]:5353"/> <propval type="astring" name="dns_address" value="[fd00:1122:3344:1::1]:53"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
4462024-05-10T21:20:42.518ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:87 prefix = Ipv6Prefix { addr: fd00:1122:3344:1::, len: 64 }
4472024-05-10T21:20:42.518ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_8749ab70-ffc4-4a3c-a81f-43992c9390ce: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService3"/> <propval type="astring" name="gateway" value="fd00:1122:3344:2::2"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:2::1"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value="[fd00:1122:3344:2::1]:5353"/> <propval type="astring" name="dns_address" value="[fd00:1122:3344:2::1]:53"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
4482024-05-10T21:20:42.518ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:87 prefix = Ipv6Prefix { addr: fd00:1122:3344:2::, len: 64 }
4492024-05-10T21:20:42.526ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e564d557-0b19-497f-baac-984106980347") failed: Property not found. retry in 37.928189ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_e564d557-0b19-497f-baac-984106980347
4502024-05-10T21:20:42.526ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_internal_dns_44b8a2e7-6078-49de-bb34-f1cd8770385e
4512024-05-10T21:20:42.531ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_internal_dns_8749ab70-ffc4-4a3c-a81f-43992c9390ce
4522024-05-10T21:20:42.573ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e564d557-0b19-497f-baac-984106980347") failed: Property not found. retry in 80.395993ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_e564d557-0b19-497f-baac-984106980347
4532024-05-10T21:20:42.644ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_44b8a2e7-6078-49de-bb34-f1cd8770385e") failed: Property not found. retry in 40.094288ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_44b8a2e7-6078-49de-bb34-f1cd8770385e
4542024-05-10T21:20:42.659ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_8749ab70-ffc4-4a3c-a81f-43992c9390ce") failed: Property not found. retry in 69.816458ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_8749ab70-ffc4-4a3c-a81f-43992c9390ce
4552024-05-10T21:20:42.666ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e564d557-0b19-497f-baac-984106980347") failed: Property not found. retry in 230.992787ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_e564d557-0b19-497f-baac-984106980347
4562024-05-10T21:20:42.691ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_44b8a2e7-6078-49de-bb34-f1cd8770385e") failed: Property not found. retry in 135.594979ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_44b8a2e7-6078-49de-bb34-f1cd8770385e
4572024-05-10T21:20:42.958ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_8749ab70-ffc4-4a3c-a81f-43992c9390ce") failed: Property not found. retry in 86.13307ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_8749ab70-ffc4-4a3c-a81f-43992c9390ce
4582024-05-10T21:20:42.973ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_44b8a2e7-6078-49de-bb34-f1cd8770385e") failed: Property not found. retry in 236.272343ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_44b8a2e7-6078-49de-bb34-f1cd8770385e
4592024-05-10T21:20:43.011ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_8749ab70-ffc4-4a3c-a81f-43992c9390ce") failed: Property not found. retry in 236.241502ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_8749ab70-ffc4-4a3c-a81f-43992c9390ce
4602024-05-10T21:20:43.023ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e564d557-0b19-497f-baac-984106980347") failed: Property not found. retry in 467.935938ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_e564d557-0b19-497f-baac-984106980347
4612024-05-10T21:20:43.222ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_44b8a2e7-6078-49de-bb34-f1cd8770385e") failed: Property not found. retry in 501.472849ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_44b8a2e7-6078-49de-bb34-f1cd8770385e
4622024-05-10T21:20:43.258ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_8749ab70-ffc4-4a3c-a81f-43992c9390ce") failed: Property not found. retry in 473.523764ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_8749ab70-ffc4-4a3c-a81f-43992c9390ce
4632024-05-10T21:20:43.501ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e564d557-0b19-497f-baac-984106980347") failed: Property not found. retry in 640.933379ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_e564d557-0b19-497f-baac-984106980347
4642024-05-10T21:20:43.732ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_44b8a2e7-6078-49de-bb34-f1cd8770385e") failed: Property not found. retry in 656.773371ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_44b8a2e7-6078-49de-bb34-f1cd8770385e
4652024-05-10T21:20:43.741ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_8749ab70-ffc4-4a3c-a81f-43992c9390ce") failed: Property not found. retry in 646.38572ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_8749ab70-ffc4-4a3c-a81f-43992c9390ce
4662024-05-10T21:20:44.035ZINFOSledAgent (ServiceManager): Ensuring bootstrap address fdb0:18c0:4d0d:a02a::2 exists in switch zone file = sled-agent/src/services.rs:2320
4672024-05-10T21:20:44.035ZINFOSledAgent (ServiceManager): Adding bootstrap address file = illumos-utils/src/running_zone.rs:626 zone = oxz_switch
4682024-05-10T21:20:44.150ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e564d557-0b19-497f-baac-984106980347") failed: Property not found. retry in 1.063832909s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_e564d557-0b19-497f-baac-984106980347
4692024-05-10T21:20:44.396ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_8749ab70-ffc4-4a3c-a81f-43992c9390ce") failed: Property not found. retry in 1.275914444s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_8749ab70-ffc4-4a3c-a81f-43992c9390ce
4702024-05-10T21:20:44.405ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_44b8a2e7-6078-49de-bb34-f1cd8770385e") failed: Property not found. retry in 1.11311774s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_44b8a2e7-6078-49de-bb34-f1cd8770385e
4712024-05-10T21:20:44.590ZINFOSledAgent (ServiceManager): Forwarding bootstrap traffic via oxBootstrap0 to fe80::8:20ff:fe5d:6d0b file = sled-agent/src/services.rs:2327
4722024-05-10T21:20:44.597ZINFOSledAgent (ServiceManager): Zone not using gateway (even though underlay is up) file = sled-agent/src/services.rs:2388
4732024-05-10T21:20:44.739ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2573
4742024-05-10T21:20:45.017ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2737
4752024-05-10T21:20:45.212ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2452
4762024-05-10T21:20:45.224ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e564d557-0b19-497f-baac-984106980347") failed: Property not found. retry in 998.017797ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_e564d557-0b19-497f-baac-984106980347
4772024-05-10T21:20:45.505ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2487
4782024-05-10T21:20:45.527ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_44b8a2e7-6078-49de-bb34-f1cd8770385e") failed: Property not found. retry in 995.797678ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_44b8a2e7-6078-49de-bb34-f1cd8770385e
4792024-05-10T21:20:45.680ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_8749ab70-ffc4-4a3c-a81f-43992c9390ce") failed: Property not found. retry in 1.221911123s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_8749ab70-ffc4-4a3c-a81f-43992c9390ce
4802024-05-10T21:20:45.699ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:2787
4812024-05-10T21:20:45.866ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:2814
4822024-05-10T21:20:46.067ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2681
4832024-05-10T21:20:46.231ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e564d557-0b19-497f-baac-984106980347") failed: Property not found. retry in 774.054745ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_e564d557-0b19-497f-baac-984106980347
4842024-05-10T21:20:46.232ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2481
4852024-05-10T21:20:46.241ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:3873 new = [fd00:1122:3344:101::2, ::1] old = [::1]
4862024-05-10T21:20:46.241ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:3889
4872024-05-10T21:20:46.241ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:609 zone = oxz_switch
4882024-05-10T21:20:46.532ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_44b8a2e7-6078-49de-bb34-f1cd8770385e") failed: Property not found. retry in 572.683814ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_44b8a2e7-6078-49de-bb34-f1cd8770385e
4892024-05-10T21:20:46.788ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:3897
4902024-05-10T21:20:46.794ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:3953
4912024-05-10T21:20:46.911ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_8749ab70-ffc4-4a3c-a81f-43992c9390ce") failed: Property not found. retry in 724.635362ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_8749ab70-ffc4-4a3c-a81f-43992c9390ce
4922024-05-10T21:20:46.927ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4015
4932024-05-10T21:20:47.015ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e564d557-0b19-497f-baac-984106980347") failed: Property not found. retry in 1.324193434s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_e564d557-0b19-497f-baac-984106980347
4942024-05-10T21:20:47.026ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:3996 rack_subnet = fd00:1122:3344::
4952024-05-10T21:20:47.047ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4043
4962024-05-10T21:20:47.115ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_44b8a2e7-6078-49de-bb34-f1cd8770385e") failed: Property not found. retry in 1.269355007s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_44b8a2e7-6078-49de-bb34-f1cd8770385e
4972024-05-10T21:20:47.147ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4070
4982024-05-10T21:20:47.271ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:365
4992024-05-10T21:20:47.303ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:413
5002024-05-10T21:20:47.334ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:651
5012024-05-10T21:20:47.334ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:689
5022024-05-10T21:20:47.334ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:692 uptime = 3
5032024-05-10T21:20:47.334ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.2.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: None,\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:435
5042024-05-10T21:20:47.412ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:381
5052024-05-10T21:20:47.412ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" }
5062024-05-10T21:20:47.412ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" }
5072024-05-10T21:20:47.412ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" }
5082024-05-10T21:20:47.412ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" }
5092024-05-10T21:20:47.412ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-M2" }
5102024-05-10T21:20:47.412ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-M2" }
5112024-05-10T21:20:47.412ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" }
5122024-05-10T21:20:47.412ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" }
5132024-05-10T21:20:47.412ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" }
5142024-05-10T21:20:47.412ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" }
5152024-05-10T21:20:47.412ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" }
5162024-05-10T21:20:47.412ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" }
5172024-05-10T21:20:47.412ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2" }
5182024-05-10T21:20:47.412ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2" }
5192024-05-10T21:20:47.412ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2" }
5202024-05-10T21:20:47.412ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2" }
5212024-05-10T21:20:47.412ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-6", model: "synthetic-model-U2" }
5222024-05-10T21:20:47.412ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-6", model: "synthetic-model-U2" }
5232024-05-10T21:20:47.412ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-7", model: "synthetic-model-U2" }
5242024-05-10T21:20:47.412ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-7", model: "synthetic-model-U2" }
5252024-05-10T21:20:47.412ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-8", model: "synthetic-model-U2" }
5262024-05-10T21:20:47.412ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-8", model: "synthetic-model-U2" }
5272024-05-10T21:20:47.645ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_8749ab70-ffc4-4a3c-a81f-43992c9390ce") failed: Property not found. retry in 575.976359ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_8749ab70-ffc4-4a3c-a81f-43992c9390ce
5282024-05-10T21:20:48.403ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_internal_dns_e564d557-0b19-497f-baac-984106980347
5292024-05-10T21:20:48.403ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_internal_dns_44b8a2e7-6078-49de-bb34-f1cd8770385e
5302024-05-10T21:20:48.403ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_internal_dns_8749ab70-ffc4-4a3c-a81f-43992c9390ce
5312024-05-10T21:20:48.403ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/6742bbd6-6bec-4f6b-94f3-002a53fc9f01/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
5322024-05-10T21:20:48.403ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/8becec77-7597-498a-9704-3ae75204e470/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
5332024-05-10T21:20:48.403ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 8657059 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:49411 req_id = c0d19ca3-40bc-4dde-9960-c17b87832425 response_code = 204 uri = /omicron-zones
5342024-05-10T21:20:48.405ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:547
5352024-05-10T21:20:48.685ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 65.092478ms) dns_config_addr = [fd00:1122:3344:1::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:1::1]:5353/config): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:567
5362024-05-10T21:20:48.776ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:547
5372024-05-10T21:20:48.829ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:547
5382024-05-10T21:20:48.885ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:583
5392024-05-10T21:20:48.885ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:259
5402024-05-10T21:20:48.918ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:276
5412024-05-10T21:20:48.920ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:301
5422024-05-10T21:20:48.920ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:193
5432024-05-10T21:20:48.949ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: 44b8a2e7-6078-49de-bb34-f1cd8770385e, underlay_address: fd00:1122:3344:1::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d7867297-5592-4803-bd09-620387b7253d (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 8749ab70-ffc4-4a3c-a81f-43992c9390ce, underlay_address: fd00:1122:3344:2::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7482ebc0-5237-4ab2-bef7-e62e772ad207 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: e564d557-0b19-497f-baac-984106980347, underlay_address: fd00:1122:3344:3::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 4a2a1aac-5879-491f-b914-3e863f8ce4c3 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 12f095cf-91fc-4467-a00b-f844a62e41df, underlay_address: fd00:1122:3344:101::1b, zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 60b2449c-6da3-4c31-b381-e580673eb0ae, kind: Service { id: 12f095cf-91fc-4467-a00b-f844a62e41df }, name: Name("ntp-12f095cf-91fc-4467-a00b-f844a62e41df"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 167])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.3.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:429 sled_address = [fd00:1122:3344:101::1]:12345
5442024-05-10T21:20:48.949ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56172
5452024-05-10T21:20:48.949ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 44b8a2e7-6078-49de-bb34-f1cd8770385e, dataset_name: DatasetName { pool_name: ZpoolName { id: d7867297-5592-4803-bd09-620387b7253d (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
5462024-05-10T21:20:48.949ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 44b8a2e7-6078-49de-bb34-f1cd8770385e, dataset_name: DatasetName { pool_name: ZpoolName { id: d7867297-5592-4803-bd09-620387b7253d (zpool), kind: External }, kind: InternalDns }, responder: ... }
5472024-05-10T21:20:48.971ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 8749ab70-ffc4-4a3c-a81f-43992c9390ce, dataset_name: DatasetName { pool_name: ZpoolName { id: 7482ebc0-5237-4ab2-bef7-e62e772ad207 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
5482024-05-10T21:20:48.971ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 8749ab70-ffc4-4a3c-a81f-43992c9390ce, dataset_name: DatasetName { pool_name: ZpoolName { id: 7482ebc0-5237-4ab2-bef7-e62e772ad207 (zpool), kind: External }, kind: InternalDns }, responder: ... }
5492024-05-10T21:20:48.991ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e564d557-0b19-497f-baac-984106980347, dataset_name: DatasetName { pool_name: ZpoolName { id: 4a2a1aac-5879-491f-b914-3e863f8ce4c3 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
5502024-05-10T21:20:48.991ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: e564d557-0b19-497f-baac-984106980347, dataset_name: DatasetName { pool_name: ZpoolName { id: 4a2a1aac-5879-491f-b914-3e863f8ce4c3 (zpool), kind: External }, kind: InternalDns }, responder: ... }
5512024-05-10T21:20:49.012ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
5522024-05-10T21:20:49.012ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/6742bbd6-6bec-4f6b-94f3-002a53fc9f01/config/omicron-zones.json file = common/src/ledger.rs:177
5532024-05-10T21:20:49.012ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8becec77-7597-498a-9704-3ae75204e470/config/omicron-zones.json file = common/src/ledger.rs:177
5542024-05-10T21:20:49.012ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
5552024-05-10T21:20:49.023ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:259
5562024-05-10T21:20:49.056ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:276
5572024-05-10T21:20:49.057ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:301
5582024-05-10T21:20:49.057ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:193
5592024-05-10T21:20:49.102ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:394 port = Port { inner: PortInner { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 202, 167]), slot: 0, vni: Vni { inner: 100 }, gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 }, vnic: "vopte0" } }
5602024-05-10T21:20:49.102ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1290 zone_type = ntp
5612024-05-10T21:20:49.102ZINFOSledAgent (ServiceManager): no nat entry found for: V4( Ipv4Network { addr: 10.151.2.169, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:102
5622024-05-10T21:20:49.102ZINFOSledAgent (ServiceManager): creating nat entry for: V4( Ipv4Network { addr: 10.151.2.169, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:109
5632024-05-10T21:20:49.103ZINFOSledAgent (ServiceManager): creation of nat entry successful for: V4( Ipv4Network { addr: 10.151.2.169, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:137
5642024-05-10T21:20:49.106ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
5652024-05-10T21:20:49.129ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_12f095cf-91fc-4467-a00b-f844a62e41df file = illumos-utils/src/zone.rs:315
5662024-05-10T21:20:49.147ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_12f095cf-91fc-4467-a00b-f844a62e41df file = illumos-utils/src/zone.rs:354
5672024-05-10T21:20:49.768ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_12f095cf-91fc-4467-a00b-f844a62e41df: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService4"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::1b"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value="fd00:1122:3344:100::/56"/> <propval type="boolean" name="boundary" value="true"/> <propval type="astring" name="server" value="0.pool.ntp.org"/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value="vopte0"/> <propval type="astring" name="gateway" value="172.30.3.1"/> <propval type="astring" name="ip" value="172.30.3.5"/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
5682024-05-10T21:20:49.768ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_ntp_12f095cf-91fc-4467-a00b-f844a62e41df
5692024-05-10T21:20:49.903ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_12f095cf-91fc-4467-a00b-f844a62e41df") failed: Property not found. retry in 38.23345ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_12f095cf-91fc-4467-a00b-f844a62e41df
5702024-05-10T21:20:49.951ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_12f095cf-91fc-4467-a00b-f844a62e41df") failed: Property not found. retry in 60.4761ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_12f095cf-91fc-4467-a00b-f844a62e41df
5712024-05-10T21:20:50.030ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_12f095cf-91fc-4467-a00b-f844a62e41df") failed: Property not found. retry in 147.282571ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_12f095cf-91fc-4467-a00b-f844a62e41df
5722024-05-10T21:20:50.189ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_12f095cf-91fc-4467-a00b-f844a62e41df") failed: Property not found. retry in 479.137824ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_12f095cf-91fc-4467-a00b-f844a62e41df
5732024-05-10T21:20:50.678ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_12f095cf-91fc-4467-a00b-f844a62e41df") failed: Property not found. retry in 642.971372ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_12f095cf-91fc-4467-a00b-f844a62e41df
5742024-05-10T21:20:50.785ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:63481
5752024-05-10T21:20:50.785ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 113 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:63481 req_id = a40a97d4-2591-47f3-9a2a-c1b04370af2b response_code = 200 uri = /baseboard
5762024-05-10T21:20:51.330ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_12f095cf-91fc-4467-a00b-f844a62e41df") failed: Property not found. retry in 1.283149856s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_12f095cf-91fc-4467-a00b-f844a62e41df
5772024-05-10T21:20:52.621ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_12f095cf-91fc-4467-a00b-f844a62e41df") failed: Property not found. retry in 904.892757ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_12f095cf-91fc-4467-a00b-f844a62e41df
5782024-05-10T21:20:53.536ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_12f095cf-91fc-4467-a00b-f844a62e41df") failed: Property not found. retry in 831.203549ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_12f095cf-91fc-4467-a00b-f844a62e41df
5792024-05-10T21:20:54.376ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_12f095cf-91fc-4467-a00b-f844a62e41df") failed: Property not found. retry in 1.193543999s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_12f095cf-91fc-4467-a00b-f844a62e41df
5802024-05-10T21:20:55.589ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_ntp_12f095cf-91fc-4467-a00b-f844a62e41df
5812024-05-10T21:20:55.589ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/6742bbd6-6bec-4f6b-94f3-002a53fc9f01/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
5822024-05-10T21:20:55.589ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/8becec77-7597-498a-9704-3ae75204e470/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
5832024-05-10T21:20:55.590ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 6640816 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:56172 req_id = 37c0b82a-896a-4a65-9278-8ef8daae8bc5 response_code = 204 uri = /omicron-zones
5842024-05-10T21:20:55.592ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:624
5852024-05-10T21:20:55.620ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:604
5862024-05-10T21:20:55.620ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43294
5872024-05-10T21:20:55.630ZINFOSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_12f095cf-91fc-4467-a00b-f844a62e41df': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3603
5882024-05-10T21:20:55.630ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:837 latency_us = 9320 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43294 req_id = 05e14541-3627-436a-b14b-0dc6dd2c77fa response_code = 500 uri = /timesync
5892024-05-10T21:20:55.633ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:654
5902024-05-10T21:20:55.756ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:604
5912024-05-10T21:20:55.757ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46086
5922024-05-10T21:20:59.765ZINFOSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_12f095cf-91fc-4467-a00b-f844a62e41df': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3603
5932024-05-10T21:20:59.765ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:837 latency_us = 4008483 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46086 req_id = d0c76969-41ef-4b70-bfc1-c63db91b5ebc response_code = 500 uri = /timesync
5942024-05-10T21:20:59.769ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:654
5952024-05-10T21:20:59.915ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:604
5962024-05-10T21:20:59.916ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39843
5972024-05-10T21:20:59.924ZINFOSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_12f095cf-91fc-4467-a00b-f844a62e41df': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3603
5982024-05-10T21:20:59.924ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:837 latency_us = 8792 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39843 req_id = 6ed6766f-b64c-412a-a8fa-f44e3286f0ef response_code = 500 uri = /timesync
5992024-05-10T21:20:59.927ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:654
6002024-05-10T21:21:00.029ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:604
6012024-05-10T21:21:00.029ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37100
6022024-05-10T21:21:04.039ZINFOSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_12f095cf-91fc-4467-a00b-f844a62e41df': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3603
6032024-05-10T21:21:04.039ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:837 latency_us = 4009421 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:37100 req_id = 24dbc955-45b1-425f-ae3d-221ab65bc470 response_code = 500 uri = /timesync
6042024-05-10T21:21:04.042ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:654
6052024-05-10T21:21:04.195ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:604
6062024-05-10T21:21:04.195ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34710
6072024-05-10T21:21:04.204ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 8502 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:34710 req_id = ae4ad18d-d178-497c-ad52-8254f352f47d response_code = 200 uri = /timesync
6082024-05-10T21:21:04.207ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:632
6092024-05-10T21:21:04.207ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:654
6102024-05-10T21:21:04.425ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:604
6112024-05-10T21:21:04.425ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60101
6122024-05-10T21:21:04.434ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 8375 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:60101 req_id = 21ee192e-709b-41e5-ac81-f813ef7fc471 response_code = 200 uri = /timesync
6132024-05-10T21:21:04.436ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:632
6142024-05-10T21:21:04.436ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:654
6152024-05-10T21:21:04.815ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:604
6162024-05-10T21:21:04.815ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61657
6172024-05-10T21:21:04.824ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 8498 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:61657 req_id = 1c2186ab-b896-40c8-bb87-e142a65dea95 response_code = 200 uri = /timesync
6182024-05-10T21:21:04.827ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:632
6192024-05-10T21:21:04.827ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:654
6202024-05-10T21:21:05.244ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:604
6212024-05-10T21:21:05.245ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40904
6222024-05-10T21:21:05.252ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 7600 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40904 req_id = 8c0581df-1be6-4963-9d27-cb2725258122 response_code = 200 uri = /timesync
6232024-05-10T21:21:05.254ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:632
6242024-05-10T21:21:05.254ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:654
6252024-05-10T21:21:06.320ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:604
6262024-05-10T21:21:06.320ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63404
6272024-05-10T21:21:06.322ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:801
6282024-05-10T21:21:06.328ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 7733 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:63404 req_id = 65de68b8-5130-4917-86c3-73c84299c46a response_code = 200 uri = /timesync
6292024-05-10T21:21:06.330ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:632
6302024-05-10T21:21:06.330ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:654
6312024-05-10T21:21:06.769ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:604
6322024-05-10T21:21:06.769ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62031
6332024-05-10T21:21:06.778ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 9069 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:62031 req_id = 8f16226c-58f7-448e-b0d3-acbb51d7d12b response_code = 200 uri = /timesync
6342024-05-10T21:21:06.780ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:632
6352024-05-10T21:21:06.780ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:654
6362024-05-10T21:21:07.309ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:604
6372024-05-10T21:21:07.309ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35039
6382024-05-10T21:21:07.318ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 8538 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:35039 req_id = 380f7644-a59e-4bcf-ba28-bfe93a9d1f05 response_code = 200 uri = /timesync
6392024-05-10T21:21:07.320ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:632
6402024-05-10T21:21:07.320ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:654
6412024-05-10T21:21:08.246ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:604
6422024-05-10T21:21:08.246ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51172
6432024-05-10T21:21:08.249ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:801
6442024-05-10T21:21:08.254ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 7647 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:51172 req_id = 6379b5f3-48af-418f-a842-db796d8f3d9b response_code = 200 uri = /timesync
6452024-05-10T21:21:08.255ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:632
6462024-05-10T21:21:08.255ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:654
6472024-05-10T21:21:09.071ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:604
6482024-05-10T21:21:09.071ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43131
6492024-05-10T21:21:09.079ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 8737 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43131 req_id = a126c71c-8739-4e56-b0f3-5200ee2a78c4 response_code = 200 uri = /timesync
6502024-05-10T21:21:09.083ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:632
6512024-05-10T21:21:09.083ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:654
6522024-05-10T21:21:09.176ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 250.004605ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:426 sled_id = 3ae06dcf-597c-4d18-b2d7-37c1f02096d7
6532024-05-10T21:21:10.167ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:604
6542024-05-10T21:21:10.167ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46207
6552024-05-10T21:21:10.175ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 7903 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46207 req_id = 79f8d9cd-2af7-44d1-868e-8798335523e3 response_code = 200 uri = /timesync
6562024-05-10T21:21:10.177ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:632
6572024-05-10T21:21:10.177ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:654
6582024-05-10T21:21:11.049ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:604
6592024-05-10T21:21:11.049ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44456
6602024-05-10T21:21:11.057ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 8044 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:44456 req_id = 3dfaf8fb-ceb3-4377-afbe-54b8d9164a28 response_code = 200 uri = /timesync
6612024-05-10T21:21:11.059ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:632
6622024-05-10T21:21:11.059ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:654
6632024-05-10T21:21:11.949ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:604
6642024-05-10T21:21:11.949ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36658
6652024-05-10T21:21:11.957ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 8042 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 9a0be2da-f90c-471c-b7d2-52f9bfef7f79 response_code = 200 uri = /timesync
6662024-05-10T21:21:11.959ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:632
6672024-05-10T21:21:11.959ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:654
6682024-05-10T21:21:13.347ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:604
6692024-05-10T21:21:13.347ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43243
6702024-05-10T21:21:13.356ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 8129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43243 req_id = be9212a4-ef8d-4cb1-b2e3-998a3e99218c response_code = 200 uri = /timesync
6712024-05-10T21:21:13.358ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:632
6722024-05-10T21:21:13.358ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:654
6732024-05-10T21:21:14.569ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:604
6742024-05-10T21:21:14.569ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54559
6752024-05-10T21:21:14.578ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 8291 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:54559 req_id = 181c2d7b-dfc4-4614-a854-6db19ccdb70c response_code = 200 uri = /timesync
6762024-05-10T21:21:14.581ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:632
6772024-05-10T21:21:14.581ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:654
6782024-05-10T21:21:15.855ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:604
6792024-05-10T21:21:15.855ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57389
6802024-05-10T21:21:15.859ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:801
6812024-05-10T21:21:15.864ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 8885 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:57389 req_id = cbfc9b85-613f-413f-bef1-2bf143122be1 response_code = 200 uri = /timesync
6822024-05-10T21:21:15.869ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:632
6832024-05-10T21:21:15.869ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:654
6842024-05-10T21:21:17.568ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:604
6852024-05-10T21:21:17.568ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56123
6862024-05-10T21:21:17.577ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 9235 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:56123 req_id = e9294f4b-ef73-4655-8714-fadaeb0ac7b2 response_code = 200 uri = /timesync
6872024-05-10T21:21:17.581ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:632
6882024-05-10T21:21:17.581ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:654
6892024-05-10T21:21:21.070ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:47480
6902024-05-10T21:21:21.070ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 53 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:47480 req_id = ce7f1a1e-88fa-494a-be9c-8a1c29639af8 response_code = 200 uri = /baseboard
6912024-05-10T21:21:21.785ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:604
6922024-05-10T21:21:21.785ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43801
6932024-05-10T21:21:21.794ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 9105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43801 req_id = 07dbcb9b-eb74-419f-aaeb-039759c945e2 response_code = 200 uri = /timesync
6942024-05-10T21:21:21.796ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:632
6952024-05-10T21:21:21.796ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:654
6962024-05-10T21:21:24.058ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 557.535885ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:426 sled_id = 3ae06dcf-597c-4d18-b2d7-37c1f02096d7
6972024-05-10T21:21:27.292ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:604
6982024-05-10T21:21:27.292ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64261
6992024-05-10T21:21:27.301ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 8618 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:64261 req_id = f0519c30-f414-48f3-affd-f1aea842f813 response_code = 200 uri = /timesync
7002024-05-10T21:21:27.303ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:632
7012024-05-10T21:21:27.303ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:654
7022024-05-10T21:21:33.722ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:604
7032024-05-10T21:21:33.722ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57431
7042024-05-10T21:21:33.732ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 9515 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:57431 req_id = cee67981-aa94-40e9-9468-98e3c845c983 response_code = 200 uri = /timesync
7052024-05-10T21:21:33.736ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:632
7062024-05-10T21:21:33.736ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:654
7072024-05-10T21:21:39.649ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 978.126924ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:426 sled_id = 3ae06dcf-597c-4d18-b2d7-37c1f02096d7
7082024-05-10T21:21:41.486ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:604
7092024-05-10T21:21:41.486ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45809
7102024-05-10T21:21:41.495ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 8974 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:45809 req_id = 373309ac-5c58-4180-8297-c779839aa96d response_code = 200 uri = /timesync
7112024-05-10T21:21:41.498ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:632
7122024-05-10T21:21:41.498ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:654
7132024-05-10T21:21:51.101ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:37372
7142024-05-10T21:21:51.101ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 51 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:37372 req_id = 38a4c4b6-1493-4e28-af42-fa06ff6df11d response_code = 200 uri = /baseboard
7152024-05-10T21:21:51.404ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:604
7162024-05-10T21:21:51.404ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56064
7172024-05-10T21:21:51.414ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 9236 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:56064 req_id = 76e980ec-aa68-462f-b11f-5649f71a00f4 response_code = 200 uri = /timesync
7182024-05-10T21:21:51.416ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:632
7192024-05-10T21:21:51.416ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:654
7202024-05-10T21:21:55.661ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.233199244s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:426 sled_id = 3ae06dcf-597c-4d18-b2d7-37c1f02096d7
7212024-05-10T21:21:56.227ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:604
7222024-05-10T21:21:56.227ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46878
7232024-05-10T21:21:56.236ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 8842 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46878 req_id = 86d3e943-c386-4177-9471-3ed3dc9de929 response_code = 200 uri = /timesync
7242024-05-10T21:21:56.239ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:632
7252024-05-10T21:21:56.239ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:654
7262024-05-10T21:22:10.167ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:604
7272024-05-10T21:22:10.167ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38943
7282024-05-10T21:22:10.175ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 8198 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:38943 req_id = a8eb1957-6b1d-423d-a6ec-4f8cd40ce9c4 response_code = 200 uri = /timesync
7292024-05-10T21:22:10.177ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:632
7302024-05-10T21:22:10.177ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:654
7312024-05-10T21:22:11.929ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 5.168986674s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:426 sled_id = 3ae06dcf-597c-4d18-b2d7-37c1f02096d7
7322024-05-10T21:22:21.158ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:39056
7332024-05-10T21:22:21.159ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 978 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:39056 req_id = 8d1de8da-2b08-43d0-94fc-a6ffe87048e4 response_code = 200 uri = /baseboard
7342024-05-10T21:22:23.468ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:604
7352024-05-10T21:22:23.468ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37682
7362024-05-10T21:22:23.478ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 9001 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:37682 req_id = 6eb7717d-bfc2-4831-9788-849f6d9a7ff4 response_code = 200 uri = /timesync
7372024-05-10T21:22:23.480ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.179656908 } file = sled-agent/src/rack_setup/service.rs:632
7382024-05-10T21:22:23.480ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:654
7392024-05-10T21:22:32.184ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 11.7040085s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:426 sled_id = 3ae06dcf-597c-4d18-b2d7-37c1f02096d7
7402024-05-10T21:22:42.544ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:604
7412024-05-10T21:22:42.544ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36904
7422024-05-10T21:22:42.554ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 9843 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:36904 req_id = 83297651-7630-4fc3-ae21-745a70101f1f response_code = 200 uri = /timesync
7432024-05-10T21:22:42.556ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380417, ip_addr: 162.159.200.1, stratum: 4, ref_time: 1715376151.022052, correction: 0.132375225 } file = sled-agent/src/rack_setup/service.rs:632
7442024-05-10T21:22:42.556ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:654
7452024-05-10T21:22:51.272ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:58253
7462024-05-10T21:22:51.273ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 611 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:58253 req_id = 3d7311ef-882a-4341-8cb8-d5389433090e response_code = 200 uri = /baseboard
7472024-05-10T21:22:58.994ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 16.369758416s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:426 sled_id = 3ae06dcf-597c-4d18-b2d7-37c1f02096d7
7482024-05-10T21:23:06.825ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:604
7492024-05-10T21:23:06.825ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60811
7502024-05-10T21:23:06.834ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 9259 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:60811 req_id = d28913c6-3edb-4e63-a9ca-ef700a7bc355 response_code = 200 uri = /timesync
7512024-05-10T21:23:06.837ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380417, ip_addr: 162.159.200.1, stratum: 4, ref_time: 1715376151.022052, correction: 0.066792235 } file = sled-agent/src/rack_setup/service.rs:632
7522024-05-10T21:23:06.837ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:654
7532024-05-10T21:23:21.389ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:37049
7542024-05-10T21:23:21.389ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 57 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:37049 req_id = 59c9903c-47a6-41b0-9c47-b598ff3171bc response_code = 200 uri = /baseboard
7552024-05-10T21:23:26.216ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:604
7562024-05-10T21:23:26.216ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50542
7572024-05-10T21:23:26.237ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 20872 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:50542 req_id = 765ee626-8020-4e1c-96e6-e843f3dcd456 response_code = 200 uri = /timesync
7582024-05-10T21:23:26.240ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 2728380417, ip_addr: 162.159.200.1, stratum: 4, ref_time: 1715376151.022052, correction: 0.014417998 } file = sled-agent/src/rack_setup/service.rs:632
7592024-05-10T21:23:26.240ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1215
7602024-05-10T21:23:26.269ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 44b8a2e7-6078-49de-bb34-f1cd8770385e, underlay_address: fd00:1122:3344:1::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d7867297-5592-4803-bd09-620387b7253d (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 8749ab70-ffc4-4a3c-a81f-43992c9390ce, underlay_address: fd00:1122:3344:2::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7482ebc0-5237-4ab2-bef7-e62e772ad207 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: e564d557-0b19-497f-baac-984106980347, underlay_address: fd00:1122:3344:3::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 4a2a1aac-5879-491f-b914-3e863f8ce4c3 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 12f095cf-91fc-4467-a00b-f844a62e41df, underlay_address: fd00:1122:3344:101::1b, zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 60b2449c-6da3-4c31-b381-e580673eb0ae, kind: Service { id: 12f095cf-91fc-4467-a00b-f844a62e41df }, name: Name("ntp-12f095cf-91fc-4467-a00b-f844a62e41df"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 167])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.3.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: c52561da-9d05-453c-a925-46f07565da34, underlay_address: fd00:1122:3344:101::3, zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d7867297-5592-4803-bd09-620387b7253d (zpool), kind: External } } } }, OmicronZoneConfig { id: db45a6d2-0a20-4573-a126-ed2d283f24e4, underlay_address: fd00:1122:3344:101::4, zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7482ebc0-5237-4ab2-bef7-e62e772ad207 (zpool), kind: External } } } }, OmicronZoneConfig { id: a2cd4e8c-b0bc-4abc-b5aa-cd2f5fa5c50b, underlay_address: fd00:1122:3344:101::5, zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 4a2a1aac-5879-491f-b914-3e863f8ce4c3 (zpool), kind: External } } } }, OmicronZoneConfig { id: 6eab11dd-aeb0-4b9e-8e67-be7999e15034, underlay_address: fd00:1122:3344:101::6, zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c20ef2f7-458a-4b20-ab01-0ef15666a084 (zpool), kind: External } } } }, OmicronZoneConfig { id: 8af4bac0-a438-4a21-a75f-3c43849b44ad, underlay_address: fd00:1122:3344:101::7, zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c78aa9ff-15c2-42ef-a938-4f9e1a276bc9 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:429 sled_address = [fd00:1122:3344:101::1]:12345
7612024-05-10T21:23:26.269ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33765
7622024-05-10T21:23:26.269ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 44b8a2e7-6078-49de-bb34-f1cd8770385e, dataset_name: DatasetName { pool_name: ZpoolName { id: d7867297-5592-4803-bd09-620387b7253d (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
7632024-05-10T21:23:26.269ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 44b8a2e7-6078-49de-bb34-f1cd8770385e, dataset_name: DatasetName { pool_name: ZpoolName { id: d7867297-5592-4803-bd09-620387b7253d (zpool), kind: External }, kind: InternalDns }, responder: ... }
7642024-05-10T21:23:26.288ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 8749ab70-ffc4-4a3c-a81f-43992c9390ce, dataset_name: DatasetName { pool_name: ZpoolName { id: 7482ebc0-5237-4ab2-bef7-e62e772ad207 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
7652024-05-10T21:23:26.288ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 8749ab70-ffc4-4a3c-a81f-43992c9390ce, dataset_name: DatasetName { pool_name: ZpoolName { id: 7482ebc0-5237-4ab2-bef7-e62e772ad207 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7662024-05-10T21:23:26.306ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e564d557-0b19-497f-baac-984106980347, dataset_name: DatasetName { pool_name: ZpoolName { id: 4a2a1aac-5879-491f-b914-3e863f8ce4c3 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
7672024-05-10T21:23:26.306ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: e564d557-0b19-497f-baac-984106980347, dataset_name: DatasetName { pool_name: ZpoolName { id: 4a2a1aac-5879-491f-b914-3e863f8ce4c3 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7682024-05-10T21:23:26.326ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c52561da-9d05-453c-a925-46f07565da34, dataset_name: DatasetName { pool_name: ZpoolName { id: d7867297-5592-4803-bd09-620387b7253d (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
7692024-05-10T21:23:26.326ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: c52561da-9d05-453c-a925-46f07565da34, dataset_name: DatasetName { pool_name: ZpoolName { id: d7867297-5592-4803-bd09-620387b7253d (zpool), kind: External }, kind: CockroachDb }, responder: ... }
7702024-05-10T21:23:26.388ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: db45a6d2-0a20-4573-a126-ed2d283f24e4, dataset_name: DatasetName { pool_name: ZpoolName { id: 7482ebc0-5237-4ab2-bef7-e62e772ad207 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
7712024-05-10T21:23:26.388ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: db45a6d2-0a20-4573-a126-ed2d283f24e4, dataset_name: DatasetName { pool_name: ZpoolName { id: 7482ebc0-5237-4ab2-bef7-e62e772ad207 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
7722024-05-10T21:23:26.449ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: a2cd4e8c-b0bc-4abc-b5aa-cd2f5fa5c50b, dataset_name: DatasetName { pool_name: ZpoolName { id: 4a2a1aac-5879-491f-b914-3e863f8ce4c3 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
7732024-05-10T21:23:26.449ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: a2cd4e8c-b0bc-4abc-b5aa-cd2f5fa5c50b, dataset_name: DatasetName { pool_name: ZpoolName { id: 4a2a1aac-5879-491f-b914-3e863f8ce4c3 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
7742024-05-10T21:23:26.512ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 6eab11dd-aeb0-4b9e-8e67-be7999e15034, dataset_name: DatasetName { pool_name: ZpoolName { id: c20ef2f7-458a-4b20-ab01-0ef15666a084 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
7752024-05-10T21:23:26.512ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 6eab11dd-aeb0-4b9e-8e67-be7999e15034, dataset_name: DatasetName { pool_name: ZpoolName { id: c20ef2f7-458a-4b20-ab01-0ef15666a084 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
7762024-05-10T21:23:26.571ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 8af4bac0-a438-4a21-a75f-3c43849b44ad, dataset_name: DatasetName { pool_name: ZpoolName { id: c78aa9ff-15c2-42ef-a938-4f9e1a276bc9 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
7772024-05-10T21:23:26.571ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 8af4bac0-a438-4a21-a75f-3c43849b44ad, dataset_name: DatasetName { pool_name: ZpoolName { id: c78aa9ff-15c2-42ef-a938-4f9e1a276bc9 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
7782024-05-10T21:23:26.632ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
7792024-05-10T21:23:26.632ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/6742bbd6-6bec-4f6b-94f3-002a53fc9f01/config/omicron-zones.json file = common/src/ledger.rs:177
7802024-05-10T21:23:26.633ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8becec77-7597-498a-9704-3ae75204e470/config/omicron-zones.json file = common/src/ledger.rs:177
7812024-05-10T21:23:26.633ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
7822024-05-10T21:23:26.717ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
7832024-05-10T21:23:26.717ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
7842024-05-10T21:23:26.717ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
7852024-05-10T21:23:26.717ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
7862024-05-10T21:23:26.717ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
7872024-05-10T21:23:26.809ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_a2cd4e8c-b0bc-4abc-b5aa-cd2f5fa5c50b file = illumos-utils/src/zone.rs:315
7882024-05-10T21:23:26.813ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_db45a6d2-0a20-4573-a126-ed2d283f24e4 file = illumos-utils/src/zone.rs:315
7892024-05-10T21:23:26.817ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_6eab11dd-aeb0-4b9e-8e67-be7999e15034 file = illumos-utils/src/zone.rs:315
7902024-05-10T21:23:26.821ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_8af4bac0-a438-4a21-a75f-3c43849b44ad file = illumos-utils/src/zone.rs:315
7912024-05-10T21:23:26.825ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_c52561da-9d05-453c-a925-46f07565da34 file = illumos-utils/src/zone.rs:315
7922024-05-10T21:23:26.830ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_a2cd4e8c-b0bc-4abc-b5aa-cd2f5fa5c50b file = illumos-utils/src/zone.rs:354
7932024-05-10T21:23:26.834ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_db45a6d2-0a20-4573-a126-ed2d283f24e4 file = illumos-utils/src/zone.rs:354
7942024-05-10T21:23:26.839ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_6eab11dd-aeb0-4b9e-8e67-be7999e15034 file = illumos-utils/src/zone.rs:354
7952024-05-10T21:23:26.844ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_8af4bac0-a438-4a21-a75f-3c43849b44ad file = illumos-utils/src/zone.rs:354
7962024-05-10T21:23:26.848ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_c52561da-9d05-453c-a925-46f07565da34 file = illumos-utils/src/zone.rs:354
7972024-05-10T21:23:29.644ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_c52561da-9d05-453c-a925-46f07565da34: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService9"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::3"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::3"/> <propval type="astring" name="listen_port" value="32221"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7982024-05-10T21:23:29.644ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_cockroachdb_c52561da-9d05-453c-a925-46f07565da34
7992024-05-10T21:23:29.653ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_6eab11dd-aeb0-4b9e-8e67-be7999e15034: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService7"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::6"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::6"/> <propval type="astring" name="listen_port" value="32221"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8002024-05-10T21:23:29.653ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_cockroachdb_6eab11dd-aeb0-4b9e-8e67-be7999e15034
8012024-05-10T21:23:29.683ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_8af4bac0-a438-4a21-a75f-3c43849b44ad: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService8"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::7"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::7"/> <propval type="astring" name="listen_port" value="32221"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8022024-05-10T21:23:29.683ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_cockroachdb_8af4bac0-a438-4a21-a75f-3c43849b44ad
8032024-05-10T21:23:29.760ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_a2cd4e8c-b0bc-4abc-b5aa-cd2f5fa5c50b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService5"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::5"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::5"/> <propval type="astring" name="listen_port" value="32221"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8042024-05-10T21:23:29.760ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_cockroachdb_a2cd4e8c-b0bc-4abc-b5aa-cd2f5fa5c50b
8052024-05-10T21:23:29.769ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_db45a6d2-0a20-4573-a126-ed2d283f24e4: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService6"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::4"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::4"/> <propval type="astring" name="listen_port" value="32221"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8062024-05-10T21:23:29.769ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_cockroachdb_db45a6d2-0a20-4573-a126-ed2d283f24e4
8072024-05-10T21:23:29.798ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6eab11dd-aeb0-4b9e-8e67-be7999e15034") failed: Property not found. retry in 25.743632ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6eab11dd-aeb0-4b9e-8e67-be7999e15034
8082024-05-10T21:23:29.806ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c52561da-9d05-453c-a925-46f07565da34") failed: Property not found. retry in 43.158303ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c52561da-9d05-453c-a925-46f07565da34
8092024-05-10T21:23:29.823ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8af4bac0-a438-4a21-a75f-3c43849b44ad") failed: Property not found. retry in 63.743791ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8af4bac0-a438-4a21-a75f-3c43849b44ad
8102024-05-10T21:23:29.832ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6eab11dd-aeb0-4b9e-8e67-be7999e15034") failed: Property not found. retry in 91.389043ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6eab11dd-aeb0-4b9e-8e67-be7999e15034
8112024-05-10T21:23:29.858ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c52561da-9d05-453c-a925-46f07565da34") failed: Property not found. retry in 138.999872ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c52561da-9d05-453c-a925-46f07565da34
8122024-05-10T21:23:29.924ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8af4bac0-a438-4a21-a75f-3c43849b44ad") failed: Property not found. retry in 91.489513ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8af4bac0-a438-4a21-a75f-3c43849b44ad
8132024-05-10T21:23:30.125ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6eab11dd-aeb0-4b9e-8e67-be7999e15034") failed: Property not found. retry in 230.069059ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6eab11dd-aeb0-4b9e-8e67-be7999e15034
8142024-05-10T21:23:30.586ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 16.371397999s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:426 sled_id = 3ae06dcf-597c-4d18-b2d7-37c1f02096d7
8152024-05-10T21:23:30.744ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8af4bac0-a438-4a21-a75f-3c43849b44ad") failed: Property not found. retry in 142.827924ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8af4bac0-a438-4a21-a75f-3c43849b44ad
8162024-05-10T21:23:31.194ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c52561da-9d05-453c-a925-46f07565da34") failed: Property not found. retry in 239.530764ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c52561da-9d05-453c-a925-46f07565da34
8172024-05-10T21:23:31.257ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a2cd4e8c-b0bc-4abc-b5aa-cd2f5fa5c50b") failed: Property not found. retry in 31.606523ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a2cd4e8c-b0bc-4abc-b5aa-cd2f5fa5c50b
8182024-05-10T21:23:31.352ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_db45a6d2-0a20-4573-a126-ed2d283f24e4") failed: Property not found. retry in 73.855058ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_db45a6d2-0a20-4573-a126-ed2d283f24e4
8192024-05-10T21:23:31.400ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6eab11dd-aeb0-4b9e-8e67-be7999e15034") failed: Property not found. retry in 441.98359ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6eab11dd-aeb0-4b9e-8e67-be7999e15034
8202024-05-10T21:23:31.495ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8af4bac0-a438-4a21-a75f-3c43849b44ad") failed: Property not found. retry in 392.670354ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8af4bac0-a438-4a21-a75f-3c43849b44ad
8212024-05-10T21:23:31.523ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c52561da-9d05-453c-a925-46f07565da34") failed: Property not found. retry in 358.091431ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c52561da-9d05-453c-a925-46f07565da34
8222024-05-10T21:23:31.544ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a2cd4e8c-b0bc-4abc-b5aa-cd2f5fa5c50b") failed: Property not found. retry in 104.189201ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a2cd4e8c-b0bc-4abc-b5aa-cd2f5fa5c50b
8232024-05-10T21:23:31.590ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_db45a6d2-0a20-4573-a126-ed2d283f24e4") failed: Property not found. retry in 134.288966ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_db45a6d2-0a20-4573-a126-ed2d283f24e4
8242024-05-10T21:23:31.682ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a2cd4e8c-b0bc-4abc-b5aa-cd2f5fa5c50b") failed: Property not found. retry in 220.857009ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a2cd4e8c-b0bc-4abc-b5aa-cd2f5fa5c50b
8252024-05-10T21:23:31.750ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_db45a6d2-0a20-4573-a126-ed2d283f24e4") failed: Property not found. retry in 142.793235ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_db45a6d2-0a20-4573-a126-ed2d283f24e4
8262024-05-10T21:23:31.888ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6eab11dd-aeb0-4b9e-8e67-be7999e15034") failed: Property not found. retry in 525.126652ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6eab11dd-aeb0-4b9e-8e67-be7999e15034
8272024-05-10T21:23:31.933ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c52561da-9d05-453c-a925-46f07565da34") failed: Property not found. retry in 748.74612ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c52561da-9d05-453c-a925-46f07565da34
8282024-05-10T21:23:31.982ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a2cd4e8c-b0bc-4abc-b5aa-cd2f5fa5c50b") failed: Property not found. retry in 575.180837ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a2cd4e8c-b0bc-4abc-b5aa-cd2f5fa5c50b
8292024-05-10T21:23:32.029ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_db45a6d2-0a20-4573-a126-ed2d283f24e4") failed: Property not found. retry in 201.05912ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_db45a6d2-0a20-4573-a126-ed2d283f24e4
8302024-05-10T21:23:32.061ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8af4bac0-a438-4a21-a75f-3c43849b44ad") failed: Property not found. retry in 657.387245ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8af4bac0-a438-4a21-a75f-3c43849b44ad
8312024-05-10T21:23:32.249ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_db45a6d2-0a20-4573-a126-ed2d283f24e4") failed: Property not found. retry in 937.153998ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_db45a6d2-0a20-4573-a126-ed2d283f24e4
8322024-05-10T21:23:32.432ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6eab11dd-aeb0-4b9e-8e67-be7999e15034") failed: Property not found. retry in 1.115525436s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6eab11dd-aeb0-4b9e-8e67-be7999e15034
8332024-05-10T21:23:32.569ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a2cd4e8c-b0bc-4abc-b5aa-cd2f5fa5c50b") failed: Property not found. retry in 738.830858ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a2cd4e8c-b0bc-4abc-b5aa-cd2f5fa5c50b
8342024-05-10T21:23:32.693ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c52561da-9d05-453c-a925-46f07565da34") failed: Property not found. retry in 952.56006ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c52561da-9d05-453c-a925-46f07565da34
8352024-05-10T21:23:32.735ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8af4bac0-a438-4a21-a75f-3c43849b44ad") failed: Property not found. retry in 1.483244187s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8af4bac0-a438-4a21-a75f-3c43849b44ad
8362024-05-10T21:23:33.194ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_db45a6d2-0a20-4573-a126-ed2d283f24e4") failed: Property not found. retry in 1.496371074s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_db45a6d2-0a20-4573-a126-ed2d283f24e4
8372024-05-10T21:23:33.317ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a2cd4e8c-b0bc-4abc-b5aa-cd2f5fa5c50b") failed: Property not found. retry in 1.468164365s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a2cd4e8c-b0bc-4abc-b5aa-cd2f5fa5c50b
8382024-05-10T21:23:33.557ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6eab11dd-aeb0-4b9e-8e67-be7999e15034") failed: Property not found. retry in 1.045031036s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6eab11dd-aeb0-4b9e-8e67-be7999e15034
8392024-05-10T21:23:33.654ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c52561da-9d05-453c-a925-46f07565da34") failed: Property not found. retry in 854.557645ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c52561da-9d05-453c-a925-46f07565da34
8402024-05-10T21:23:34.234ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8af4bac0-a438-4a21-a75f-3c43849b44ad") failed: Property not found. retry in 979.691701ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8af4bac0-a438-4a21-a75f-3c43849b44ad
8412024-05-10T21:23:34.531ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c52561da-9d05-453c-a925-46f07565da34") failed: Property not found. retry in 916.118102ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c52561da-9d05-453c-a925-46f07565da34
8422024-05-10T21:23:34.615ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6eab11dd-aeb0-4b9e-8e67-be7999e15034") failed: Property not found. retry in 1.447893266s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6eab11dd-aeb0-4b9e-8e67-be7999e15034
8432024-05-10T21:23:34.700ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_db45a6d2-0a20-4573-a126-ed2d283f24e4") failed: Property not found. retry in 1.09291351s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_db45a6d2-0a20-4573-a126-ed2d283f24e4
8442024-05-10T21:23:34.797ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a2cd4e8c-b0bc-4abc-b5aa-cd2f5fa5c50b") failed: Property not found. retry in 1.267393618s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a2cd4e8c-b0bc-4abc-b5aa-cd2f5fa5c50b
8452024-05-10T21:23:35.223ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8af4bac0-a438-4a21-a75f-3c43849b44ad") failed: Property not found. retry in 757.749784ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8af4bac0-a438-4a21-a75f-3c43849b44ad
8462024-05-10T21:23:35.460ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c52561da-9d05-453c-a925-46f07565da34") failed: Property not found. retry in 1.099938178s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c52561da-9d05-453c-a925-46f07565da34
8472024-05-10T21:23:35.803ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_db45a6d2-0a20-4573-a126-ed2d283f24e4") failed: Property not found. retry in 661.152386ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_db45a6d2-0a20-4573-a126-ed2d283f24e4
8482024-05-10T21:23:35.990ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8af4bac0-a438-4a21-a75f-3c43849b44ad") failed: Property not found. retry in 1.200016465s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8af4bac0-a438-4a21-a75f-3c43849b44ad
8492024-05-10T21:23:36.072ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6eab11dd-aeb0-4b9e-8e67-be7999e15034") failed: Property not found. retry in 1.288668521s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6eab11dd-aeb0-4b9e-8e67-be7999e15034
8502024-05-10T21:23:36.079ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a2cd4e8c-b0bc-4abc-b5aa-cd2f5fa5c50b") failed: Property not found. retry in 1.466009914s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a2cd4e8c-b0bc-4abc-b5aa-cd2f5fa5c50b
8512024-05-10T21:23:36.474ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_db45a6d2-0a20-4573-a126-ed2d283f24e4") failed: Property not found. retry in 1.185703872s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_db45a6d2-0a20-4573-a126-ed2d283f24e4
8522024-05-10T21:23:36.570ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c52561da-9d05-453c-a925-46f07565da34") failed: Property not found. retry in 552.125317ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c52561da-9d05-453c-a925-46f07565da34
8532024-05-10T21:23:37.132ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c52561da-9d05-453c-a925-46f07565da34") failed: Property not found. retry in 1.427436239s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c52561da-9d05-453c-a925-46f07565da34
8542024-05-10T21:23:37.199ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8af4bac0-a438-4a21-a75f-3c43849b44ad") failed: Property not found. retry in 1.401261588s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8af4bac0-a438-4a21-a75f-3c43849b44ad
8552024-05-10T21:23:37.370ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6eab11dd-aeb0-4b9e-8e67-be7999e15034") failed: Property not found. retry in 1.416683302s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6eab11dd-aeb0-4b9e-8e67-be7999e15034
8562024-05-10T21:23:37.554ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a2cd4e8c-b0bc-4abc-b5aa-cd2f5fa5c50b") failed: Property not found. retry in 1.205840615s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a2cd4e8c-b0bc-4abc-b5aa-cd2f5fa5c50b
8572024-05-10T21:23:37.669ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_db45a6d2-0a20-4573-a126-ed2d283f24e4") failed: Property not found. retry in 1.118926115s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_db45a6d2-0a20-4573-a126-ed2d283f24e4
8582024-05-10T21:23:38.829ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_cockroachdb_a2cd4e8c-b0bc-4abc-b5aa-cd2f5fa5c50b
8592024-05-10T21:23:38.829ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_cockroachdb_db45a6d2-0a20-4573-a126-ed2d283f24e4
8602024-05-10T21:23:38.829ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_cockroachdb_6eab11dd-aeb0-4b9e-8e67-be7999e15034
8612024-05-10T21:23:38.829ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_cockroachdb_8af4bac0-a438-4a21-a75f-3c43849b44ad
8622024-05-10T21:23:38.829ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_cockroachdb_c52561da-9d05-453c-a925-46f07565da34
8632024-05-10T21:23:38.829ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/6742bbd6-6bec-4f6b-94f3-002a53fc9f01/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8642024-05-10T21:23:38.830ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/8becec77-7597-498a-9704-3ae75204e470/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8652024-05-10T21:23:38.830ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 12545873 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:33765 req_id = 2b0c3420-810e-423e-973c-80df6eb250a8 response_code = 204 uri = /omicron-zones
8662024-05-10T21:23:38.866ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52693
8672024-05-10T21:23:38.900ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::6]:32221 file = sled-agent/src/services.rs:3437
8682024-05-10T21:23:47.636ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3455
8692024-05-10T21:23:51.289ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3478
8702024-05-10T21:23:51.291ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 12425317 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:52693 req_id = d560aa34-98ec-4636-8ca1-c3bd31583ec2 response_code = 204 uri = /cockroachdb
8712024-05-10T21:23:51.368ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: 44b8a2e7-6078-49de-bb34-f1cd8770385e, underlay_address: fd00:1122:3344:1::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d7867297-5592-4803-bd09-620387b7253d (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 8749ab70-ffc4-4a3c-a81f-43992c9390ce, underlay_address: fd00:1122:3344:2::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7482ebc0-5237-4ab2-bef7-e62e772ad207 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: e564d557-0b19-497f-baac-984106980347, underlay_address: fd00:1122:3344:3::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 4a2a1aac-5879-491f-b914-3e863f8ce4c3 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 12f095cf-91fc-4467-a00b-f844a62e41df, underlay_address: fd00:1122:3344:101::1b, zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 60b2449c-6da3-4c31-b381-e580673eb0ae, kind: Service { id: 12f095cf-91fc-4467-a00b-f844a62e41df }, name: Name("ntp-12f095cf-91fc-4467-a00b-f844a62e41df"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 167])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.3.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: c52561da-9d05-453c-a925-46f07565da34, underlay_address: fd00:1122:3344:101::3, zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d7867297-5592-4803-bd09-620387b7253d (zpool), kind: External } } } }, OmicronZoneConfig { id: db45a6d2-0a20-4573-a126-ed2d283f24e4, underlay_address: fd00:1122:3344:101::4, zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7482ebc0-5237-4ab2-bef7-e62e772ad207 (zpool), kind: External } } } }, OmicronZoneConfig { id: a2cd4e8c-b0bc-4abc-b5aa-cd2f5fa5c50b, underlay_address: fd00:1122:3344:101::5, zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 4a2a1aac-5879-491f-b914-3e863f8ce4c3 (zpool), kind: External } } } }, OmicronZoneConfig { id: 6eab11dd-aeb0-4b9e-8e67-be7999e15034, underlay_address: fd00:1122:3344:101::6, zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c20ef2f7-458a-4b20-ab01-0ef15666a084 (zpool), kind: External } } } }, OmicronZoneConfig { id: 8af4bac0-a438-4a21-a75f-3c43849b44ad, underlay_address: fd00:1122:3344:101::7, zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c78aa9ff-15c2-42ef-a938-4f9e1a276bc9 (zpool), kind: External } } } }, OmicronZoneConfig { id: 7325b560-f7aa-4399-a6c6-a3322f42d759, underlay_address: fd00:1122:3344:101::8, zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d7867297-5592-4803-bd09-620387b7253d (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.2.164:53, nic: NetworkInterface { id: 9f5600e8-2094-4425-bdd8-3005882ee50f, kind: Service { id: 7325b560-f7aa-4399-a6c6-a3322f42d759 }, name: Name("external-dns-7325b560-f7aa-4399-a6c6-a3322f42d759"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 190])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.1.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 } } }, OmicronZoneConfig { id: e03d4432-8b77-4406-904d-ebd71cc9739e, underlay_address: fd00:1122:3344:101::9, zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7482ebc0-5237-4ab2-bef7-e62e772ad207 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.2.165:53, nic: NetworkInterface { id: 3076c844-8a4f-4e23-8343-ae2edafd59bc, kind: Service { id: e03d4432-8b77-4406-904d-ebd71cc9739e }, name: Name("external-dns-e03d4432-8b77-4406-904d-ebd71cc9739e"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 130, 3])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.1.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 } } }, OmicronZoneConfig { id: 2fc7758a-cae3-4d9b-ade9-3a7691598581, underlay_address: fd00:1122:3344:101::a, zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.2.166, nic: NetworkInterface { id: 6768c786-a56a-479c-a1a1-b0566791d10c, kind: Service { id: 2fc7758a-cae3-4d9b-ade9-3a7691598581 }, name: Name("nexus-2fc7758a-cae3-4d9b-ade9-3a7691598581"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 85])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 7bb2217a-5bab-47ca-8e9e-29f166894592, underlay_address: fd00:1122:3344:101::b, zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.2.167, nic: NetworkInterface { id: a28a0581-77ae-4cf2-b9a8-382fafb05295, kind: Service { id: 7bb2217a-5bab-47ca-8e9e-29f166894592 }, name: Name("nexus-7bb2217a-5bab-47ca-8e9e-29f166894592"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 221])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: dd46fcb1-c07b-4880-9112-3895f2df61ed, underlay_address: fd00:1122:3344:101::c, zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.2.168, nic: NetworkInterface { id: 476144d9-7af0-48ae-ae6d-f7b1547a9af0, kind: Service { id: dd46fcb1-c07b-4880-9112-3895f2df61ed }, name: Name("nexus-dd46fcb1-c07b-4880-9112-3895f2df61ed"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 134, 174])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 95738557-5fbe-4760-a2f5-e295833eb800, underlay_address: fd00:1122:3344:101::d, zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: 207101fa-3f8f-4bbb-a8c0-4f0407f828e8, underlay_address: fd00:1122:3344:101::e, zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d7867297-5592-4803-bd09-620387b7253d (zpool), kind: External } } } }, OmicronZoneConfig { id: d7314b67-85b3-4c30-acfc-5e9dff5e5939, underlay_address: fd00:1122:3344:101::f, zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: 996b624d-00ef-4678-8cfa-ad052b261509, underlay_address: fd00:1122:3344:101::10, zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: 0af3291d-7808-448b-a5ec-68ea6a4730ef, underlay_address: fd00:1122:3344:101::11, zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: ada61d89-35f2-4021-829f-0d604c91d0ff, underlay_address: fd00:1122:3344:101::12, zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d7867297-5592-4803-bd09-620387b7253d (zpool), kind: External } } } }, OmicronZoneConfig { id: 5c09bf7a-54dd-4d4c-bdd3-12884bf29927, underlay_address: fd00:1122:3344:101::13, zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7482ebc0-5237-4ab2-bef7-e62e772ad207 (zpool), kind: External } } } }, OmicronZoneConfig { id: 101e94eb-79e6-493c-8bba-b631934a03b9, underlay_address: fd00:1122:3344:101::14, zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 4a2a1aac-5879-491f-b914-3e863f8ce4c3 (zpool), kind: External } } } }, OmicronZoneConfig { id: b473a0f3-4103-4d03-9647-a8361e344d97, underlay_address: fd00:1122:3344:101::15, zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c20ef2f7-458a-4b20-ab01-0ef15666a084 (zpool), kind: External } } } }, OmicronZoneConfig { id: 66d05714-044e-4478-a42e-018c12715d96, underlay_address: fd00:1122:3344:101::16, zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c78aa9ff-15c2-42ef-a938-4f9e1a276bc9 (zpool), kind: External } } } }, OmicronZoneConfig { id: 06efb5f5-bb93-4e71-b8a9-60f655f78031, underlay_address: fd00:1122:3344:101::17, zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b315123f-de7f-4c95-94ec-6ebbaf4bb37f (zpool), kind: External } } } }, OmicronZoneConfig { id: c1dcad46-3d8d-4678-899a-efb74ec83395, underlay_address: fd00:1122:3344:101::18, zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: be007fc9-c18b-4eb9-b039-d1acd6258caa (zpool), kind: External } } } }, OmicronZoneConfig { id: 4fdb69f7-0af6-40d3-9922-f38ae4f0f54b, underlay_address: fd00:1122:3344:101::19, zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d1ca4b9b-c237-46f9-b5f2-dacd6333114b (zpool), kind: External } } } }, OmicronZoneConfig { id: d6578850-a802-4381-b533-4fb297487a8f, underlay_address: fd00:1122:3344:101::1a, zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6827078d-a479-42be-8ba6-18589f19cebd (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:429 sled_address = [fd00:1122:3344:101::1]:12345
8722024-05-10T21:23:51.368ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43378
8732024-05-10T21:23:51.370ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 44b8a2e7-6078-49de-bb34-f1cd8770385e, dataset_name: DatasetName { pool_name: ZpoolName { id: d7867297-5592-4803-bd09-620387b7253d (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
8742024-05-10T21:23:51.370ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 44b8a2e7-6078-49de-bb34-f1cd8770385e, dataset_name: DatasetName { pool_name: ZpoolName { id: d7867297-5592-4803-bd09-620387b7253d (zpool), kind: External }, kind: InternalDns }, responder: ... }
8752024-05-10T21:23:51.397ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 8749ab70-ffc4-4a3c-a81f-43992c9390ce, dataset_name: DatasetName { pool_name: ZpoolName { id: 7482ebc0-5237-4ab2-bef7-e62e772ad207 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
8762024-05-10T21:23:51.397ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 8749ab70-ffc4-4a3c-a81f-43992c9390ce, dataset_name: DatasetName { pool_name: ZpoolName { id: 7482ebc0-5237-4ab2-bef7-e62e772ad207 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8772024-05-10T21:23:51.418ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e564d557-0b19-497f-baac-984106980347, dataset_name: DatasetName { pool_name: ZpoolName { id: 4a2a1aac-5879-491f-b914-3e863f8ce4c3 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
8782024-05-10T21:23:51.418ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: e564d557-0b19-497f-baac-984106980347, dataset_name: DatasetName { pool_name: ZpoolName { id: 4a2a1aac-5879-491f-b914-3e863f8ce4c3 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8792024-05-10T21:23:51.439ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c52561da-9d05-453c-a925-46f07565da34, dataset_name: DatasetName { pool_name: ZpoolName { id: d7867297-5592-4803-bd09-620387b7253d (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
8802024-05-10T21:23:51.439ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: c52561da-9d05-453c-a925-46f07565da34, dataset_name: DatasetName { pool_name: ZpoolName { id: d7867297-5592-4803-bd09-620387b7253d (zpool), kind: External }, kind: CockroachDb }, responder: ... }
8812024-05-10T21:23:51.460ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: db45a6d2-0a20-4573-a126-ed2d283f24e4, dataset_name: DatasetName { pool_name: ZpoolName { id: 7482ebc0-5237-4ab2-bef7-e62e772ad207 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
8822024-05-10T21:23:51.460ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: db45a6d2-0a20-4573-a126-ed2d283f24e4, dataset_name: DatasetName { pool_name: ZpoolName { id: 7482ebc0-5237-4ab2-bef7-e62e772ad207 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
8832024-05-10T21:23:51.463ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:36933
8842024-05-10T21:23:51.463ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 438 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:36933 req_id = c21712f6-fd12-4312-8c49-d754262f93c7 response_code = 200 uri = /baseboard
8852024-05-10T21:23:51.479ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: a2cd4e8c-b0bc-4abc-b5aa-cd2f5fa5c50b, dataset_name: DatasetName { pool_name: ZpoolName { id: 4a2a1aac-5879-491f-b914-3e863f8ce4c3 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
8862024-05-10T21:23:51.479ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: a2cd4e8c-b0bc-4abc-b5aa-cd2f5fa5c50b, dataset_name: DatasetName { pool_name: ZpoolName { id: 4a2a1aac-5879-491f-b914-3e863f8ce4c3 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
8872024-05-10T21:23:51.499ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 6eab11dd-aeb0-4b9e-8e67-be7999e15034, dataset_name: DatasetName { pool_name: ZpoolName { id: c20ef2f7-458a-4b20-ab01-0ef15666a084 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
8882024-05-10T21:23:51.499ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 6eab11dd-aeb0-4b9e-8e67-be7999e15034, dataset_name: DatasetName { pool_name: ZpoolName { id: c20ef2f7-458a-4b20-ab01-0ef15666a084 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
8892024-05-10T21:23:51.517ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 8af4bac0-a438-4a21-a75f-3c43849b44ad, dataset_name: DatasetName { pool_name: ZpoolName { id: c78aa9ff-15c2-42ef-a938-4f9e1a276bc9 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
8902024-05-10T21:23:51.517ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 8af4bac0-a438-4a21-a75f-3c43849b44ad, dataset_name: DatasetName { pool_name: ZpoolName { id: c78aa9ff-15c2-42ef-a938-4f9e1a276bc9 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
8912024-05-10T21:23:51.538ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 7325b560-f7aa-4399-a6c6-a3322f42d759, dataset_name: DatasetName { pool_name: ZpoolName { id: d7867297-5592-4803-bd09-620387b7253d (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
8922024-05-10T21:23:51.538ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 7325b560-f7aa-4399-a6c6-a3322f42d759, dataset_name: DatasetName { pool_name: ZpoolName { id: d7867297-5592-4803-bd09-620387b7253d (zpool), kind: External }, kind: ExternalDns }, responder: ... }
8932024-05-10T21:23:51.613ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e03d4432-8b77-4406-904d-ebd71cc9739e, dataset_name: DatasetName { pool_name: ZpoolName { id: 7482ebc0-5237-4ab2-bef7-e62e772ad207 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
8942024-05-10T21:23:51.613ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: e03d4432-8b77-4406-904d-ebd71cc9739e, dataset_name: DatasetName { pool_name: ZpoolName { id: 7482ebc0-5237-4ab2-bef7-e62e772ad207 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
8952024-05-10T21:23:51.686ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 207101fa-3f8f-4bbb-a8c0-4f0407f828e8, dataset_name: DatasetName { pool_name: ZpoolName { id: d7867297-5592-4803-bd09-620387b7253d (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:381
8962024-05-10T21:23:51.687ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 207101fa-3f8f-4bbb-a8c0-4f0407f828e8, dataset_name: DatasetName { pool_name: ZpoolName { id: d7867297-5592-4803-bd09-620387b7253d (zpool), kind: External }, kind: Clickhouse }, responder: ... }
8972024-05-10T21:23:51.762ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: ada61d89-35f2-4021-829f-0d604c91d0ff, dataset_name: DatasetName { pool_name: ZpoolName { id: d7867297-5592-4803-bd09-620387b7253d (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
8982024-05-10T21:23:51.762ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: ada61d89-35f2-4021-829f-0d604c91d0ff, dataset_name: DatasetName { pool_name: ZpoolName { id: d7867297-5592-4803-bd09-620387b7253d (zpool), kind: External }, kind: Crucible }, responder: ... }
8992024-05-10T21:23:51.837ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 5c09bf7a-54dd-4d4c-bdd3-12884bf29927, dataset_name: DatasetName { pool_name: ZpoolName { id: 7482ebc0-5237-4ab2-bef7-e62e772ad207 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
9002024-05-10T21:23:51.837ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 5c09bf7a-54dd-4d4c-bdd3-12884bf29927, dataset_name: DatasetName { pool_name: ZpoolName { id: 7482ebc0-5237-4ab2-bef7-e62e772ad207 (zpool), kind: External }, kind: Crucible }, responder: ... }
9012024-05-10T21:23:51.906ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 101e94eb-79e6-493c-8bba-b631934a03b9, dataset_name: DatasetName { pool_name: ZpoolName { id: 4a2a1aac-5879-491f-b914-3e863f8ce4c3 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
9022024-05-10T21:23:51.906ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 101e94eb-79e6-493c-8bba-b631934a03b9, dataset_name: DatasetName { pool_name: ZpoolName { id: 4a2a1aac-5879-491f-b914-3e863f8ce4c3 (zpool), kind: External }, kind: Crucible }, responder: ... }
9032024-05-10T21:23:51.982ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: b473a0f3-4103-4d03-9647-a8361e344d97, dataset_name: DatasetName { pool_name: ZpoolName { id: c20ef2f7-458a-4b20-ab01-0ef15666a084 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
9042024-05-10T21:23:51.982ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: b473a0f3-4103-4d03-9647-a8361e344d97, dataset_name: DatasetName { pool_name: ZpoolName { id: c20ef2f7-458a-4b20-ab01-0ef15666a084 (zpool), kind: External }, kind: Crucible }, responder: ... }
9052024-05-10T21:23:52.062ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 66d05714-044e-4478-a42e-018c12715d96, dataset_name: DatasetName { pool_name: ZpoolName { id: c78aa9ff-15c2-42ef-a938-4f9e1a276bc9 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
9062024-05-10T21:23:52.062ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 66d05714-044e-4478-a42e-018c12715d96, dataset_name: DatasetName { pool_name: ZpoolName { id: c78aa9ff-15c2-42ef-a938-4f9e1a276bc9 (zpool), kind: External }, kind: Crucible }, responder: ... }
9072024-05-10T21:23:52.141ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 06efb5f5-bb93-4e71-b8a9-60f655f78031, dataset_name: DatasetName { pool_name: ZpoolName { id: b315123f-de7f-4c95-94ec-6ebbaf4bb37f (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
9082024-05-10T21:23:52.141ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 06efb5f5-bb93-4e71-b8a9-60f655f78031, dataset_name: DatasetName { pool_name: ZpoolName { id: b315123f-de7f-4c95-94ec-6ebbaf4bb37f (zpool), kind: External }, kind: Crucible }, responder: ... }
9092024-05-10T21:23:52.210ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c1dcad46-3d8d-4678-899a-efb74ec83395, dataset_name: DatasetName { pool_name: ZpoolName { id: be007fc9-c18b-4eb9-b039-d1acd6258caa (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
9102024-05-10T21:23:52.210ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: c1dcad46-3d8d-4678-899a-efb74ec83395, dataset_name: DatasetName { pool_name: ZpoolName { id: be007fc9-c18b-4eb9-b039-d1acd6258caa (zpool), kind: External }, kind: Crucible }, responder: ... }
9112024-05-10T21:23:52.280ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 4fdb69f7-0af6-40d3-9922-f38ae4f0f54b, dataset_name: DatasetName { pool_name: ZpoolName { id: d1ca4b9b-c237-46f9-b5f2-dacd6333114b (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
9122024-05-10T21:23:52.280ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 4fdb69f7-0af6-40d3-9922-f38ae4f0f54b, dataset_name: DatasetName { pool_name: ZpoolName { id: d1ca4b9b-c237-46f9-b5f2-dacd6333114b (zpool), kind: External }, kind: Crucible }, responder: ... }
9132024-05-10T21:23:52.342ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d6578850-a802-4381-b533-4fb297487a8f, dataset_name: DatasetName { pool_name: ZpoolName { id: 6827078d-a479-42be-8ba6-18589f19cebd (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
9142024-05-10T21:23:52.342ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: d6578850-a802-4381-b533-4fb297487a8f, dataset_name: DatasetName { pool_name: ZpoolName { id: 6827078d-a479-42be-8ba6-18589f19cebd (zpool), kind: External }, kind: Crucible }, responder: ... }
9152024-05-10T21:23:52.408ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9162024-05-10T21:23:52.408ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/6742bbd6-6bec-4f6b-94f3-002a53fc9f01/config/omicron-zones.json file = common/src/ledger.rs:177
9172024-05-10T21:23:52.409ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8becec77-7597-498a-9704-3ae75204e470/config/omicron-zones.json file = common/src/ledger.rs:177
9182024-05-10T21:23:52.409ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9192024-05-10T21:23:52.553ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:259
9202024-05-10T21:23:52.553ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9212024-05-10T21:23:52.553ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9222024-05-10T21:23:52.568ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:259
9232024-05-10T21:23:52.569ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9242024-05-10T21:23:52.618ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9252024-05-10T21:23:52.618ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9262024-05-10T21:23:52.618ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9272024-05-10T21:23:52.618ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9282024-05-10T21:23:52.618ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9292024-05-10T21:23:52.794ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:259
9302024-05-10T21:23:52.794ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9312024-05-10T21:23:52.794ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9322024-05-10T21:23:52.796ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:259
9332024-05-10T21:23:52.797ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:259
9342024-05-10T21:23:52.833ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9352024-05-10T21:23:52.833ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9362024-05-10T21:23:52.833ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9372024-05-10T21:23:52.833ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9382024-05-10T21:23:52.834ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_06efb5f5-bb93-4e71-b8a9-60f655f78031 file = illumos-utils/src/zone.rs:315
9392024-05-10T21:23:52.839ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_b473a0f3-4103-4d03-9647-a8361e344d97 file = illumos-utils/src/zone.rs:315
9402024-05-10T21:23:52.844ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_d7314b67-85b3-4c30-acfc-5e9dff5e5939 file = illumos-utils/src/zone.rs:315
9412024-05-10T21:23:52.849ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_4fdb69f7-0af6-40d3-9922-f38ae4f0f54b file = illumos-utils/src/zone.rs:315
9422024-05-10T21:23:52.854ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_101e94eb-79e6-493c-8bba-b631934a03b9 file = illumos-utils/src/zone.rs:315
9432024-05-10T21:23:52.859ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_0af3291d-7808-448b-a5ec-68ea6a4730ef file = illumos-utils/src/zone.rs:315
9442024-05-10T21:23:52.864ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_ada61d89-35f2-4021-829f-0d604c91d0ff file = illumos-utils/src/zone.rs:315
9452024-05-10T21:23:52.869ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_d6578850-a802-4381-b533-4fb297487a8f file = illumos-utils/src/zone.rs:315
9462024-05-10T21:23:52.990ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_06efb5f5-bb93-4e71-b8a9-60f655f78031 file = illumos-utils/src/zone.rs:354
9472024-05-10T21:23:52.995ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_b473a0f3-4103-4d03-9647-a8361e344d97 file = illumos-utils/src/zone.rs:354
9482024-05-10T21:23:53.000ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_d7314b67-85b3-4c30-acfc-5e9dff5e5939 file = illumos-utils/src/zone.rs:354
9492024-05-10T21:23:53.005ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_4fdb69f7-0af6-40d3-9922-f38ae4f0f54b file = illumos-utils/src/zone.rs:354
9502024-05-10T21:23:53.010ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_101e94eb-79e6-493c-8bba-b631934a03b9 file = illumos-utils/src/zone.rs:354
9512024-05-10T21:23:53.015ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_0af3291d-7808-448b-a5ec-68ea6a4730ef file = illumos-utils/src/zone.rs:354
9522024-05-10T21:23:53.019ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_ada61d89-35f2-4021-829f-0d604c91d0ff file = illumos-utils/src/zone.rs:354
9532024-05-10T21:23:53.024ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_d6578850-a802-4381-b533-4fb297487a8f file = illumos-utils/src/zone.rs:354
9542024-05-10T21:23:53.029ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_996b624d-00ef-4678-8cfa-ad052b261509 file = illumos-utils/src/zone.rs:315
9552024-05-10T21:23:53.033ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_c1dcad46-3d8d-4678-899a-efb74ec83395 file = illumos-utils/src/zone.rs:315
9562024-05-10T21:23:53.039ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_95738557-5fbe-4760-a2f5-e295833eb800 file = illumos-utils/src/zone.rs:315
9572024-05-10T21:23:53.045ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_5c09bf7a-54dd-4d4c-bdd3-12884bf29927 file = illumos-utils/src/zone.rs:315
9582024-05-10T21:23:53.050ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_207101fa-3f8f-4bbb-a8c0-4f0407f828e8 file = illumos-utils/src/zone.rs:315
9592024-05-10T21:23:53.057ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_66d05714-044e-4478-a42e-018c12715d96 file = illumos-utils/src/zone.rs:315
9602024-05-10T21:23:53.064ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_996b624d-00ef-4678-8cfa-ad052b261509 file = illumos-utils/src/zone.rs:354
9612024-05-10T21:23:53.070ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_c1dcad46-3d8d-4678-899a-efb74ec83395 file = illumos-utils/src/zone.rs:354
9622024-05-10T21:23:53.078ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_95738557-5fbe-4760-a2f5-e295833eb800 file = illumos-utils/src/zone.rs:354
9632024-05-10T21:23:53.085ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_5c09bf7a-54dd-4d4c-bdd3-12884bf29927 file = illumos-utils/src/zone.rs:354
9642024-05-10T21:23:53.092ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_207101fa-3f8f-4bbb-a8c0-4f0407f828e8 file = illumos-utils/src/zone.rs:354
9652024-05-10T21:23:53.100ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_66d05714-044e-4478-a42e-018c12715d96 file = illumos-utils/src/zone.rs:354
9662024-05-10T21:23:53.169ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:276
9672024-05-10T21:23:53.249ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:276
9682024-05-10T21:23:53.318ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:276
9692024-05-10T21:23:53.376ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:276
9702024-05-10T21:23:53.434ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:276
9712024-05-10T21:23:53.436ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:301
9722024-05-10T21:23:53.436ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:193
9732024-05-10T21:23:53.527ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:394 port = Port { inner: PortInner { name: "opte1", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 142, 190]), slot: 0, vni: Vni { inner: 100 }, gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 }, vnic: "vopte1" } }
9742024-05-10T21:23:53.527ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1290 zone_type = external_dns
9752024-05-10T21:23:53.531ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:301
9762024-05-10T21:23:53.531ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:193
9772024-05-10T21:23:53.625ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:394 port = Port { inner: PortInner { name: "opte2", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 130, 3]), slot: 0, vni: Vni { inner: 100 }, gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 }, vnic: "vopte2" } }
9782024-05-10T21:23:53.625ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1290 zone_type = external_dns
9792024-05-10T21:23:53.630ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:301
9802024-05-10T21:23:53.630ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:193
9812024-05-10T21:23:53.723ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:394 port = Port { inner: PortInner { name: "opte3", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 253, 85]), slot: 0, vni: Vni { inner: 100 }, gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 }, vnic: "vopte3" } }
9822024-05-10T21:23:53.723ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1290 zone_type = nexus
9832024-05-10T21:23:53.726ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:301
9842024-05-10T21:23:53.726ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:193
9852024-05-10T21:23:53.820ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:394 port = Port { inner: PortInner { name: "opte4", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 134, 174]), slot: 0, vni: Vni { inner: 100 }, gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 }, vnic: "vopte4" } }
9862024-05-10T21:23:53.820ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1290 zone_type = nexus
9872024-05-10T21:23:53.823ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:301
9882024-05-10T21:23:53.823ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:193
9892024-05-10T21:23:53.938ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:394 port = Port { inner: PortInner { name: "opte5", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 255, 221]), slot: 0, vni: Vni { inner: 100 }, gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 }, vnic: "vopte5" } }
9902024-05-10T21:23:53.938ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1290 zone_type = nexus
9912024-05-10T21:23:53.938ZINFOSledAgent (ServiceManager): no nat entry found for: V4( Ipv4Network { addr: 10.151.2.164, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:102
9922024-05-10T21:23:53.938ZINFOSledAgent (ServiceManager): creating nat entry for: V4( Ipv4Network { addr: 10.151.2.164, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:109
9932024-05-10T21:23:53.939ZINFOSledAgent (ServiceManager): no nat entry found for: V4( Ipv4Network { addr: 10.151.2.165, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:102
9942024-05-10T21:23:53.939ZINFOSledAgent (ServiceManager): creating nat entry for: V4( Ipv4Network { addr: 10.151.2.165, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:109
9952024-05-10T21:23:53.956ZINFOSledAgent (ServiceManager): creation of nat entry successful for: V4( Ipv4Network { addr: 10.151.2.164, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:137
9962024-05-10T21:23:53.959ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9972024-05-10T21:23:54.008ZINFOSledAgent (ServiceManager): creation of nat entry successful for: V4( Ipv4Network { addr: 10.151.2.165, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:137
9982024-05-10T21:23:54.012ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9992024-05-10T21:23:54.012ZINFOSledAgent (ServiceManager): no nat entry found for: V4( Ipv4Network { addr: 10.151.2.166, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:102
10002024-05-10T21:23:54.012ZINFOSledAgent (ServiceManager): creating nat entry for: V4( Ipv4Network { addr: 10.151.2.166, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:109
10012024-05-10T21:23:54.012ZINFOSledAgent (ServiceManager): no nat entry found for: V4( Ipv4Network { addr: 10.151.2.168, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:102
10022024-05-10T21:23:54.012ZINFOSledAgent (ServiceManager): creating nat entry for: V4( Ipv4Network { addr: 10.151.2.168, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:109
10032024-05-10T21:23:54.012ZINFOSledAgent (ServiceManager): no nat entry found for: V4( Ipv4Network { addr: 10.151.2.167, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:102
10042024-05-10T21:23:54.012ZINFOSledAgent (ServiceManager): creating nat entry for: V4( Ipv4Network { addr: 10.151.2.167, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:109
10052024-05-10T21:23:54.047ZINFOSledAgent (ServiceManager): creation of nat entry successful for: V4( Ipv4Network { addr: 10.151.2.166, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:137
10062024-05-10T21:23:54.051ZINFOSledAgent (ServiceManager): creation of nat entry successful for: V4( Ipv4Network { addr: 10.151.2.168, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:137
10072024-05-10T21:23:54.054ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
10082024-05-10T21:23:54.054ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
10092024-05-10T21:23:54.054ZINFOSledAgent (ServiceManager): creation of nat entry successful for: V4( Ipv4Network { addr: 10.151.2.167, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:137
10102024-05-10T21:23:54.056ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
10112024-05-10T21:23:54.057ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_7325b560-f7aa-4399-a6c6-a3322f42d759 file = illumos-utils/src/zone.rs:315
10122024-05-10T21:23:54.068ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_e03d4432-8b77-4406-904d-ebd71cc9739e file = illumos-utils/src/zone.rs:315
10132024-05-10T21:23:54.196ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_7325b560-f7aa-4399-a6c6-a3322f42d759 file = illumos-utils/src/zone.rs:354
10142024-05-10T21:23:54.206ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_e03d4432-8b77-4406-904d-ebd71cc9739e file = illumos-utils/src/zone.rs:354
10152024-05-10T21:23:54.212ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_2fc7758a-cae3-4d9b-ade9-3a7691598581 file = illumos-utils/src/zone.rs:315
10162024-05-10T21:23:54.220ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_dd46fcb1-c07b-4880-9112-3895f2df61ed file = illumos-utils/src/zone.rs:315
10172024-05-10T21:23:54.230ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_7bb2217a-5bab-47ca-8e9e-29f166894592 file = illumos-utils/src/zone.rs:315
10182024-05-10T21:23:54.245ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_2fc7758a-cae3-4d9b-ade9-3a7691598581 file = illumos-utils/src/zone.rs:354
10192024-05-10T21:23:54.254ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_dd46fcb1-c07b-4880-9112-3895f2df61ed file = illumos-utils/src/zone.rs:354
10202024-05-10T21:23:54.264ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_7bb2217a-5bab-47ca-8e9e-29f166894592 file = illumos-utils/src/zone.rs:354
10212024-05-10T21:23:56.901ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_996b624d-00ef-4678-8cfa-ad052b261509: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService18"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::10"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::10"/> <propval type="astring" name="listen_port" value="17000"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10222024-05-10T21:23:56.914ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_0af3291d-7808-448b-a5ec-68ea6a4730ef: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService15"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::11"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::11"/> <propval type="astring" name="listen_port" value="17000"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10232024-05-10T21:23:56.914ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_pantry_996b624d-00ef-4678-8cfa-ad052b261509
10242024-05-10T21:23:56.918ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_pantry_0af3291d-7808-448b-a5ec-68ea6a4730ef
10252024-05-10T21:23:57.088ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_06efb5f5-bb93-4e71-b8a9-60f655f78031: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService10"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::17"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_b315123f-de7f-4c95-94ec-6ebbaf4bb37f/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::17"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="52ddc00d-da75-4df7-8f77-cc6935170c18"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10262024-05-10T21:23:57.088ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_06efb5f5-bb93-4e71-b8a9-60f655f78031
10272024-05-10T21:23:57.092ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_101e94eb-79e6-493c-8bba-b631934a03b9: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService14"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::14"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_4a2a1aac-5879-491f-b914-3e863f8ce4c3/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::14"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="d3f91f9e-ebe8-43fd-bb60-03321bb15409"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10282024-05-10T21:23:57.092ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_ada61d89-35f2-4021-829f-0d604c91d0ff: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService16"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::12"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_d7867297-5592-4803-bd09-620387b7253d/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::12"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="d28cf3ae-4e82-49e7-86ba-73cb6ba9be55"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10292024-05-10T21:23:57.094ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_66d05714-044e-4478-a42e-018c12715d96: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService23"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::16"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_c78aa9ff-15c2-42ef-a938-4f9e1a276bc9/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::16"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="370a179e-3311-494e-88df-696081dd6b29"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10302024-05-10T21:23:57.094ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_101e94eb-79e6-493c-8bba-b631934a03b9
10312024-05-10T21:23:57.104ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_ada61d89-35f2-4021-829f-0d604c91d0ff
10322024-05-10T21:23:57.114ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_66d05714-044e-4478-a42e-018c12715d96
10332024-05-10T21:23:57.126ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_4fdb69f7-0af6-40d3-9922-f38ae4f0f54b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService13"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::19"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_d1ca4b9b-c237-46f9-b5f2-dacd6333114b/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::19"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="b36af419-3c70-4f75-b9f1-778aee854fda"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10342024-05-10T21:23:57.126ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_4fdb69f7-0af6-40d3-9922-f38ae4f0f54b
10352024-05-10T21:23:57.142ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_5c09bf7a-54dd-4d4c-bdd3-12884bf29927: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService21"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::13"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_7482ebc0-5237-4ab2-bef7-e62e772ad207/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::13"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="75f30590-8bec-4395-8962-86d920d82f18"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10362024-05-10T21:23:57.142ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_5c09bf7a-54dd-4d4c-bdd3-12884bf29927
10372024-05-10T21:23:57.175ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_b473a0f3-4103-4d03-9647-a8361e344d97: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService11"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::15"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_c20ef2f7-458a-4b20-ab01-0ef15666a084/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::15"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="4177325e-7e1e-4ffc-8a1a-7c4e96dd2c91"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10382024-05-10T21:23:57.177ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_b473a0f3-4103-4d03-9647-a8361e344d97
10392024-05-10T21:23:57.379ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_c1dcad46-3d8d-4678-899a-efb74ec83395: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService19"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::18"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_be007fc9-c18b-4eb9-b039-d1acd6258caa/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::18"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="de674e91-6641-43f4-99c5-4da0ae47fe33"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10402024-05-10T21:23:57.379ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_c1dcad46-3d8d-4678-899a-efb74ec83395
10412024-05-10T21:23:57.462ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_06efb5f5-bb93-4e71-b8a9-60f655f78031") failed: Property not found. retry in 48.910767ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_06efb5f5-bb93-4e71-b8a9-60f655f78031
10422024-05-10T21:23:57.479ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4fdb69f7-0af6-40d3-9922-f38ae4f0f54b") failed: Property not found. retry in 68.433381ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4fdb69f7-0af6-40d3-9922-f38ae4f0f54b
10432024-05-10T21:23:57.499ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_101e94eb-79e6-493c-8bba-b631934a03b9") failed: Property not found. retry in 64.373611ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_101e94eb-79e6-493c-8bba-b631934a03b9
10442024-05-10T21:23:57.516ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ada61d89-35f2-4021-829f-0d604c91d0ff") failed: Property not found. retry in 60.873466ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ada61d89-35f2-4021-829f-0d604c91d0ff
10452024-05-10T21:23:57.531ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_996b624d-00ef-4678-8cfa-ad052b261509") failed: Property not found. retry in 53.866976ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_996b624d-00ef-4678-8cfa-ad052b261509
10462024-05-10T21:23:57.549ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66d05714-044e-4478-a42e-018c12715d96") failed: Property not found. retry in 27.692528ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_66d05714-044e-4478-a42e-018c12715d96
10472024-05-10T21:23:57.633ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_06efb5f5-bb93-4e71-b8a9-60f655f78031") failed: Property not found. retry in 120.796705ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_06efb5f5-bb93-4e71-b8a9-60f655f78031
10482024-05-10T21:23:57.668ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b473a0f3-4103-4d03-9647-a8361e344d97") failed: Property not found. retry in 69.575275ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b473a0f3-4103-4d03-9647-a8361e344d97
10492024-05-10T21:23:57.708ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4fdb69f7-0af6-40d3-9922-f38ae4f0f54b") failed: Property not found. retry in 97.123579ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4fdb69f7-0af6-40d3-9922-f38ae4f0f54b
10502024-05-10T21:23:57.796ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0af3291d-7808-448b-a5ec-68ea6a4730ef") failed: Property not found. retry in 64.711197ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0af3291d-7808-448b-a5ec-68ea6a4730ef
10512024-05-10T21:23:57.874ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5c09bf7a-54dd-4d4c-bdd3-12884bf29927") failed: Property not found. retry in 57.883066ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5c09bf7a-54dd-4d4c-bdd3-12884bf29927
10522024-05-10T21:23:57.971ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_06efb5f5-bb93-4e71-b8a9-60f655f78031") failed: Property not found. retry in 258.74096ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_06efb5f5-bb93-4e71-b8a9-60f655f78031
10532024-05-10T21:23:58.000ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b473a0f3-4103-4d03-9647-a8361e344d97") failed: Property not found. retry in 119.682917ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b473a0f3-4103-4d03-9647-a8361e344d97
10542024-05-10T21:23:58.165ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4fdb69f7-0af6-40d3-9922-f38ae4f0f54b") failed: Property not found. retry in 118.540831ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4fdb69f7-0af6-40d3-9922-f38ae4f0f54b
10552024-05-10T21:23:58.198ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_101e94eb-79e6-493c-8bba-b631934a03b9") failed: Property not found. retry in 113.595049ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_101e94eb-79e6-493c-8bba-b631934a03b9
10562024-05-10T21:24:02.579ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0af3291d-7808-448b-a5ec-68ea6a4730ef") failed: Property not found. retry in 91.428157ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0af3291d-7808-448b-a5ec-68ea6a4730ef
10572024-05-10T21:24:03.168ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ada61d89-35f2-4021-829f-0d604c91d0ff") failed: Property not found. retry in 74.835135ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ada61d89-35f2-4021-829f-0d604c91d0ff
10582024-05-10T21:24:03.510ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_996b624d-00ef-4678-8cfa-ad052b261509") failed: Property not found. retry in 128.647656ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_996b624d-00ef-4678-8cfa-ad052b261509
10592024-05-10T21:24:03.707ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c1dcad46-3d8d-4678-899a-efb74ec83395") failed: Property not found. retry in 60.24004ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c1dcad46-3d8d-4678-899a-efb74ec83395
10602024-05-10T21:24:03.758ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5c09bf7a-54dd-4d4c-bdd3-12884bf29927") failed: Property not found. retry in 120.502647ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5c09bf7a-54dd-4d4c-bdd3-12884bf29927
10612024-05-10T21:24:03.982ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66d05714-044e-4478-a42e-018c12715d96") failed: Property not found. retry in 93.350119ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_66d05714-044e-4478-a42e-018c12715d96
10622024-05-10T21:24:04.113ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_06efb5f5-bb93-4e71-b8a9-60f655f78031") failed: Property not found. retry in 405.353849ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_06efb5f5-bb93-4e71-b8a9-60f655f78031
10632024-05-10T21:24:04.263ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b473a0f3-4103-4d03-9647-a8361e344d97") failed: Property not found. retry in 207.926005ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b473a0f3-4103-4d03-9647-a8361e344d97
10642024-05-10T21:24:04.420ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_e03d4432-8b77-4406-904d-ebd71cc9739e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService25"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::9"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value="vopte2"/> <propval type="astring" name="gateway" value="172.30.1.1"/> <propval type="astring" name="ip" value="172.30.1.6"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value="[fd00:1122:3344:101::9]:5353"/> <propval type="astring" name="dns_address" value="172.30.1.6:53"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10652024-05-10T21:24:04.484ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4fdb69f7-0af6-40d3-9922-f38ae4f0f54b") failed: Property not found. retry in 264.882927ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4fdb69f7-0af6-40d3-9922-f38ae4f0f54b
10662024-05-10T21:24:04.495ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_101e94eb-79e6-493c-8bba-b631934a03b9") failed: Property not found. retry in 298.333891ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_101e94eb-79e6-493c-8bba-b631934a03b9
10672024-05-10T21:24:04.508ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0af3291d-7808-448b-a5ec-68ea6a4730ef") failed: Property not found. retry in 256.95617ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0af3291d-7808-448b-a5ec-68ea6a4730ef
10682024-05-10T21:24:04.606ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ada61d89-35f2-4021-829f-0d604c91d0ff") failed: Property not found. retry in 293.40626ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ada61d89-35f2-4021-829f-0d604c91d0ff
10692024-05-10T21:24:04.618ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_996b624d-00ef-4678-8cfa-ad052b261509") failed: Property not found. retry in 190.221043ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_996b624d-00ef-4678-8cfa-ad052b261509
10702024-05-10T21:24:04.629ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c1dcad46-3d8d-4678-899a-efb74ec83395") failed: Property not found. retry in 106.383696ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c1dcad46-3d8d-4678-899a-efb74ec83395
10712024-05-10T21:24:04.639ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5c09bf7a-54dd-4d4c-bdd3-12884bf29927") failed: Property not found. retry in 273.437336ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5c09bf7a-54dd-4d4c-bdd3-12884bf29927
10722024-05-10T21:24:04.650ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66d05714-044e-4478-a42e-018c12715d96") failed: Property not found. retry in 220.239621ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_66d05714-044e-4478-a42e-018c12715d96
10732024-05-10T21:24:04.660ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_06efb5f5-bb93-4e71-b8a9-60f655f78031") failed: Property not found. retry in 1.107599182s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_06efb5f5-bb93-4e71-b8a9-60f655f78031
10742024-05-10T21:24:04.670ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b473a0f3-4103-4d03-9647-a8361e344d97") failed: Property not found. retry in 584.505901ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b473a0f3-4103-4d03-9647-a8361e344d97
10752024-05-10T21:24:04.716ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_7325b560-f7aa-4399-a6c6-a3322f42d759: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService24"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::8"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value="vopte1"/> <propval type="astring" name="gateway" value="172.30.1.1"/> <propval type="astring" name="ip" value="172.30.1.5"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value="[fd00:1122:3344:101::8]:5353"/> <propval type="astring" name="dns_address" value="172.30.1.5:53"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10762024-05-10T21:24:04.717ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_d7314b67-85b3-4c30-acfc-5e9dff5e5939: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService12"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::f"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::f"/> <propval type="astring" name="listen_port" value="17000"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10772024-05-10T21:24:04.718ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_external_dns_e03d4432-8b77-4406-904d-ebd71cc9739e
10782024-05-10T21:24:04.724ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_external_dns_7325b560-f7aa-4399-a6c6-a3322f42d759
10792024-05-10T21:24:04.730ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_pantry_d7314b67-85b3-4c30-acfc-5e9dff5e5939
10802024-05-10T21:24:04.747ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c1dcad46-3d8d-4678-899a-efb74ec83395") failed: Property not found. retry in 140.9482ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c1dcad46-3d8d-4678-899a-efb74ec83395
10812024-05-10T21:24:04.785ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4fdb69f7-0af6-40d3-9922-f38ae4f0f54b") failed: Property not found. retry in 487.848916ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4fdb69f7-0af6-40d3-9922-f38ae4f0f54b
10822024-05-10T21:24:04.796ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0af3291d-7808-448b-a5ec-68ea6a4730ef") failed: Property not found. retry in 498.325346ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0af3291d-7808-448b-a5ec-68ea6a4730ef
10832024-05-10T21:24:04.806ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_101e94eb-79e6-493c-8bba-b631934a03b9") failed: Property not found. retry in 357.581633ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_101e94eb-79e6-493c-8bba-b631934a03b9
10842024-05-10T21:24:04.819ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_996b624d-00ef-4678-8cfa-ad052b261509") failed: Property not found. retry in 345.397082ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_996b624d-00ef-4678-8cfa-ad052b261509
10852024-05-10T21:24:04.882ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66d05714-044e-4478-a42e-018c12715d96") failed: Property not found. retry in 504.332067ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_66d05714-044e-4478-a42e-018c12715d96
10862024-05-10T21:24:04.901ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c1dcad46-3d8d-4678-899a-efb74ec83395") failed: Property not found. retry in 574.462852ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c1dcad46-3d8d-4678-899a-efb74ec83395
10872024-05-10T21:24:04.912ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ada61d89-35f2-4021-829f-0d604c91d0ff") failed: Property not found. retry in 513.984129ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ada61d89-35f2-4021-829f-0d604c91d0ff
10882024-05-10T21:24:04.926ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5c09bf7a-54dd-4d4c-bdd3-12884bf29927") failed: Property not found. retry in 524.933176ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5c09bf7a-54dd-4d4c-bdd3-12884bf29927
10892024-05-10T21:24:04.936ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d7314b67-85b3-4c30-acfc-5e9dff5e5939") failed: Property not found. retry in 43.516491ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d7314b67-85b3-4c30-acfc-5e9dff5e5939
10902024-05-10T21:24:04.944ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e03d4432-8b77-4406-904d-ebd71cc9739e") failed: Property not found. retry in 72.964663ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e03d4432-8b77-4406-904d-ebd71cc9739e
10912024-05-10T21:24:04.954ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7325b560-f7aa-4399-a6c6-a3322f42d759") failed: Property not found. retry in 38.38915ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_7325b560-f7aa-4399-a6c6-a3322f42d759
10922024-05-10T21:24:04.954ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_d6578850-a802-4381-b533-4fb297487a8f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService17"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::1a"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_6827078d-a479-42be-8ba6-18589f19cebd/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::1a"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="b04edc1e-bfc5-4edf-a1d5-cb2cd4836334"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10932024-05-10T21:24:04.955ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_d6578850-a802-4381-b533-4fb297487a8f
10942024-05-10T21:24:04.991ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d7314b67-85b3-4c30-acfc-5e9dff5e5939") failed: Property not found. retry in 90.872887ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d7314b67-85b3-4c30-acfc-5e9dff5e5939
10952024-05-10T21:24:05.003ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7325b560-f7aa-4399-a6c6-a3322f42d759") failed: Property not found. retry in 120.859078ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_7325b560-f7aa-4399-a6c6-a3322f42d759
10962024-05-10T21:24:05.029ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e03d4432-8b77-4406-904d-ebd71cc9739e") failed: Property not found. retry in 119.147957ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e03d4432-8b77-4406-904d-ebd71cc9739e
10972024-05-10T21:24:05.094ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d7314b67-85b3-4c30-acfc-5e9dff5e5939") failed: Property not found. retry in 270.817154ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d7314b67-85b3-4c30-acfc-5e9dff5e5939
10982024-05-10T21:24:05.134ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7325b560-f7aa-4399-a6c6-a3322f42d759") failed: Property not found. retry in 237.818943ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_7325b560-f7aa-4399-a6c6-a3322f42d759
10992024-05-10T21:24:05.143ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6578850-a802-4381-b533-4fb297487a8f") failed: Property not found. retry in 58.388697ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6578850-a802-4381-b533-4fb297487a8f
11002024-05-10T21:24:05.164ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e03d4432-8b77-4406-904d-ebd71cc9739e") failed: Property not found. retry in 160.533635ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e03d4432-8b77-4406-904d-ebd71cc9739e
11012024-05-10T21:24:05.177ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_101e94eb-79e6-493c-8bba-b631934a03b9") failed: Property not found. retry in 519.188135ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_101e94eb-79e6-493c-8bba-b631934a03b9
11022024-05-10T21:24:05.187ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_996b624d-00ef-4678-8cfa-ad052b261509") failed: Property not found. retry in 789.428308ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_996b624d-00ef-4678-8cfa-ad052b261509
11032024-05-10T21:24:05.211ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6578850-a802-4381-b533-4fb297487a8f") failed: Property not found. retry in 68.610489ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6578850-a802-4381-b533-4fb297487a8f
11042024-05-10T21:24:05.242ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_95738557-5fbe-4760-a2f5-e295833eb800: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService20"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::d"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value="95738557-5fbe-4760-a2f5-e295833eb800"/> <propval type="astring" name="address" value="[fd00:1122:3344:101::d]:12223"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11052024-05-10T21:24:05.243ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_oximeter_95738557-5fbe-4760-a2f5-e295833eb800
11062024-05-10T21:24:05.267ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b473a0f3-4103-4d03-9647-a8361e344d97") failed: Property not found. retry in 665.525295ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b473a0f3-4103-4d03-9647-a8361e344d97
11072024-05-10T21:24:05.286ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4fdb69f7-0af6-40d3-9922-f38ae4f0f54b") failed: Property not found. retry in 657.332606ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4fdb69f7-0af6-40d3-9922-f38ae4f0f54b
11082024-05-10T21:24:05.296ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6578850-a802-4381-b533-4fb297487a8f") failed: Property not found. retry in 113.05803ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6578850-a802-4381-b533-4fb297487a8f
11092024-05-10T21:24:05.308ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0af3291d-7808-448b-a5ec-68ea6a4730ef") failed: Property not found. retry in 1.018285914s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0af3291d-7808-448b-a5ec-68ea6a4730ef
11102024-05-10T21:24:05.336ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e03d4432-8b77-4406-904d-ebd71cc9739e") failed: Property not found. retry in 502.124707ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e03d4432-8b77-4406-904d-ebd71cc9739e
11112024-05-10T21:24:05.380ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d7314b67-85b3-4c30-acfc-5e9dff5e5939") failed: Property not found. retry in 402.523648ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d7314b67-85b3-4c30-acfc-5e9dff5e5939
11122024-05-10T21:24:05.392ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7325b560-f7aa-4399-a6c6-a3322f42d759") failed: Property not found. retry in 413.875263ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_7325b560-f7aa-4399-a6c6-a3322f42d759
11132024-05-10T21:24:05.403ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66d05714-044e-4478-a42e-018c12715d96") failed: Property not found. retry in 1.011953904s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_66d05714-044e-4478-a42e-018c12715d96
11142024-05-10T21:24:05.423ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6578850-a802-4381-b533-4fb297487a8f") failed: Property not found. retry in 490.944313ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6578850-a802-4381-b533-4fb297487a8f
11152024-05-10T21:24:05.438ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ada61d89-35f2-4021-829f-0d604c91d0ff") failed: Property not found. retry in 723.704469ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ada61d89-35f2-4021-829f-0d604c91d0ff
11162024-05-10T21:24:05.464ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5c09bf7a-54dd-4d4c-bdd3-12884bf29927") failed: Property not found. retry in 913.550454ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5c09bf7a-54dd-4d4c-bdd3-12884bf29927
11172024-05-10T21:24:05.474ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_95738557-5fbe-4760-a2f5-e295833eb800") failed: Property not found. retry in 63.913766ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_95738557-5fbe-4760-a2f5-e295833eb800
11182024-05-10T21:24:05.487ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c1dcad46-3d8d-4678-899a-efb74ec83395") failed: Property not found. retry in 793.199885ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c1dcad46-3d8d-4678-899a-efb74ec83395
11192024-05-10T21:24:05.547ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_95738557-5fbe-4760-a2f5-e295833eb800") failed: Property not found. retry in 131.734797ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_95738557-5fbe-4760-a2f5-e295833eb800
11202024-05-10T21:24:05.694ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_95738557-5fbe-4760-a2f5-e295833eb800") failed: Property not found. retry in 107.679453ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_95738557-5fbe-4760-a2f5-e295833eb800
11212024-05-10T21:24:05.708ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_101e94eb-79e6-493c-8bba-b631934a03b9") failed: Property not found. retry in 1.486647419s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_101e94eb-79e6-493c-8bba-b631934a03b9
11222024-05-10T21:24:05.779ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_06efb5f5-bb93-4e71-b8a9-60f655f78031") failed: Property not found. retry in 1.178682654s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_06efb5f5-bb93-4e71-b8a9-60f655f78031
11232024-05-10T21:24:05.794ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d7314b67-85b3-4c30-acfc-5e9dff5e5939") failed: Property not found. retry in 1.095971834s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d7314b67-85b3-4c30-acfc-5e9dff5e5939
11242024-05-10T21:24:05.814ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_95738557-5fbe-4760-a2f5-e295833eb800") failed: Property not found. retry in 346.151373ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_95738557-5fbe-4760-a2f5-e295833eb800
11252024-05-10T21:24:05.824ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7325b560-f7aa-4399-a6c6-a3322f42d759") failed: Property not found. retry in 588.946027ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_7325b560-f7aa-4399-a6c6-a3322f42d759
11262024-05-10T21:24:05.849ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e03d4432-8b77-4406-904d-ebd71cc9739e") failed: Property not found. retry in 880.593039ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e03d4432-8b77-4406-904d-ebd71cc9739e
11272024-05-10T21:24:05.925ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6578850-a802-4381-b533-4fb297487a8f") failed: Property not found. retry in 866.407976ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6578850-a802-4381-b533-4fb297487a8f
11282024-05-10T21:24:05.945ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b473a0f3-4103-4d03-9647-a8361e344d97") failed: Property not found. retry in 1.474444088s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b473a0f3-4103-4d03-9647-a8361e344d97
11292024-05-10T21:24:05.955ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4fdb69f7-0af6-40d3-9922-f38ae4f0f54b") failed: Property not found. retry in 758.194575ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4fdb69f7-0af6-40d3-9922-f38ae4f0f54b
11302024-05-10T21:24:05.988ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_996b624d-00ef-4678-8cfa-ad052b261509") failed: Property not found. retry in 1.013842611s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_996b624d-00ef-4678-8cfa-ad052b261509
11312024-05-10T21:24:06.173ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_95738557-5fbe-4760-a2f5-e295833eb800") failed: Property not found. retry in 1.177984838s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_95738557-5fbe-4760-a2f5-e295833eb800
11322024-05-10T21:24:06.184ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ada61d89-35f2-4021-829f-0d604c91d0ff") failed: Property not found. retry in 1.33545567s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ada61d89-35f2-4021-829f-0d604c91d0ff
11332024-05-10T21:24:06.294ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c1dcad46-3d8d-4678-899a-efb74ec83395") failed: Property not found. retry in 1.058460391s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c1dcad46-3d8d-4678-899a-efb74ec83395
11342024-05-10T21:24:06.344ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0af3291d-7808-448b-a5ec-68ea6a4730ef") failed: Property not found. retry in 1.060055811s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0af3291d-7808-448b-a5ec-68ea6a4730ef
11352024-05-10T21:24:06.377ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 74.16477977s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:426 sled_id = 3ae06dcf-597c-4d18-b2d7-37c1f02096d7
11362024-05-10T21:24:06.391ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5c09bf7a-54dd-4d4c-bdd3-12884bf29927") failed: Property not found. retry in 1.264010005s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5c09bf7a-54dd-4d4c-bdd3-12884bf29927
11372024-05-10T21:24:06.426ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7325b560-f7aa-4399-a6c6-a3322f42d759") failed: Property not found. retry in 1.446119151s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_7325b560-f7aa-4399-a6c6-a3322f42d759
11382024-05-10T21:24:06.436ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66d05714-044e-4478-a42e-018c12715d96") failed: Property not found. retry in 1.127030864s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_66d05714-044e-4478-a42e-018c12715d96
11392024-05-10T21:24:06.504ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_7bb2217a-5bab-47ca-8e9e-29f166894592: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService28"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::b"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value="vopte5"/> <propval type="astring" name="gateway" value="172.30.2.1"/> <propval type="astring" name="ip" value="172.30.2.6"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11402024-05-10T21:24:06.528ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_dd46fcb1-c07b-4880-9112-3895f2df61ed: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService27"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::c"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value="vopte4"/> <propval type="astring" name="gateway" value="172.30.2.1"/> <propval type="astring" name="ip" value="172.30.2.7"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11412024-05-10T21:24:06.528ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_nexus_7bb2217a-5bab-47ca-8e9e-29f166894592
11422024-05-10T21:24:06.534ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_nexus_dd46fcb1-c07b-4880-9112-3895f2df61ed
11432024-05-10T21:24:06.538ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_2fc7758a-cae3-4d9b-ade9-3a7691598581: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService26"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::a"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value="vopte3"/> <propval type="astring" name="gateway" value="172.30.2.1"/> <propval type="astring" name="ip" value="172.30.2.5"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11442024-05-10T21:24:06.539ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_nexus_2fc7758a-cae3-4d9b-ade9-3a7691598581
11452024-05-10T21:24:06.721ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2fc7758a-cae3-4d9b-ade9-3a7691598581") failed: Property not found. retry in 40.059526ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2fc7758a-cae3-4d9b-ade9-3a7691598581
11462024-05-10T21:24:06.730ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4fdb69f7-0af6-40d3-9922-f38ae4f0f54b") failed: Property not found. retry in 1.382267669s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4fdb69f7-0af6-40d3-9922-f38ae4f0f54b
11472024-05-10T21:24:06.736ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dd46fcb1-c07b-4880-9112-3895f2df61ed") failed: Property not found. retry in 58.58316ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_dd46fcb1-c07b-4880-9112-3895f2df61ed
11482024-05-10T21:24:06.743ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7bb2217a-5bab-47ca-8e9e-29f166894592") failed: Property not found. retry in 43.527748ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7bb2217a-5bab-47ca-8e9e-29f166894592
11492024-05-10T21:24:06.751ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e03d4432-8b77-4406-904d-ebd71cc9739e") failed: Property not found. retry in 1.313919654s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e03d4432-8b77-4406-904d-ebd71cc9739e
11502024-05-10T21:24:06.767ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2fc7758a-cae3-4d9b-ade9-3a7691598581") failed: Property not found. retry in 78.853611ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2fc7758a-cae3-4d9b-ade9-3a7691598581
11512024-05-10T21:24:06.796ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7bb2217a-5bab-47ca-8e9e-29f166894592") failed: Property not found. retry in 56.792222ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7bb2217a-5bab-47ca-8e9e-29f166894592
11522024-05-10T21:24:06.804ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6578850-a802-4381-b533-4fb297487a8f") failed: Property not found. retry in 760.434331ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6578850-a802-4381-b533-4fb297487a8f
11532024-05-10T21:24:06.811ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dd46fcb1-c07b-4880-9112-3895f2df61ed") failed: Property not found. retry in 137.063582ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_dd46fcb1-c07b-4880-9112-3895f2df61ed
11542024-05-10T21:24:06.855ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2fc7758a-cae3-4d9b-ade9-3a7691598581") failed: Property not found. retry in 120.465492ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2fc7758a-cae3-4d9b-ade9-3a7691598581
11552024-05-10T21:24:06.862ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7bb2217a-5bab-47ca-8e9e-29f166894592") failed: Property not found. retry in 282.021678ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7bb2217a-5bab-47ca-8e9e-29f166894592
11562024-05-10T21:24:06.899ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d7314b67-85b3-4c30-acfc-5e9dff5e5939") failed: Property not found. retry in 699.018769ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d7314b67-85b3-4c30-acfc-5e9dff5e5939
11572024-05-10T21:24:06.957ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dd46fcb1-c07b-4880-9112-3895f2df61ed") failed: Property not found. retry in 118.410312ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_dd46fcb1-c07b-4880-9112-3895f2df61ed
11582024-05-10T21:24:06.966ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_06efb5f5-bb93-4e71-b8a9-60f655f78031") failed: Property not found. retry in 1.275248222s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_06efb5f5-bb93-4e71-b8a9-60f655f78031
11592024-05-10T21:24:06.985ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2fc7758a-cae3-4d9b-ade9-3a7691598581") failed: Property not found. retry in 494.228039ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2fc7758a-cae3-4d9b-ade9-3a7691598581
11602024-05-10T21:24:07.010ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_996b624d-00ef-4678-8cfa-ad052b261509") failed: Property not found. retry in 827.104096ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_996b624d-00ef-4678-8cfa-ad052b261509
11612024-05-10T21:24:07.084ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dd46fcb1-c07b-4880-9112-3895f2df61ed") failed: Property not found. retry in 207.179002ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_dd46fcb1-c07b-4880-9112-3895f2df61ed
11622024-05-10T21:24:07.156ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7bb2217a-5bab-47ca-8e9e-29f166894592") failed: Property not found. retry in 573.628478ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7bb2217a-5bab-47ca-8e9e-29f166894592
11632024-05-10T21:24:07.205ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_101e94eb-79e6-493c-8bba-b631934a03b9") failed: Property not found. retry in 910.322466ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_101e94eb-79e6-493c-8bba-b631934a03b9
11642024-05-10T21:24:07.301ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dd46fcb1-c07b-4880-9112-3895f2df61ed") failed: Property not found. retry in 867.325722ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_dd46fcb1-c07b-4880-9112-3895f2df61ed
11652024-05-10T21:24:07.361ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_95738557-5fbe-4760-a2f5-e295833eb800") failed: Property not found. retry in 1.445681923s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_95738557-5fbe-4760-a2f5-e295833eb800
11662024-05-10T21:24:07.369ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c1dcad46-3d8d-4678-899a-efb74ec83395") failed: Property not found. retry in 707.246179ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c1dcad46-3d8d-4678-899a-efb74ec83395
11672024-05-10T21:24:07.413ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0af3291d-7808-448b-a5ec-68ea6a4730ef") failed: Property not found. retry in 500.179351ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0af3291d-7808-448b-a5ec-68ea6a4730ef
11682024-05-10T21:24:07.428ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b473a0f3-4103-4d03-9647-a8361e344d97") failed: Property not found. retry in 514.417669ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b473a0f3-4103-4d03-9647-a8361e344d97
11692024-05-10T21:24:07.489ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2fc7758a-cae3-4d9b-ade9-3a7691598581") failed: Property not found. retry in 436.281373ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2fc7758a-cae3-4d9b-ade9-3a7691598581
11702024-05-10T21:24:07.530ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ada61d89-35f2-4021-829f-0d604c91d0ff") failed: Property not found. retry in 1.082576826s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ada61d89-35f2-4021-829f-0d604c91d0ff
11712024-05-10T21:24:07.572ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66d05714-044e-4478-a42e-018c12715d96") failed: Property not found. retry in 928.773548ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_66d05714-044e-4478-a42e-018c12715d96
11722024-05-10T21:24:07.580ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6578850-a802-4381-b533-4fb297487a8f") failed: Property not found. retry in 1.29577176s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6578850-a802-4381-b533-4fb297487a8f
11732024-05-10T21:24:07.607ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d7314b67-85b3-4c30-acfc-5e9dff5e5939") failed: Property not found. retry in 617.156409ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d7314b67-85b3-4c30-acfc-5e9dff5e5939
11742024-05-10T21:24:07.664ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5c09bf7a-54dd-4d4c-bdd3-12884bf29927") failed: Property not found. retry in 1.201171366s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5c09bf7a-54dd-4d4c-bdd3-12884bf29927
11752024-05-10T21:24:07.741ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7bb2217a-5bab-47ca-8e9e-29f166894592") failed: Property not found. retry in 643.387945ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7bb2217a-5bab-47ca-8e9e-29f166894592
11762024-05-10T21:24:07.846ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_996b624d-00ef-4678-8cfa-ad052b261509") failed: Property not found. retry in 571.642777ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_996b624d-00ef-4678-8cfa-ad052b261509
11772024-05-10T21:24:07.880ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7325b560-f7aa-4399-a6c6-a3322f42d759") failed: Property not found. retry in 904.254355ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_7325b560-f7aa-4399-a6c6-a3322f42d759
11782024-05-10T21:24:08.012ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0af3291d-7808-448b-a5ec-68ea6a4730ef") failed: Property not found. retry in 890.025708ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0af3291d-7808-448b-a5ec-68ea6a4730ef
11792024-05-10T21:24:08.299ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b473a0f3-4103-4d03-9647-a8361e344d97") failed: Property not found. retry in 1.095010254s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b473a0f3-4103-4d03-9647-a8361e344d97
11802024-05-10T21:24:08.337ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d7314b67-85b3-4c30-acfc-5e9dff5e5939") failed: Property not found. retry in 824.99615ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d7314b67-85b3-4c30-acfc-5e9dff5e5939
11812024-05-10T21:24:08.373ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e03d4432-8b77-4406-904d-ebd71cc9739e") failed: Property not found. retry in 732.718255ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e03d4432-8b77-4406-904d-ebd71cc9739e
11822024-05-10T21:24:08.404ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4fdb69f7-0af6-40d3-9922-f38ae4f0f54b") failed: Property not found. retry in 1.253422659s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4fdb69f7-0af6-40d3-9922-f38ae4f0f54b
11832024-05-10T21:24:08.467ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_101e94eb-79e6-493c-8bba-b631934a03b9") failed: Property not found. retry in 663.056712ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_101e94eb-79e6-493c-8bba-b631934a03b9
11842024-05-10T21:24:08.489ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_996b624d-00ef-4678-8cfa-ad052b261509") failed: Property not found. retry in 1.049085326s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_996b624d-00ef-4678-8cfa-ad052b261509
11852024-05-10T21:24:08.507ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c1dcad46-3d8d-4678-899a-efb74ec83395") failed: Property not found. retry in 922.931713ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c1dcad46-3d8d-4678-899a-efb74ec83395
11862024-05-10T21:24:08.522ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2fc7758a-cae3-4d9b-ade9-3a7691598581") failed: Property not found. retry in 1.309226573s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2fc7758a-cae3-4d9b-ade9-3a7691598581
11872024-05-10T21:24:08.534ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dd46fcb1-c07b-4880-9112-3895f2df61ed") failed: Property not found. retry in 1.047073042s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_dd46fcb1-c07b-4880-9112-3895f2df61ed
11882024-05-10T21:24:08.547ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7bb2217a-5bab-47ca-8e9e-29f166894592") failed: Property not found. retry in 1.136534867s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7bb2217a-5bab-47ca-8e9e-29f166894592
11892024-05-10T21:24:08.558ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66d05714-044e-4478-a42e-018c12715d96") failed: Property not found. retry in 1.217971986s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_66d05714-044e-4478-a42e-018c12715d96
11902024-05-10T21:24:08.569ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_06efb5f5-bb93-4e71-b8a9-60f655f78031") failed: Property not found. retry in 1.473456019s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_06efb5f5-bb93-4e71-b8a9-60f655f78031
11912024-05-10T21:24:08.629ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ada61d89-35f2-4021-829f-0d604c91d0ff") failed: Property not found. retry in 1.492219411s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ada61d89-35f2-4021-829f-0d604c91d0ff
11922024-05-10T21:24:08.799ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7325b560-f7aa-4399-a6c6-a3322f42d759") failed: Property not found. retry in 640.287293ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_7325b560-f7aa-4399-a6c6-a3322f42d759
11932024-05-10T21:24:08.820ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_95738557-5fbe-4760-a2f5-e295833eb800") failed: Property not found. retry in 952.074124ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_95738557-5fbe-4760-a2f5-e295833eb800
11942024-05-10T21:24:08.879ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5c09bf7a-54dd-4d4c-bdd3-12884bf29927") failed: Property not found. retry in 880.148866ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5c09bf7a-54dd-4d4c-bdd3-12884bf29927
11952024-05-10T21:24:08.891ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6578850-a802-4381-b533-4fb297487a8f") failed: Property not found. retry in 923.096837ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6578850-a802-4381-b533-4fb297487a8f
11962024-05-10T21:24:08.915ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0af3291d-7808-448b-a5ec-68ea6a4730ef") failed: Property not found. retry in 1.420439227s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0af3291d-7808-448b-a5ec-68ea6a4730ef
11972024-05-10T21:24:09.121ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e03d4432-8b77-4406-904d-ebd71cc9739e") failed: Property not found. retry in 1.238029976s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e03d4432-8b77-4406-904d-ebd71cc9739e
11982024-05-10T21:24:09.144ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_101e94eb-79e6-493c-8bba-b631934a03b9") failed: Property not found. retry in 818.653288ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_101e94eb-79e6-493c-8bba-b631934a03b9
11992024-05-10T21:24:09.173ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d7314b67-85b3-4c30-acfc-5e9dff5e5939") failed: Property not found. retry in 1.351664627s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d7314b67-85b3-4c30-acfc-5e9dff5e5939
12002024-05-10T21:24:09.407ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b473a0f3-4103-4d03-9647-a8361e344d97") failed: Property not found. retry in 1.066037195s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b473a0f3-4103-4d03-9647-a8361e344d97
12012024-05-10T21:24:09.441ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c1dcad46-3d8d-4678-899a-efb74ec83395") failed: Property not found. retry in 996.193611ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c1dcad46-3d8d-4678-899a-efb74ec83395
12022024-05-10T21:24:09.451ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7325b560-f7aa-4399-a6c6-a3322f42d759") failed: Property not found. retry in 623.584103ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_7325b560-f7aa-4399-a6c6-a3322f42d759
12032024-05-10T21:24:09.549ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_996b624d-00ef-4678-8cfa-ad052b261509") failed: Property not found. retry in 1.372260477s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_996b624d-00ef-4678-8cfa-ad052b261509
12042024-05-10T21:24:09.589ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dd46fcb1-c07b-4880-9112-3895f2df61ed") failed: Property not found. retry in 619.449047ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_dd46fcb1-c07b-4880-9112-3895f2df61ed
12052024-05-10T21:24:09.669ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4fdb69f7-0af6-40d3-9922-f38ae4f0f54b") failed: Property not found. retry in 1.473079678s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4fdb69f7-0af6-40d3-9922-f38ae4f0f54b
12062024-05-10T21:24:09.696ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7bb2217a-5bab-47ca-8e9e-29f166894592") failed: Property not found. retry in 954.671442ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7bb2217a-5bab-47ca-8e9e-29f166894592
12072024-05-10T21:24:09.770ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5c09bf7a-54dd-4d4c-bdd3-12884bf29927") failed: Property not found. retry in 628.751389ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5c09bf7a-54dd-4d4c-bdd3-12884bf29927
12082024-05-10T21:24:09.783ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_95738557-5fbe-4760-a2f5-e295833eb800") failed: Property not found. retry in 708.231066ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_95738557-5fbe-4760-a2f5-e295833eb800
12092024-05-10T21:24:09.792ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66d05714-044e-4478-a42e-018c12715d96") failed: Property not found. retry in 1.201146759s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_66d05714-044e-4478-a42e-018c12715d96
12102024-05-10T21:24:09.826ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6578850-a802-4381-b533-4fb297487a8f") failed: Property not found. retry in 1.376831938s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6578850-a802-4381-b533-4fb297487a8f
12112024-05-10T21:24:09.842ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2fc7758a-cae3-4d9b-ade9-3a7691598581") failed: Property not found. retry in 1.049745012s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2fc7758a-cae3-4d9b-ade9-3a7691598581
12122024-05-10T21:24:09.972ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_101e94eb-79e6-493c-8bba-b631934a03b9") failed: Property not found. retry in 1.412979759s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_101e94eb-79e6-493c-8bba-b631934a03b9
12132024-05-10T21:24:10.072ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_06efb5f5-bb93-4e71-b8a9-60f655f78031") failed: Property not found. retry in 850.108668ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_06efb5f5-bb93-4e71-b8a9-60f655f78031
12142024-05-10T21:24:10.083ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7325b560-f7aa-4399-a6c6-a3322f42d759") failed: Property not found. retry in 1.30208524s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_7325b560-f7aa-4399-a6c6-a3322f42d759
12152024-05-10T21:24:10.131ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ada61d89-35f2-4021-829f-0d604c91d0ff") failed: Property not found. retry in 648.440811ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ada61d89-35f2-4021-829f-0d604c91d0ff
12162024-05-10T21:24:10.238ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dd46fcb1-c07b-4880-9112-3895f2df61ed") failed: Property not found. retry in 1.27402987s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_dd46fcb1-c07b-4880-9112-3895f2df61ed
12172024-05-10T21:24:10.351ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0af3291d-7808-448b-a5ec-68ea6a4730ef") failed: Property not found. retry in 1.073826172s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0af3291d-7808-448b-a5ec-68ea6a4730ef
12182024-05-10T21:24:10.372ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e03d4432-8b77-4406-904d-ebd71cc9739e") failed: Property not found. retry in 859.914288ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e03d4432-8b77-4406-904d-ebd71cc9739e
12192024-05-10T21:24:10.408ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5c09bf7a-54dd-4d4c-bdd3-12884bf29927") failed: Property not found. retry in 1.267295939s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5c09bf7a-54dd-4d4c-bdd3-12884bf29927
12202024-05-10T21:24:10.447ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c1dcad46-3d8d-4678-899a-efb74ec83395") failed: Property not found. retry in 1.242451661s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c1dcad46-3d8d-4678-899a-efb74ec83395
12212024-05-10T21:24:10.480ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b473a0f3-4103-4d03-9647-a8361e344d97") failed: Property not found. retry in 1.476190194s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b473a0f3-4103-4d03-9647-a8361e344d97
12222024-05-10T21:24:10.499ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_95738557-5fbe-4760-a2f5-e295833eb800") failed: Property not found. retry in 1.249802286s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_95738557-5fbe-4760-a2f5-e295833eb800
12232024-05-10T21:24:10.533ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d7314b67-85b3-4c30-acfc-5e9dff5e5939") failed: Property not found. retry in 802.588204ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d7314b67-85b3-4c30-acfc-5e9dff5e5939
12242024-05-10T21:24:10.660ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7bb2217a-5bab-47ca-8e9e-29f166894592") failed: Property not found. retry in 1.120632868s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7bb2217a-5bab-47ca-8e9e-29f166894592
12252024-05-10T21:24:10.789ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ada61d89-35f2-4021-829f-0d604c91d0ff") failed: Property not found. retry in 883.291623ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ada61d89-35f2-4021-829f-0d604c91d0ff
12262024-05-10T21:24:10.903ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2fc7758a-cae3-4d9b-ade9-3a7691598581") failed: Property not found. retry in 1.256051237s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2fc7758a-cae3-4d9b-ade9-3a7691598581
12272024-05-10T21:24:10.930ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_06efb5f5-bb93-4e71-b8a9-60f655f78031") failed: Property not found. retry in 510.706107ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_06efb5f5-bb93-4e71-b8a9-60f655f78031
12282024-05-10T21:24:10.937ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_996b624d-00ef-4678-8cfa-ad052b261509") failed: Property not found. retry in 731.564134ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_996b624d-00ef-4678-8cfa-ad052b261509
12292024-05-10T21:24:11.003ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66d05714-044e-4478-a42e-018c12715d96") failed: Property not found. retry in 1.422478535s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_66d05714-044e-4478-a42e-018c12715d96
12302024-05-10T21:24:11.149ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4fdb69f7-0af6-40d3-9922-f38ae4f0f54b") failed: Property not found. retry in 509.086453ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4fdb69f7-0af6-40d3-9922-f38ae4f0f54b
12312024-05-10T21:24:11.212ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6578850-a802-4381-b533-4fb297487a8f") failed: Property not found. retry in 843.926006ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6578850-a802-4381-b533-4fb297487a8f
12322024-05-10T21:24:11.241ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e03d4432-8b77-4406-904d-ebd71cc9739e") failed: Property not found. retry in 1.073893905s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e03d4432-8b77-4406-904d-ebd71cc9739e
12332024-05-10T21:24:11.343ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d7314b67-85b3-4c30-acfc-5e9dff5e5939") failed: Property not found. retry in 758.081665ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d7314b67-85b3-4c30-acfc-5e9dff5e5939
12342024-05-10T21:24:11.394ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_101e94eb-79e6-493c-8bba-b631934a03b9") failed: Property not found. retry in 1.478388365s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_101e94eb-79e6-493c-8bba-b631934a03b9
12352024-05-10T21:24:11.403ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7325b560-f7aa-4399-a6c6-a3322f42d759") failed: Property not found. retry in 709.767806ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_7325b560-f7aa-4399-a6c6-a3322f42d759
12362024-05-10T21:24:11.433ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0af3291d-7808-448b-a5ec-68ea6a4730ef") failed: Property not found. retry in 1.020748803s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0af3291d-7808-448b-a5ec-68ea6a4730ef
12372024-05-10T21:24:11.449ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_06efb5f5-bb93-4e71-b8a9-60f655f78031") failed: Property not found. retry in 1.279430413s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_06efb5f5-bb93-4e71-b8a9-60f655f78031
12382024-05-10T21:24:11.520ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dd46fcb1-c07b-4880-9112-3895f2df61ed") failed: Property not found. retry in 1.294096607s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_dd46fcb1-c07b-4880-9112-3895f2df61ed
12392024-05-10T21:24:11.668ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4fdb69f7-0af6-40d3-9922-f38ae4f0f54b") failed: Property not found. retry in 698.975439ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4fdb69f7-0af6-40d3-9922-f38ae4f0f54b
12402024-05-10T21:24:11.676ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_996b624d-00ef-4678-8cfa-ad052b261509") failed: Property not found. retry in 1.084077821s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_996b624d-00ef-4678-8cfa-ad052b261509
12412024-05-10T21:24:11.683ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ada61d89-35f2-4021-829f-0d604c91d0ff") failed: Property not found. retry in 1.252828309s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ada61d89-35f2-4021-829f-0d604c91d0ff
12422024-05-10T21:24:11.691ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5c09bf7a-54dd-4d4c-bdd3-12884bf29927") failed: Property not found. retry in 1.184690565s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5c09bf7a-54dd-4d4c-bdd3-12884bf29927
12432024-05-10T21:24:11.699ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c1dcad46-3d8d-4678-899a-efb74ec83395") failed: Property not found. retry in 588.586582ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c1dcad46-3d8d-4678-899a-efb74ec83395
12442024-05-10T21:24:11.757ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_95738557-5fbe-4760-a2f5-e295833eb800") failed: Property not found. retry in 1.354054713s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_95738557-5fbe-4760-a2f5-e295833eb800
12452024-05-10T21:24:11.788ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7bb2217a-5bab-47ca-8e9e-29f166894592") failed: Property not found. retry in 662.671217ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7bb2217a-5bab-47ca-8e9e-29f166894592
12462024-05-10T21:24:11.964ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b473a0f3-4103-4d03-9647-a8361e344d97") failed: Property not found. retry in 1.266052919s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b473a0f3-4103-4d03-9647-a8361e344d97
12472024-05-10T21:24:12.065ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6578850-a802-4381-b533-4fb297487a8f") failed: Property not found. retry in 881.202197ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6578850-a802-4381-b533-4fb297487a8f
12482024-05-10T21:24:12.109ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d7314b67-85b3-4c30-acfc-5e9dff5e5939") failed: Property not found. retry in 894.485055ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d7314b67-85b3-4c30-acfc-5e9dff5e5939
12492024-05-10T21:24:12.121ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7325b560-f7aa-4399-a6c6-a3322f42d759") failed: Property not found. retry in 1.201924619s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_7325b560-f7aa-4399-a6c6-a3322f42d759
12502024-05-10T21:24:12.170ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2fc7758a-cae3-4d9b-ade9-3a7691598581") failed: Property not found. retry in 1.101780554s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2fc7758a-cae3-4d9b-ade9-3a7691598581
12512024-05-10T21:24:12.297ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c1dcad46-3d8d-4678-899a-efb74ec83395") failed: Property not found. retry in 1.276816007s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c1dcad46-3d8d-4678-899a-efb74ec83395
12522024-05-10T21:24:12.324ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e03d4432-8b77-4406-904d-ebd71cc9739e") failed: Property not found. retry in 1.062544577s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e03d4432-8b77-4406-904d-ebd71cc9739e
12532024-05-10T21:24:12.376ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4fdb69f7-0af6-40d3-9922-f38ae4f0f54b") failed: Property not found. retry in 1.377645072s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4fdb69f7-0af6-40d3-9922-f38ae4f0f54b
12542024-05-10T21:24:12.436ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66d05714-044e-4478-a42e-018c12715d96") failed: Property not found. retry in 1.356947229s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_66d05714-044e-4478-a42e-018c12715d96
12552024-05-10T21:24:12.464ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7bb2217a-5bab-47ca-8e9e-29f166894592") failed: Property not found. retry in 1.279559477s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7bb2217a-5bab-47ca-8e9e-29f166894592
12562024-05-10T21:24:12.475ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0af3291d-7808-448b-a5ec-68ea6a4730ef") failed: Property not found. retry in 1.321323488s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0af3291d-7808-448b-a5ec-68ea6a4730ef
12572024-05-10T21:24:12.739ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_06efb5f5-bb93-4e71-b8a9-60f655f78031") failed: Property not found. retry in 579.721336ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_06efb5f5-bb93-4e71-b8a9-60f655f78031
12582024-05-10T21:24:12.772ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_996b624d-00ef-4678-8cfa-ad052b261509") failed: Property not found. retry in 827.593996ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_996b624d-00ef-4678-8cfa-ad052b261509
12592024-05-10T21:24:12.824ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dd46fcb1-c07b-4880-9112-3895f2df61ed") failed: Property not found. retry in 1.225233244s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_dd46fcb1-c07b-4880-9112-3895f2df61ed
12602024-05-10T21:24:12.882ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_101e94eb-79e6-493c-8bba-b631934a03b9") failed: Property not found. retry in 568.907067ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_101e94eb-79e6-493c-8bba-b631934a03b9
12612024-05-10T21:24:12.893ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5c09bf7a-54dd-4d4c-bdd3-12884bf29927") failed: Property not found. retry in 1.125738952s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5c09bf7a-54dd-4d4c-bdd3-12884bf29927
12622024-05-10T21:24:12.951ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ada61d89-35f2-4021-829f-0d604c91d0ff") failed: Property not found. retry in 838.053727ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ada61d89-35f2-4021-829f-0d604c91d0ff
12632024-05-10T21:24:12.963ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6578850-a802-4381-b533-4fb297487a8f") failed: Property not found. retry in 870.257006ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6578850-a802-4381-b533-4fb297487a8f
12642024-05-10T21:24:13.015ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d7314b67-85b3-4c30-acfc-5e9dff5e5939") failed: Property not found. retry in 1.317625331s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d7314b67-85b3-4c30-acfc-5e9dff5e5939
12652024-05-10T21:24:13.126ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_95738557-5fbe-4760-a2f5-e295833eb800") failed: Property not found. retry in 1.076576698s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_95738557-5fbe-4760-a2f5-e295833eb800
12662024-05-10T21:24:13.239ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b473a0f3-4103-4d03-9647-a8361e344d97") failed: Property not found. retry in 1.282952082s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b473a0f3-4103-4d03-9647-a8361e344d97
12672024-05-10T21:24:13.280ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2fc7758a-cae3-4d9b-ade9-3a7691598581") failed: Property not found. retry in 512.358943ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2fc7758a-cae3-4d9b-ade9-3a7691598581
12682024-05-10T21:24:13.327ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_06efb5f5-bb93-4e71-b8a9-60f655f78031") failed: Property not found. retry in 1.325314989s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_06efb5f5-bb93-4e71-b8a9-60f655f78031
12692024-05-10T21:24:13.336ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7325b560-f7aa-4399-a6c6-a3322f42d759") failed: Property not found. retry in 858.734153ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_7325b560-f7aa-4399-a6c6-a3322f42d759
12702024-05-10T21:24:13.397ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e03d4432-8b77-4406-904d-ebd71cc9739e") failed: Property not found. retry in 1.4650258s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e03d4432-8b77-4406-904d-ebd71cc9739e
12712024-05-10T21:24:13.463ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_101e94eb-79e6-493c-8bba-b631934a03b9") failed: Property not found. retry in 1.132438551s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_101e94eb-79e6-493c-8bba-b631934a03b9
12722024-05-10T21:24:13.590ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c1dcad46-3d8d-4678-899a-efb74ec83395") failed: Property not found. retry in 716.546989ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c1dcad46-3d8d-4678-899a-efb74ec83395
12732024-05-10T21:24:13.611ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_996b624d-00ef-4678-8cfa-ad052b261509") failed: Property not found. retry in 844.719687ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_996b624d-00ef-4678-8cfa-ad052b261509
12742024-05-10T21:24:13.755ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7bb2217a-5bab-47ca-8e9e-29f166894592") failed: Property not found. retry in 1.320383409s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7bb2217a-5bab-47ca-8e9e-29f166894592
12752024-05-10T21:24:13.765ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4fdb69f7-0af6-40d3-9922-f38ae4f0f54b") failed: Property not found. retry in 591.37976ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4fdb69f7-0af6-40d3-9922-f38ae4f0f54b
12762024-05-10T21:24:13.799ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ada61d89-35f2-4021-829f-0d604c91d0ff") failed: Property not found. retry in 1.289104928s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ada61d89-35f2-4021-829f-0d604c91d0ff
12772024-05-10T21:24:13.808ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0af3291d-7808-448b-a5ec-68ea6a4730ef") failed: Property not found. retry in 947.96236ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0af3291d-7808-448b-a5ec-68ea6a4730ef
12782024-05-10T21:24:13.818ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2fc7758a-cae3-4d9b-ade9-3a7691598581") failed: Property not found. retry in 847.255333ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2fc7758a-cae3-4d9b-ade9-3a7691598581
12792024-05-10T21:24:13.826ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66d05714-044e-4478-a42e-018c12715d96") failed: Property not found. retry in 1.476990175s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_66d05714-044e-4478-a42e-018c12715d96
12802024-05-10T21:24:13.846ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6578850-a802-4381-b533-4fb297487a8f") failed: Property not found. retry in 586.169431ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6578850-a802-4381-b533-4fb297487a8f
12812024-05-10T21:24:14.030ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5c09bf7a-54dd-4d4c-bdd3-12884bf29927") failed: Property not found. retry in 1.490084006s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5c09bf7a-54dd-4d4c-bdd3-12884bf29927
12822024-05-10T21:24:14.061ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dd46fcb1-c07b-4880-9112-3895f2df61ed") failed: Property not found. retry in 805.249515ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_dd46fcb1-c07b-4880-9112-3895f2df61ed
12832024-05-10T21:24:14.211ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7325b560-f7aa-4399-a6c6-a3322f42d759") failed: Property not found. retry in 564.641243ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_7325b560-f7aa-4399-a6c6-a3322f42d759
12842024-05-10T21:24:14.227ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_95738557-5fbe-4760-a2f5-e295833eb800") failed: Property not found. retry in 875.759367ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_95738557-5fbe-4760-a2f5-e295833eb800
12852024-05-10T21:24:14.321ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c1dcad46-3d8d-4678-899a-efb74ec83395") failed: Property not found. retry in 604.574757ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c1dcad46-3d8d-4678-899a-efb74ec83395
12862024-05-10T21:24:14.348ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d7314b67-85b3-4c30-acfc-5e9dff5e5939") failed: Property not found. retry in 1.301735205s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d7314b67-85b3-4c30-acfc-5e9dff5e5939
12872024-05-10T21:24:14.373ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4fdb69f7-0af6-40d3-9922-f38ae4f0f54b") failed: Property not found. retry in 1.295937715s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4fdb69f7-0af6-40d3-9922-f38ae4f0f54b
12882024-05-10T21:24:14.448ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6578850-a802-4381-b533-4fb297487a8f") failed: Property not found. retry in 594.268019ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6578850-a802-4381-b533-4fb297487a8f
12892024-05-10T21:24:14.470ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_996b624d-00ef-4678-8cfa-ad052b261509") failed: Property not found. retry in 1.140372484s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_996b624d-00ef-4678-8cfa-ad052b261509
12902024-05-10T21:24:14.536ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b473a0f3-4103-4d03-9647-a8361e344d97") failed: Property not found. retry in 1.25747997s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b473a0f3-4103-4d03-9647-a8361e344d97
12912024-05-10T21:24:14.614ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_101e94eb-79e6-493c-8bba-b631934a03b9") failed: Property not found. retry in 953.311679ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_101e94eb-79e6-493c-8bba-b631934a03b9
12922024-05-10T21:24:14.668ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_06efb5f5-bb93-4e71-b8a9-60f655f78031") failed: Property not found. retry in 934.280742ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_06efb5f5-bb93-4e71-b8a9-60f655f78031
12932024-05-10T21:24:14.685ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2fc7758a-cae3-4d9b-ade9-3a7691598581") failed: Property not found. retry in 1.241394451s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2fc7758a-cae3-4d9b-ade9-3a7691598581
12942024-05-10T21:24:14.773ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0af3291d-7808-448b-a5ec-68ea6a4730ef") failed: Property not found. retry in 1.329215014s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0af3291d-7808-448b-a5ec-68ea6a4730ef
12952024-05-10T21:24:14.791ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7325b560-f7aa-4399-a6c6-a3322f42d759") failed: Property not found. retry in 1.295079427s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_7325b560-f7aa-4399-a6c6-a3322f42d759
12962024-05-10T21:24:14.876ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e03d4432-8b77-4406-904d-ebd71cc9739e") failed: Property not found. retry in 1.037532367s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e03d4432-8b77-4406-904d-ebd71cc9739e
12972024-05-10T21:24:14.890ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dd46fcb1-c07b-4880-9112-3895f2df61ed") failed: Property not found. retry in 1.057567093s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_dd46fcb1-c07b-4880-9112-3895f2df61ed
12982024-05-10T21:24:14.946ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c1dcad46-3d8d-4678-899a-efb74ec83395") failed: Property not found. retry in 782.338616ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c1dcad46-3d8d-4678-899a-efb74ec83395
12992024-05-10T21:24:14.990ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_207101fa-3f8f-4bbb-a8c0-4f0407f828e8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService22"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::e"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::e"/> <propval type="astring" name="listen_port" value="8123"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13002024-05-10T21:24:14.991ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_clickhouse_207101fa-3f8f-4bbb-a8c0-4f0407f828e8
13012024-05-10T21:24:15.059ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6578850-a802-4381-b533-4fb297487a8f") failed: Property not found. retry in 677.17097ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6578850-a802-4381-b533-4fb297487a8f
13022024-05-10T21:24:15.087ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7bb2217a-5bab-47ca-8e9e-29f166894592") failed: Property not found. retry in 1.419241539s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7bb2217a-5bab-47ca-8e9e-29f166894592
13032024-05-10T21:24:15.102ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ada61d89-35f2-4021-829f-0d604c91d0ff") failed: Property not found. retry in 1.211656691s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ada61d89-35f2-4021-829f-0d604c91d0ff
13042024-05-10T21:24:15.116ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_95738557-5fbe-4760-a2f5-e295833eb800") failed: Property not found. retry in 1.437956059s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_95738557-5fbe-4760-a2f5-e295833eb800
13052024-05-10T21:24:15.306ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_207101fa-3f8f-4bbb-a8c0-4f0407f828e8") failed: Property not found. retry in 31.786213ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_207101fa-3f8f-4bbb-a8c0-4f0407f828e8
13062024-05-10T21:24:15.325ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66d05714-044e-4478-a42e-018c12715d96") failed: Property not found. retry in 1.419192015s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_66d05714-044e-4478-a42e-018c12715d96
13072024-05-10T21:24:15.351ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_207101fa-3f8f-4bbb-a8c0-4f0407f828e8") failed: Property not found. retry in 127.655797ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_207101fa-3f8f-4bbb-a8c0-4f0407f828e8
13082024-05-10T21:24:15.501ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_207101fa-3f8f-4bbb-a8c0-4f0407f828e8") failed: Property not found. retry in 121.806497ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_207101fa-3f8f-4bbb-a8c0-4f0407f828e8
13092024-05-10T21:24:15.548ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5c09bf7a-54dd-4d4c-bdd3-12884bf29927") failed: Property not found. retry in 712.250914ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5c09bf7a-54dd-4d4c-bdd3-12884bf29927
13102024-05-10T21:24:15.584ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_101e94eb-79e6-493c-8bba-b631934a03b9") failed: Property not found. retry in 862.756287ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_101e94eb-79e6-493c-8bba-b631934a03b9
13112024-05-10T21:24:15.617ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_06efb5f5-bb93-4e71-b8a9-60f655f78031") failed: Property not found. retry in 954.114608ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_06efb5f5-bb93-4e71-b8a9-60f655f78031
13122024-05-10T21:24:15.629ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_996b624d-00ef-4678-8cfa-ad052b261509") failed: Property not found. retry in 679.297808ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_996b624d-00ef-4678-8cfa-ad052b261509
13132024-05-10T21:24:15.643ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_207101fa-3f8f-4bbb-a8c0-4f0407f828e8") failed: Property not found. retry in 316.303515ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_207101fa-3f8f-4bbb-a8c0-4f0407f828e8
13142024-05-10T21:24:15.663ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d7314b67-85b3-4c30-acfc-5e9dff5e5939") failed: Property not found. retry in 616.946032ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d7314b67-85b3-4c30-acfc-5e9dff5e5939
13152024-05-10T21:24:15.682ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4fdb69f7-0af6-40d3-9922-f38ae4f0f54b") failed: Property not found. retry in 1.099212272s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4fdb69f7-0af6-40d3-9922-f38ae4f0f54b
13162024-05-10T21:24:15.743ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c1dcad46-3d8d-4678-899a-efb74ec83395") failed: Property not found. retry in 827.50002ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c1dcad46-3d8d-4678-899a-efb74ec83395
13172024-05-10T21:24:15.757ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6578850-a802-4381-b533-4fb297487a8f") failed: Property not found. retry in 1.188452241s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6578850-a802-4381-b533-4fb297487a8f
13182024-05-10T21:24:15.816ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b473a0f3-4103-4d03-9647-a8361e344d97") failed: Property not found. retry in 1.307581499s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b473a0f3-4103-4d03-9647-a8361e344d97
13192024-05-10T21:24:15.930ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e03d4432-8b77-4406-904d-ebd71cc9739e") failed: Property not found. retry in 1.436316156s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e03d4432-8b77-4406-904d-ebd71cc9739e
13202024-05-10T21:24:15.943ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2fc7758a-cae3-4d9b-ade9-3a7691598581") failed: Property not found. retry in 1.120317901s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2fc7758a-cae3-4d9b-ade9-3a7691598581
13212024-05-10T21:24:15.963ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dd46fcb1-c07b-4880-9112-3895f2df61ed") failed: Property not found. retry in 503.741553ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_dd46fcb1-c07b-4880-9112-3895f2df61ed
13222024-05-10T21:24:15.978ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_207101fa-3f8f-4bbb-a8c0-4f0407f828e8") failed: Property not found. retry in 1.066979127s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_207101fa-3f8f-4bbb-a8c0-4f0407f828e8
13232024-05-10T21:24:16.098ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7325b560-f7aa-4399-a6c6-a3322f42d759") failed: Property not found. retry in 723.374159ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_7325b560-f7aa-4399-a6c6-a3322f42d759
13242024-05-10T21:24:16.111ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0af3291d-7808-448b-a5ec-68ea6a4730ef") failed: Property not found. retry in 792.787145ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0af3291d-7808-448b-a5ec-68ea6a4730ef
13252024-05-10T21:24:16.273ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5c09bf7a-54dd-4d4c-bdd3-12884bf29927") failed: Property not found. retry in 1.328295123s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5c09bf7a-54dd-4d4c-bdd3-12884bf29927
13262024-05-10T21:24:16.290ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d7314b67-85b3-4c30-acfc-5e9dff5e5939") failed: Property not found. retry in 584.79537ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d7314b67-85b3-4c30-acfc-5e9dff5e5939
13272024-05-10T21:24:16.320ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_996b624d-00ef-4678-8cfa-ad052b261509") failed: Property not found. retry in 757.027655ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_996b624d-00ef-4678-8cfa-ad052b261509
13282024-05-10T21:24:16.329ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ada61d89-35f2-4021-829f-0d604c91d0ff") failed: Property not found. retry in 1.041308146s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ada61d89-35f2-4021-829f-0d604c91d0ff
13292024-05-10T21:24:16.458ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_101e94eb-79e6-493c-8bba-b631934a03b9") failed: Property not found. retry in 782.9558ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_101e94eb-79e6-493c-8bba-b631934a03b9
13302024-05-10T21:24:16.476ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dd46fcb1-c07b-4880-9112-3895f2df61ed") failed: Property not found. retry in 1.033816449s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_dd46fcb1-c07b-4880-9112-3895f2df61ed
13312024-05-10T21:24:16.516ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7bb2217a-5bab-47ca-8e9e-29f166894592") failed: Property not found. retry in 895.049086ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7bb2217a-5bab-47ca-8e9e-29f166894592
13322024-05-10T21:24:16.564ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_95738557-5fbe-4760-a2f5-e295833eb800") failed: Property not found. retry in 1.060620612s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_95738557-5fbe-4760-a2f5-e295833eb800
13332024-05-10T21:24:16.580ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c1dcad46-3d8d-4678-899a-efb74ec83395") failed: Property not found. retry in 809.989399ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c1dcad46-3d8d-4678-899a-efb74ec83395
13342024-05-10T21:24:16.592ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_06efb5f5-bb93-4e71-b8a9-60f655f78031") failed: Property not found. retry in 1.026240418s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_06efb5f5-bb93-4e71-b8a9-60f655f78031
13352024-05-10T21:24:16.754ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66d05714-044e-4478-a42e-018c12715d96") failed: Property not found. retry in 823.737702ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_66d05714-044e-4478-a42e-018c12715d96
13362024-05-10T21:24:16.795ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4fdb69f7-0af6-40d3-9922-f38ae4f0f54b") failed: Property not found. retry in 1.29602534s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4fdb69f7-0af6-40d3-9922-f38ae4f0f54b
13372024-05-10T21:24:16.832ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7325b560-f7aa-4399-a6c6-a3322f42d759") failed: Property not found. retry in 777.902701ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_7325b560-f7aa-4399-a6c6-a3322f42d759
13382024-05-10T21:24:16.886ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d7314b67-85b3-4c30-acfc-5e9dff5e5939") failed: Property not found. retry in 1.338650885s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d7314b67-85b3-4c30-acfc-5e9dff5e5939
13392024-05-10T21:24:16.916ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0af3291d-7808-448b-a5ec-68ea6a4730ef") failed: Property not found. retry in 1.269201965s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0af3291d-7808-448b-a5ec-68ea6a4730ef
13402024-05-10T21:24:16.958ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6578850-a802-4381-b533-4fb297487a8f") failed: Property not found. retry in 827.932742ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6578850-a802-4381-b533-4fb297487a8f
13412024-05-10T21:24:17.061ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_207101fa-3f8f-4bbb-a8c0-4f0407f828e8") failed: Property not found. retry in 695.444557ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_207101fa-3f8f-4bbb-a8c0-4f0407f828e8
13422024-05-10T21:24:17.076ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2fc7758a-cae3-4d9b-ade9-3a7691598581") failed: Property not found. retry in 966.724045ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2fc7758a-cae3-4d9b-ade9-3a7691598581
13432024-05-10T21:24:17.090ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_996b624d-00ef-4678-8cfa-ad052b261509") failed: Property not found. retry in 662.249907ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_996b624d-00ef-4678-8cfa-ad052b261509
13442024-05-10T21:24:17.136ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b473a0f3-4103-4d03-9647-a8361e344d97") failed: Property not found. retry in 1.000601658s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b473a0f3-4103-4d03-9647-a8361e344d97
13452024-05-10T21:24:17.252ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_101e94eb-79e6-493c-8bba-b631934a03b9") failed: Property not found. retry in 1.128006161s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_101e94eb-79e6-493c-8bba-b631934a03b9
13462024-05-10T21:24:17.381ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e03d4432-8b77-4406-904d-ebd71cc9739e") failed: Property not found. retry in 817.275915ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e03d4432-8b77-4406-904d-ebd71cc9739e
13472024-05-10T21:24:17.394ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ada61d89-35f2-4021-829f-0d604c91d0ff") failed: Property not found. retry in 1.16538492s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ada61d89-35f2-4021-829f-0d604c91d0ff
13482024-05-10T21:24:17.406ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c1dcad46-3d8d-4678-899a-efb74ec83395") failed: Property not found. retry in 1.113426157s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c1dcad46-3d8d-4678-899a-efb74ec83395
13492024-05-10T21:24:17.425ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7bb2217a-5bab-47ca-8e9e-29f166894592") failed: Property not found. retry in 1.396891049s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7bb2217a-5bab-47ca-8e9e-29f166894592
13502024-05-10T21:24:17.525ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dd46fcb1-c07b-4880-9112-3895f2df61ed") failed: Property not found. retry in 898.089414ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_dd46fcb1-c07b-4880-9112-3895f2df61ed
13512024-05-10T21:24:17.592ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66d05714-044e-4478-a42e-018c12715d96") failed: Property not found. retry in 555.045978ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_66d05714-044e-4478-a42e-018c12715d96
13522024-05-10T21:24:17.616ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5c09bf7a-54dd-4d4c-bdd3-12884bf29927") failed: Property not found. retry in 1.041685968s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5c09bf7a-54dd-4d4c-bdd3-12884bf29927
13532024-05-10T21:24:17.630ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7325b560-f7aa-4399-a6c6-a3322f42d759") failed: Property not found. retry in 876.517831ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_7325b560-f7aa-4399-a6c6-a3322f42d759
13542024-05-10T21:24:17.643ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_06efb5f5-bb93-4e71-b8a9-60f655f78031") failed: Property not found. retry in 927.086407ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_06efb5f5-bb93-4e71-b8a9-60f655f78031
13552024-05-10T21:24:17.656ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_95738557-5fbe-4760-a2f5-e295833eb800") failed: Property not found. retry in 651.656938ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_95738557-5fbe-4760-a2f5-e295833eb800
13562024-05-10T21:24:17.769ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_996b624d-00ef-4678-8cfa-ad052b261509") failed: Property not found. retry in 1.291422488s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_996b624d-00ef-4678-8cfa-ad052b261509
13572024-05-10T21:24:17.787ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_207101fa-3f8f-4bbb-a8c0-4f0407f828e8") failed: Property not found. retry in 513.302194ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_207101fa-3f8f-4bbb-a8c0-4f0407f828e8
13582024-05-10T21:24:17.801ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6578850-a802-4381-b533-4fb297487a8f") failed: Property not found. retry in 822.282164ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6578850-a802-4381-b533-4fb297487a8f
13592024-05-10T21:24:18.056ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2fc7758a-cae3-4d9b-ade9-3a7691598581") failed: Property not found. retry in 928.903258ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2fc7758a-cae3-4d9b-ade9-3a7691598581
13602024-05-10T21:24:18.104ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4fdb69f7-0af6-40d3-9922-f38ae4f0f54b") failed: Property not found. retry in 1.311683019s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4fdb69f7-0af6-40d3-9922-f38ae4f0f54b
13612024-05-10T21:24:18.151ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b473a0f3-4103-4d03-9647-a8361e344d97") failed: Property not found. retry in 1.215975429s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b473a0f3-4103-4d03-9647-a8361e344d97
13622024-05-10T21:24:18.164ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66d05714-044e-4478-a42e-018c12715d96") failed: Property not found. retry in 719.483559ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_66d05714-044e-4478-a42e-018c12715d96
13632024-05-10T21:24:18.199ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0af3291d-7808-448b-a5ec-68ea6a4730ef") failed: Property not found. retry in 652.489187ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0af3291d-7808-448b-a5ec-68ea6a4730ef
13642024-05-10T21:24:18.213ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e03d4432-8b77-4406-904d-ebd71cc9739e") failed: Property not found. retry in 509.603882ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e03d4432-8b77-4406-904d-ebd71cc9739e
13652024-05-10T21:24:18.237ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d7314b67-85b3-4c30-acfc-5e9dff5e5939") failed: Property not found. retry in 728.478367ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d7314b67-85b3-4c30-acfc-5e9dff5e5939
13662024-05-10T21:24:18.313ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_207101fa-3f8f-4bbb-a8c0-4f0407f828e8") failed: Property not found. retry in 632.838558ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_207101fa-3f8f-4bbb-a8c0-4f0407f828e8
13672024-05-10T21:24:18.325ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_95738557-5fbe-4760-a2f5-e295833eb800") failed: Property not found. retry in 1.484556534s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_95738557-5fbe-4760-a2f5-e295833eb800
13682024-05-10T21:24:18.392ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_101e94eb-79e6-493c-8bba-b631934a03b9") failed: Property not found. retry in 772.427012ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_101e94eb-79e6-493c-8bba-b631934a03b9
13692024-05-10T21:24:18.437ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dd46fcb1-c07b-4880-9112-3895f2df61ed") failed: Property not found. retry in 586.938808ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_dd46fcb1-c07b-4880-9112-3895f2df61ed
13702024-05-10T21:24:18.519ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7325b560-f7aa-4399-a6c6-a3322f42d759") failed: Property not found. retry in 1.360867497s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_7325b560-f7aa-4399-a6c6-a3322f42d759
13712024-05-10T21:24:18.531ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c1dcad46-3d8d-4678-899a-efb74ec83395") failed: Property not found. retry in 714.137447ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c1dcad46-3d8d-4678-899a-efb74ec83395
13722024-05-10T21:24:18.572ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ada61d89-35f2-4021-829f-0d604c91d0ff") failed: Property not found. retry in 625.640329ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ada61d89-35f2-4021-829f-0d604c91d0ff
13732024-05-10T21:24:18.585ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_06efb5f5-bb93-4e71-b8a9-60f655f78031") failed: Property not found. retry in 771.357715ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_06efb5f5-bb93-4e71-b8a9-60f655f78031
13742024-05-10T21:24:18.636ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6578850-a802-4381-b533-4fb297487a8f") failed: Property not found. retry in 734.303655ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6578850-a802-4381-b533-4fb297487a8f
13752024-05-10T21:24:18.671ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5c09bf7a-54dd-4d4c-bdd3-12884bf29927") failed: Property not found. retry in 1.202345528s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5c09bf7a-54dd-4d4c-bdd3-12884bf29927
13762024-05-10T21:24:18.735ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e03d4432-8b77-4406-904d-ebd71cc9739e") failed: Property not found. retry in 1.366301625s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e03d4432-8b77-4406-904d-ebd71cc9739e
13772024-05-10T21:24:18.836ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7bb2217a-5bab-47ca-8e9e-29f166894592") failed: Property not found. retry in 921.952901ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7bb2217a-5bab-47ca-8e9e-29f166894592
13782024-05-10T21:24:18.865ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0af3291d-7808-448b-a5ec-68ea6a4730ef") failed: Property not found. retry in 1.285431929s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0af3291d-7808-448b-a5ec-68ea6a4730ef
13792024-05-10T21:24:18.896ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66d05714-044e-4478-a42e-018c12715d96") failed: Property not found. retry in 1.125494369s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_66d05714-044e-4478-a42e-018c12715d96
13802024-05-10T21:24:18.958ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_207101fa-3f8f-4bbb-a8c0-4f0407f828e8") failed: Property not found. retry in 1.399341533s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_207101fa-3f8f-4bbb-a8c0-4f0407f828e8
13812024-05-10T21:24:18.976ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d7314b67-85b3-4c30-acfc-5e9dff5e5939") failed: Property not found. retry in 667.409647ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d7314b67-85b3-4c30-acfc-5e9dff5e5939
13822024-05-10T21:24:18.997ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2fc7758a-cae3-4d9b-ade9-3a7691598581") failed: Property not found. retry in 580.370139ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2fc7758a-cae3-4d9b-ade9-3a7691598581
13832024-05-10T21:24:19.035ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dd46fcb1-c07b-4880-9112-3895f2df61ed") failed: Property not found. retry in 527.911914ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_dd46fcb1-c07b-4880-9112-3895f2df61ed
13842024-05-10T21:24:19.072ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_996b624d-00ef-4678-8cfa-ad052b261509") failed: Property not found. retry in 1.437883047s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_996b624d-00ef-4678-8cfa-ad052b261509
13852024-05-10T21:24:19.174ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_101e94eb-79e6-493c-8bba-b631934a03b9") failed: Property not found. retry in 1.403253082s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_101e94eb-79e6-493c-8bba-b631934a03b9
13862024-05-10T21:24:19.207ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ada61d89-35f2-4021-829f-0d604c91d0ff") failed: Property not found. retry in 764.295926ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ada61d89-35f2-4021-829f-0d604c91d0ff
13872024-05-10T21:24:19.255ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c1dcad46-3d8d-4678-899a-efb74ec83395") failed: Property not found. retry in 1.381368919s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c1dcad46-3d8d-4678-899a-efb74ec83395
13882024-05-10T21:24:19.367ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_06efb5f5-bb93-4e71-b8a9-60f655f78031") failed: Property not found. retry in 819.482216ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_06efb5f5-bb93-4e71-b8a9-60f655f78031
13892024-05-10T21:24:19.376ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b473a0f3-4103-4d03-9647-a8361e344d97") failed: Property not found. retry in 1.445766692s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b473a0f3-4103-4d03-9647-a8361e344d97
13902024-05-10T21:24:19.386ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6578850-a802-4381-b533-4fb297487a8f") failed: Property not found. retry in 1.264413214s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6578850-a802-4381-b533-4fb297487a8f
13912024-05-10T21:24:19.425ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4fdb69f7-0af6-40d3-9922-f38ae4f0f54b") failed: Property not found. retry in 1.448047361s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4fdb69f7-0af6-40d3-9922-f38ae4f0f54b
13922024-05-10T21:24:19.574ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dd46fcb1-c07b-4880-9112-3895f2df61ed") failed: Property not found. retry in 1.454484637s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_dd46fcb1-c07b-4880-9112-3895f2df61ed
13932024-05-10T21:24:19.586ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2fc7758a-cae3-4d9b-ade9-3a7691598581") failed: Property not found. retry in 1.36485487s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2fc7758a-cae3-4d9b-ade9-3a7691598581
13942024-05-10T21:24:19.654ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d7314b67-85b3-4c30-acfc-5e9dff5e5939") failed: Property not found. retry in 1.217471234s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d7314b67-85b3-4c30-acfc-5e9dff5e5939
13952024-05-10T21:24:19.768ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7bb2217a-5bab-47ca-8e9e-29f166894592") failed: Property not found. retry in 537.950134ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7bb2217a-5bab-47ca-8e9e-29f166894592
13962024-05-10T21:24:19.818ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_95738557-5fbe-4760-a2f5-e295833eb800") failed: Property not found. retry in 1.295044137s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_95738557-5fbe-4760-a2f5-e295833eb800
13972024-05-10T21:24:19.884ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5c09bf7a-54dd-4d4c-bdd3-12884bf29927") failed: Property not found. retry in 592.314039ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5c09bf7a-54dd-4d4c-bdd3-12884bf29927
13982024-05-10T21:24:19.893ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7325b560-f7aa-4399-a6c6-a3322f42d759") failed: Property not found. retry in 1.336311588s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_7325b560-f7aa-4399-a6c6-a3322f42d759
13992024-05-10T21:24:19.980ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ada61d89-35f2-4021-829f-0d604c91d0ff") failed: Property not found. retry in 779.436281ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ada61d89-35f2-4021-829f-0d604c91d0ff
14002024-05-10T21:24:20.032ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66d05714-044e-4478-a42e-018c12715d96") failed: Property not found. retry in 1.005739773s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_66d05714-044e-4478-a42e-018c12715d96
14012024-05-10T21:24:20.112ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e03d4432-8b77-4406-904d-ebd71cc9739e") failed: Property not found. retry in 1.11832309s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e03d4432-8b77-4406-904d-ebd71cc9739e
14022024-05-10T21:24:20.160ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0af3291d-7808-448b-a5ec-68ea6a4730ef") failed: Property not found. retry in 1.444195676s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0af3291d-7808-448b-a5ec-68ea6a4730ef
14032024-05-10T21:24:20.195ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_06efb5f5-bb93-4e71-b8a9-60f655f78031") failed: Property not found. retry in 1.2906616s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_06efb5f5-bb93-4e71-b8a9-60f655f78031
14042024-05-10T21:24:20.315ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7bb2217a-5bab-47ca-8e9e-29f166894592") failed: Property not found. retry in 1.296999783s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7bb2217a-5bab-47ca-8e9e-29f166894592
14052024-05-10T21:24:20.366ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_207101fa-3f8f-4bbb-a8c0-4f0407f828e8") failed: Property not found. retry in 960.120585ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_207101fa-3f8f-4bbb-a8c0-4f0407f828e8
14062024-05-10T21:24:20.489ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5c09bf7a-54dd-4d4c-bdd3-12884bf29927") failed: Property not found. retry in 702.012267ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5c09bf7a-54dd-4d4c-bdd3-12884bf29927
14072024-05-10T21:24:20.520ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_996b624d-00ef-4678-8cfa-ad052b261509") failed: Property not found. retry in 663.492952ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_996b624d-00ef-4678-8cfa-ad052b261509
14082024-05-10T21:24:20.587ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_101e94eb-79e6-493c-8bba-b631934a03b9") failed: Property not found. retry in 1.412735858s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_101e94eb-79e6-493c-8bba-b631934a03b9
14092024-05-10T21:24:20.646ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c1dcad46-3d8d-4678-899a-efb74ec83395") failed: Property not found. retry in 927.454632ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c1dcad46-3d8d-4678-899a-efb74ec83395
14102024-05-10T21:24:20.659ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6578850-a802-4381-b533-4fb297487a8f") failed: Property not found. retry in 1.016010303s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6578850-a802-4381-b533-4fb297487a8f
14112024-05-10T21:24:20.769ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ada61d89-35f2-4021-829f-0d604c91d0ff") failed: Property not found. retry in 991.96212ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ada61d89-35f2-4021-829f-0d604c91d0ff
14122024-05-10T21:24:20.831ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b473a0f3-4103-4d03-9647-a8361e344d97") failed: Property not found. retry in 1.093244861s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b473a0f3-4103-4d03-9647-a8361e344d97
14132024-05-10T21:24:20.882ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d7314b67-85b3-4c30-acfc-5e9dff5e5939") failed: Property not found. retry in 749.714834ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d7314b67-85b3-4c30-acfc-5e9dff5e5939
14142024-05-10T21:24:20.890ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4fdb69f7-0af6-40d3-9922-f38ae4f0f54b") failed: Property not found. retry in 620.20668ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4fdb69f7-0af6-40d3-9922-f38ae4f0f54b
14152024-05-10T21:24:20.962ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2fc7758a-cae3-4d9b-ade9-3a7691598581") failed: Property not found. retry in 1.493284707s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2fc7758a-cae3-4d9b-ade9-3a7691598581
14162024-05-10T21:24:21.037ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dd46fcb1-c07b-4880-9112-3895f2df61ed") failed: Property not found. retry in 791.315348ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_dd46fcb1-c07b-4880-9112-3895f2df61ed
14172024-05-10T21:24:21.047ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66d05714-044e-4478-a42e-018c12715d96") failed: Property not found. retry in 1.105114337s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_66d05714-044e-4478-a42e-018c12715d96
14182024-05-10T21:24:21.123ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_95738557-5fbe-4760-a2f5-e295833eb800") failed: Property not found. retry in 623.360168ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_95738557-5fbe-4760-a2f5-e295833eb800
14192024-05-10T21:24:21.193ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_996b624d-00ef-4678-8cfa-ad052b261509") failed: Property not found. retry in 772.104921ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_996b624d-00ef-4678-8cfa-ad052b261509
14202024-05-10T21:24:21.201ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5c09bf7a-54dd-4d4c-bdd3-12884bf29927") failed: Property not found. retry in 1.07145684s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5c09bf7a-54dd-4d4c-bdd3-12884bf29927
14212024-05-10T21:24:21.239ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7325b560-f7aa-4399-a6c6-a3322f42d759") failed: Property not found. retry in 576.422909ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_7325b560-f7aa-4399-a6c6-a3322f42d759
14222024-05-10T21:24:21.248ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e03d4432-8b77-4406-904d-ebd71cc9739e") failed: Property not found. retry in 584.646065ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e03d4432-8b77-4406-904d-ebd71cc9739e
14232024-05-10T21:24:21.336ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_207101fa-3f8f-4bbb-a8c0-4f0407f828e8") failed: Property not found. retry in 1.319029159s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_207101fa-3f8f-4bbb-a8c0-4f0407f828e8
14242024-05-10T21:24:21.495ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_06efb5f5-bb93-4e71-b8a9-60f655f78031") failed: Property not found. retry in 1.401041177s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_06efb5f5-bb93-4e71-b8a9-60f655f78031
14252024-05-10T21:24:21.520ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4fdb69f7-0af6-40d3-9922-f38ae4f0f54b") failed: Property not found. retry in 774.859034ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4fdb69f7-0af6-40d3-9922-f38ae4f0f54b
14262024-05-10T21:24:21.582ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c1dcad46-3d8d-4678-899a-efb74ec83395") failed: Property not found. retry in 681.598339ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c1dcad46-3d8d-4678-899a-efb74ec83395
14272024-05-10T21:24:21.614ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0af3291d-7808-448b-a5ec-68ea6a4730ef") failed: Property not found. retry in 1.244311662s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0af3291d-7808-448b-a5ec-68ea6a4730ef
14282024-05-10T21:24:21.622ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7bb2217a-5bab-47ca-8e9e-29f166894592") failed: Property not found. retry in 1.341300817s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7bb2217a-5bab-47ca-8e9e-29f166894592
14292024-05-10T21:24:21.640ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d7314b67-85b3-4c30-acfc-5e9dff5e5939") failed: Property not found. retry in 1.457057232s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d7314b67-85b3-4c30-acfc-5e9dff5e5939
14302024-05-10T21:24:21.684ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6578850-a802-4381-b533-4fb297487a8f") failed: Property not found. retry in 1.338114941s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6578850-a802-4381-b533-4fb297487a8f
14312024-05-10T21:24:21.756ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_95738557-5fbe-4760-a2f5-e295833eb800") failed: Property not found. retry in 718.515745ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_95738557-5fbe-4760-a2f5-e295833eb800
14322024-05-10T21:24:21.770ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ada61d89-35f2-4021-829f-0d604c91d0ff") failed: Property not found. retry in 678.085151ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ada61d89-35f2-4021-829f-0d604c91d0ff
14332024-05-10T21:24:21.824ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7325b560-f7aa-4399-a6c6-a3322f42d759") failed: Property not found. retry in 1.159332964s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_7325b560-f7aa-4399-a6c6-a3322f42d759
14342024-05-10T21:24:21.837ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dd46fcb1-c07b-4880-9112-3895f2df61ed") failed: Property not found. retry in 543.915974ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_dd46fcb1-c07b-4880-9112-3895f2df61ed
14352024-05-10T21:24:21.845ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e03d4432-8b77-4406-904d-ebd71cc9739e") failed: Property not found. retry in 928.709288ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e03d4432-8b77-4406-904d-ebd71cc9739e
14362024-05-10T21:24:21.874ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:45817
14372024-05-10T21:24:21.896ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 11769 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:45817 req_id = 1750f64c-5222-481d-a995-bc7f9326e688 response_code = 200 uri = /baseboard
14382024-05-10T21:24:21.938ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b473a0f3-4103-4d03-9647-a8361e344d97") failed: Property not found. retry in 919.938905ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b473a0f3-4103-4d03-9647-a8361e344d97
14392024-05-10T21:24:21.975ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_996b624d-00ef-4678-8cfa-ad052b261509") failed: Property not found. retry in 510.015548ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_996b624d-00ef-4678-8cfa-ad052b261509
14402024-05-10T21:24:22.012ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_101e94eb-79e6-493c-8bba-b631934a03b9") failed: Property not found. retry in 754.429747ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_101e94eb-79e6-493c-8bba-b631934a03b9
14412024-05-10T21:24:22.162ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66d05714-044e-4478-a42e-018c12715d96") failed: Property not found. retry in 578.402241ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_66d05714-044e-4478-a42e-018c12715d96
14422024-05-10T21:24:22.274ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c1dcad46-3d8d-4678-899a-efb74ec83395") failed: Property not found. retry in 663.131782ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c1dcad46-3d8d-4678-899a-efb74ec83395
14432024-05-10T21:24:22.392ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dd46fcb1-c07b-4880-9112-3895f2df61ed") failed: Property not found. retry in 1.306461133s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_dd46fcb1-c07b-4880-9112-3895f2df61ed
14442024-05-10T21:24:22.856ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_207101fa-3f8f-4bbb-a8c0-4f0407f828e8") failed: Property not found. retry in 833.03ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_207101fa-3f8f-4bbb-a8c0-4f0407f828e8
14452024-05-10T21:24:23.699ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_207101fa-3f8f-4bbb-a8c0-4f0407f828e8") failed: Property not found. retry in 905.225351ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_207101fa-3f8f-4bbb-a8c0-4f0407f828e8
14462024-05-10T21:24:24.616ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_207101fa-3f8f-4bbb-a8c0-4f0407f828e8") failed: Property not found. retry in 687.016041ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_207101fa-3f8f-4bbb-a8c0-4f0407f828e8
14472024-05-10T21:24:25.346ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_crucible_06efb5f5-bb93-4e71-b8a9-60f655f78031
14482024-05-10T21:24:25.346ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_crucible_b473a0f3-4103-4d03-9647-a8361e344d97
14492024-05-10T21:24:25.346ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_external_dns_7325b560-f7aa-4399-a6c6-a3322f42d759
14502024-05-10T21:24:25.346ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_crucible_pantry_d7314b67-85b3-4c30-acfc-5e9dff5e5939
14512024-05-10T21:24:25.346ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_external_dns_e03d4432-8b77-4406-904d-ebd71cc9739e
14522024-05-10T21:24:25.346ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_crucible_4fdb69f7-0af6-40d3-9922-f38ae4f0f54b
14532024-05-10T21:24:25.346ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_crucible_101e94eb-79e6-493c-8bba-b631934a03b9
14542024-05-10T21:24:25.348ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_crucible_pantry_0af3291d-7808-448b-a5ec-68ea6a4730ef
14552024-05-10T21:24:25.348ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_crucible_ada61d89-35f2-4021-829f-0d604c91d0ff
14562024-05-10T21:24:25.348ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_crucible_d6578850-a802-4381-b533-4fb297487a8f
14572024-05-10T21:24:25.348ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_crucible_pantry_996b624d-00ef-4678-8cfa-ad052b261509
14582024-05-10T21:24:25.348ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_crucible_c1dcad46-3d8d-4678-899a-efb74ec83395
14592024-05-10T21:24:25.348ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_nexus_2fc7758a-cae3-4d9b-ade9-3a7691598581
14602024-05-10T21:24:25.348ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_nexus_dd46fcb1-c07b-4880-9112-3895f2df61ed
14612024-05-10T21:24:25.348ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_nexus_7bb2217a-5bab-47ca-8e9e-29f166894592
14622024-05-10T21:24:25.348ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_oximeter_95738557-5fbe-4760-a2f5-e295833eb800
14632024-05-10T21:24:25.348ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_crucible_5c09bf7a-54dd-4d4c-bdd3-12884bf29927
14642024-05-10T21:24:25.348ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_clickhouse_207101fa-3f8f-4bbb-a8c0-4f0407f828e8
14652024-05-10T21:24:25.348ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_crucible_66d05714-044e-4478-a42e-018c12715d96
14662024-05-10T21:24:25.350ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/6742bbd6-6bec-4f6b-94f3-002a53fc9f01/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
14672024-05-10T21:24:25.351ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/8becec77-7597-498a-9704-3ae75204e470/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
14682024-05-10T21:24:25.363ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 33994204 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:43378 req_id = ab8acd2e-7a0a-4bcc-b994-4ff3d8670830 response_code = 204 uri = /omicron-zones
14692024-05-10T21:24:25.380ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1235
14702024-05-10T21:24:25.380ZINFOSledAgent (RSS): Writing ledger to /pool/int/6742bbd6-6bec-4f6b-94f3-002a53fc9f01/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
14712024-05-10T21:24:25.380ZINFOSledAgent (RSS): Writing ledger to /pool/int/8becec77-7597-498a-9704-3ae75204e470/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
14722024-05-10T21:24:25.414ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:679
14732024-05-10T21:24:25.420ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::a]:12221 file = sled-agent/src/rack_setup/service.rs:692
14742024-05-10T21:24:25.455ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV1 { bfd: [], bgp: [], infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV1 { addresses: [ V4( Ipv4Network { addr: 10.151.2.174, prefix: 24, }, ), ], autoneg: false, bgp_peers: [], port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Network { addr: 0.0.0.0, prefix: 0, }, ), nexthop: 10.151.2.100, vlan_id: None, }, ], switch: Switch0, uplink_port_fec: None, uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56, }, } file = sled-agent/src/rack_setup/service.rs:816
14752024-05-10T21:24:27.425ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/58769e48-4e3f-40ad-a95a-fd916e51fe8a/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:878
14762024-05-10T21:24:27.570ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/58769e48-4e3f-40ad-a95a-fd916e51fe8a/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:878
14772024-05-10T21:24:27.656ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/58769e48-4e3f-40ad-a95a-fd916e51fe8a/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:878
14782024-05-10T21:24:27.786ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/58769e48-4e3f-40ad-a95a-fd916e51fe8a/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:878
14792024-05-10T21:24:27.882ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/58769e48-4e3f-40ad-a95a-fd916e51fe8a/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:878
14802024-05-10T21:24:28.167ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/58769e48-4e3f-40ad-a95a-fd916e51fe8a/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:878
14812024-05-10T21:24:28.316ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/58769e48-4e3f-40ad-a95a-fd916e51fe8a/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:878
14822024-05-10T21:24:28.702ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/58769e48-4e3f-40ad-a95a-fd916e51fe8a/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:878
14832024-05-10T21:24:29.153ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/58769e48-4e3f-40ad-a95a-fd916e51fe8a/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:878
14842024-05-10T21:24:29.534ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/58769e48-4e3f-40ad-a95a-fd916e51fe8a/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:878
14852024-05-10T21:24:30.162ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/58769e48-4e3f-40ad-a95a-fd916e51fe8a/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:878
14862024-05-10T21:24:30.948ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/58769e48-4e3f-40ad-a95a-fd916e51fe8a/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:878
14872024-05-10T21:24:31.840ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/3ae06dcf-597c-4d18-b2d7-37c1f02096d7): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/probe_manager.rs:169 sled_id = 3ae06dcf-597c-4d18-b2d7-37c1f02096d7
14882024-05-10T21:24:31.841ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/58769e48-4e3f-40ad-a95a-fd916e51fe8a/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:878
14892024-05-10T21:24:32.844ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/3ae06dcf-597c-4d18-b2d7-37c1f02096d7): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/probe_manager.rs:169 sled_id = 3ae06dcf-597c-4d18-b2d7-37c1f02096d7
14902024-05-10T21:24:32.943ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/58769e48-4e3f-40ad-a95a-fd916e51fe8a/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:878
14912024-05-10T21:24:33.440ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/3ae06dcf-597c-4d18-b2d7-37c1f02096d7): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/nexus.rs:619 sled_id = 3ae06dcf-597c-4d18-b2d7-37c1f02096d7
14922024-05-10T21:24:33.848ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/3ae06dcf-597c-4d18-b2d7-37c1f02096d7): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/probe_manager.rs:169 sled_id = 3ae06dcf-597c-4d18-b2d7-37c1f02096d7
14932024-05-10T21:24:34.296ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/3ae06dcf-597c-4d18-b2d7-37c1f02096d7): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/nexus.rs:619 sled_id = 3ae06dcf-597c-4d18-b2d7-37c1f02096d7
14942024-05-10T21:24:34.417ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/58769e48-4e3f-40ad-a95a-fd916e51fe8a/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:878
14952024-05-10T21:24:34.853ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/3ae06dcf-597c-4d18-b2d7-37c1f02096d7): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/probe_manager.rs:169 sled_id = 3ae06dcf-597c-4d18-b2d7-37c1f02096d7
14962024-05-10T21:24:35.175ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/58769e48-4e3f-40ad-a95a-fd916e51fe8a/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:878
14972024-05-10T21:24:35.856ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/3ae06dcf-597c-4d18-b2d7-37c1f02096d7): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/probe_manager.rs:169 sled_id = 3ae06dcf-597c-4d18-b2d7-37c1f02096d7
14982024-05-10T21:24:35.996ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/58769e48-4e3f-40ad-a95a-fd916e51fe8a/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:878
14992024-05-10T21:24:36.290ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/3ae06dcf-597c-4d18-b2d7-37c1f02096d7): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/nexus.rs:619 sled_id = 3ae06dcf-597c-4d18-b2d7-37c1f02096d7
15002024-05-10T21:24:36.859ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/3ae06dcf-597c-4d18-b2d7-37c1f02096d7): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/probe_manager.rs:169 sled_id = 3ae06dcf-597c-4d18-b2d7-37c1f02096d7
15012024-05-10T21:24:37.862ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/3ae06dcf-597c-4d18-b2d7-37c1f02096d7): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/probe_manager.rs:169 sled_id = 3ae06dcf-597c-4d18-b2d7-37c1f02096d7
15022024-05-10T21:24:38.290ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/3ae06dcf-597c-4d18-b2d7-37c1f02096d7): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/nexus.rs:619 sled_id = 3ae06dcf-597c-4d18-b2d7-37c1f02096d7
15032024-05-10T21:24:38.633ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/58769e48-4e3f-40ad-a95a-fd916e51fe8a/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:878
15042024-05-10T21:24:42.252ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "ec218832-5de9-443e-a681-b77627ee72a9", "content-length": "173", "date": "Fri, 10 May 2024 21:24:41 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"3ae06dcf-597c-4d18-b2d7-37c1f02096d7\"", request_id: "ec218832-5de9-443e-a681-b77627ee72a9" } file = sled-agent/src/rack_setup/service.rs:878
15052024-05-10T21:24:42.354ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:592 new_generation = 1 old_generation = 1 sled_id = 3ae06dcf-597c-4d18-b2d7-37c1f02096d7
15062024-05-10T21:24:42.532ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61399
15072024-05-10T21:24:42.532ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
15082024-05-10T21:24:42.621ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 89103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61399 req_id = 85090bdc-b4c2-485f-abf0-9b702db37eeb response_code = 200 uri = /inventory
15092024-05-10T21:24:42.622ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
15102024-05-10T21:24:42.622ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/6742bbd6-6bec-4f6b-94f3-002a53fc9f01/config/omicron-zones.json file = common/src/ledger.rs:177
15112024-05-10T21:24:42.623ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8becec77-7597-498a-9704-3ae75204e470/config/omicron-zones.json file = common/src/ledger.rs:177
15122024-05-10T21:24:42.624ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 2243 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61399 req_id = 65ea4725-026d-43c6-b423-061b3ac84b4e response_code = 200 uri = /omicron-zones
15132024-05-10T21:24:45.660ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54416
15142024-05-10T21:24:45.665ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:525 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3076c844-8a4f-4e23-8343-ae2edafd59bc, kind: Service { id: e03d4432-8b77-4406-904d-ebd71cc9739e }, name: Name("external-dns-e03d4432-8b77-4406-904d-ebd71cc9739e"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 130, 3])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.1.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 9f5600e8-2094-4425-bdd8-3005882ee50f, kind: Service { id: 7325b560-f7aa-4399-a6c6-a3322f42d759 }, name: Name("external-dns-7325b560-f7aa-4399-a6c6-a3322f42d759"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 190])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.1.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 476144d9-7af0-48ae-ae6d-f7b1547a9af0, kind: Service { id: dd46fcb1-c07b-4880-9112-3895f2df61ed }, name: Name("nexus-dd46fcb1-c07b-4880-9112-3895f2df61ed"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 134, 174])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 6768c786-a56a-479c-a1a1-b0566791d10c, kind: Service { id: 2fc7758a-cae3-4d9b-ade9-3a7691598581 }, name: Name("nexus-2fc7758a-cae3-4d9b-ade9-3a7691598581"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 85])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: a28a0581-77ae-4cf2-b9a8-382fafb05295, kind: Service { id: 7bb2217a-5bab-47ca-8e9e-29f166894592 }, name: Name("nexus-7bb2217a-5bab-47ca-8e9e-29f166894592"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 221])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
15152024-05-10T21:24:45.666ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15162024-05-10T21:24:45.666ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15172024-05-10T21:24:45.666ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte0" rules = []
15182024-05-10T21:24:45.666ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15192024-05-10T21:24:45.666ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15202024-05-10T21:24:45.666ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15212024-05-10T21:24:45.666ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 5042 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54416 req_id = e13d367b-d9a9-4313-8ad9-2085e51d4932 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
15222024-05-10T21:24:45.667ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:888
15232024-05-10T21:24:45.880ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34576
15242024-05-10T21:24:45.880ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
15252024-05-10T21:24:45.972ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 92472 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34576 req_id = 02cad872-fae5-4ce3-8d72-dd2526a72007 response_code = 200 uri = /inventory
15262024-05-10T21:24:45.973ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
15272024-05-10T21:24:45.973ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/6742bbd6-6bec-4f6b-94f3-002a53fc9f01/config/omicron-zones.json file = common/src/ledger.rs:177
15282024-05-10T21:24:45.973ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8becec77-7597-498a-9704-3ae75204e470/config/omicron-zones.json file = common/src/ledger.rs:177
15292024-05-10T21:24:45.973ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 790 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34576 req_id = 5f00fe52-4b59-472e-be4b-4ad3cb8316b1 response_code = 200 uri = /omicron-zones
15302024-05-10T21:24:46.972ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54794
15312024-05-10T21:24:46.972ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:525 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3076c844-8a4f-4e23-8343-ae2edafd59bc, kind: Service { id: e03d4432-8b77-4406-904d-ebd71cc9739e }, name: Name("external-dns-e03d4432-8b77-4406-904d-ebd71cc9739e"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 130, 3])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.1.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 9f5600e8-2094-4425-bdd8-3005882ee50f, kind: Service { id: 7325b560-f7aa-4399-a6c6-a3322f42d759 }, name: Name("external-dns-7325b560-f7aa-4399-a6c6-a3322f42d759"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 190])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.1.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 476144d9-7af0-48ae-ae6d-f7b1547a9af0, kind: Service { id: dd46fcb1-c07b-4880-9112-3895f2df61ed }, name: Name("nexus-dd46fcb1-c07b-4880-9112-3895f2df61ed"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 134, 174])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 6768c786-a56a-479c-a1a1-b0566791d10c, kind: Service { id: 2fc7758a-cae3-4d9b-ade9-3a7691598581 }, name: Name("nexus-2fc7758a-cae3-4d9b-ade9-3a7691598581"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 85])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: a28a0581-77ae-4cf2-b9a8-382fafb05295, kind: Service { id: 7bb2217a-5bab-47ca-8e9e-29f166894592 }, name: Name("nexus-7bb2217a-5bab-47ca-8e9e-29f166894592"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 221])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
15322024-05-10T21:24:46.972ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15332024-05-10T21:24:46.972ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15342024-05-10T21:24:46.972ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte0" rules = []
15352024-05-10T21:24:46.972ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15362024-05-10T21:24:46.972ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15372024-05-10T21:24:46.972ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15382024-05-10T21:24:46.972ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 397 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54794 req_id = 28d840c4-4142-4cd0-874c-0e2dd8094dc7 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
15392024-05-10T21:24:47.126ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43461
15402024-05-10T21:24:47.127ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:525 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3076c844-8a4f-4e23-8343-ae2edafd59bc, kind: Service { id: e03d4432-8b77-4406-904d-ebd71cc9739e }, name: Name("external-dns-e03d4432-8b77-4406-904d-ebd71cc9739e"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 130, 3])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.1.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 9f5600e8-2094-4425-bdd8-3005882ee50f, kind: Service { id: 7325b560-f7aa-4399-a6c6-a3322f42d759 }, name: Name("external-dns-7325b560-f7aa-4399-a6c6-a3322f42d759"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 190])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.1.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 476144d9-7af0-48ae-ae6d-f7b1547a9af0, kind: Service { id: dd46fcb1-c07b-4880-9112-3895f2df61ed }, name: Name("nexus-dd46fcb1-c07b-4880-9112-3895f2df61ed"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 134, 174])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 6768c786-a56a-479c-a1a1-b0566791d10c, kind: Service { id: 2fc7758a-cae3-4d9b-ade9-3a7691598581 }, name: Name("nexus-2fc7758a-cae3-4d9b-ade9-3a7691598581"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 85])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: a28a0581-77ae-4cf2-b9a8-382fafb05295, kind: Service { id: 7bb2217a-5bab-47ca-8e9e-29f166894592 }, name: Name("nexus-7bb2217a-5bab-47ca-8e9e-29f166894592"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 221])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
15412024-05-10T21:24:47.127ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15422024-05-10T21:24:47.127ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15432024-05-10T21:24:47.127ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte0" rules = []
15442024-05-10T21:24:47.127ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15452024-05-10T21:24:47.127ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15462024-05-10T21:24:47.127ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15472024-05-10T21:24:47.127ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 352 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43461 req_id = 832e1eb3-6fd8-489c-ac0f-c8a2af283976 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
15482024-05-10T21:24:47.138ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47023
15492024-05-10T21:24:47.138ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:525 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3076c844-8a4f-4e23-8343-ae2edafd59bc, kind: Service { id: e03d4432-8b77-4406-904d-ebd71cc9739e }, name: Name("external-dns-e03d4432-8b77-4406-904d-ebd71cc9739e"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 130, 3])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.1.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 9f5600e8-2094-4425-bdd8-3005882ee50f, kind: Service { id: 7325b560-f7aa-4399-a6c6-a3322f42d759 }, name: Name("external-dns-7325b560-f7aa-4399-a6c6-a3322f42d759"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 190])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.1.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 476144d9-7af0-48ae-ae6d-f7b1547a9af0, kind: Service { id: dd46fcb1-c07b-4880-9112-3895f2df61ed }, name: Name("nexus-dd46fcb1-c07b-4880-9112-3895f2df61ed"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 134, 174])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 6768c786-a56a-479c-a1a1-b0566791d10c, kind: Service { id: 2fc7758a-cae3-4d9b-ade9-3a7691598581 }, name: Name("nexus-2fc7758a-cae3-4d9b-ade9-3a7691598581"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 85])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: a28a0581-77ae-4cf2-b9a8-382fafb05295, kind: Service { id: 7bb2217a-5bab-47ca-8e9e-29f166894592 }, name: Name("nexus-7bb2217a-5bab-47ca-8e9e-29f166894592"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 221])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
15502024-05-10T21:24:47.138ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15512024-05-10T21:24:47.138ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15522024-05-10T21:24:47.138ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte0" rules = []
15532024-05-10T21:24:47.138ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15542024-05-10T21:24:47.138ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15552024-05-10T21:24:47.139ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15562024-05-10T21:24:47.139ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 916 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47023 req_id = fa4b2fbe-ee82-4003-83a1-7c22f11a6b29 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
15572024-05-10T21:24:51.935ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:39965
15582024-05-10T21:24:51.935ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 79 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:39965 req_id = 2acb9b3f-67ca-4508-a8ab-dc488767486c response_code = 200 uri = /baseboard
15592024-05-10T21:25:09.141ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33960
15602024-05-10T21:25:09.235ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 94359 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:33960 req_id = a8bb51f6-da26-47b8-8347-c85ac01d7af6 response_code = 204 uri = /switch-ports
15612024-05-10T21:25:09.235ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39143
15622024-05-10T21:25:09.236ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 517 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33960 req_id = 39631f92-a12e-4e71-aedb-ca2476d6104b response_code = 200 uri = /network-bootstore-config
15632024-05-10T21:25:09.266ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63925
15642024-05-10T21:25:09.289ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 53790 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:39143 req_id = 6391b989-4700-4339-9557-b865e9e6831f response_code = 204 uri = /switch-ports
15652024-05-10T21:25:09.293ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 554 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39143 req_id = f71d5232-287b-465d-97db-0345b24ce9c8 response_code = 200 uri = /network-bootstore-config
15662024-05-10T21:25:09.309ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
15672024-05-10T21:25:09.309ZINFOSledAgent (bootstore): Writing ledger to /pool/int/6742bbd6-6bec-4f6b-94f3-002a53fc9f01/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
15682024-05-10T21:25:09.310ZINFOSledAgent (bootstore): Writing ledger to /pool/int/8becec77-7597-498a-9704-3ae75204e470/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
15692024-05-10T21:25:09.310ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
15702024-05-10T21:25:09.310ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 2366 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39143 req_id = 8849e8f8-1c4f-48ba-8983-f8109871a410 response_code = 204 uri = /network-bootstore-config
15712024-05-10T21:25:09.337ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 68147 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:63925 req_id = bc657c1c-87a8-497d-a6a8-1a73496a677c response_code = 204 uri = /switch-ports
15722024-05-10T21:25:09.338ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63925 req_id = 9e5ed1de-7f76-41fb-9cbb-a32566445299 response_code = 200 uri = /network-bootstore-config
15732024-05-10T21:25:09.355ZINFOSledAgent (bootstore): Attempting to update network config with generation: 3, current_generation: 2 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
15742024-05-10T21:25:09.356ZINFOSledAgent (bootstore): Writing ledger to /pool/int/6742bbd6-6bec-4f6b-94f3-002a53fc9f01/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
15752024-05-10T21:25:09.356ZINFOSledAgent (bootstore): Writing ledger to /pool/int/8becec77-7597-498a-9704-3ae75204e470/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
15762024-05-10T21:25:09.356ZINFOSledAgent (bootstore): Broadcasting network config with generation 3 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
15772024-05-10T21:25:09.356ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 1154 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33960 req_id = 08d98196-0e2a-48c2-956a-0d910113951f response_code = 204 uri = /network-bootstore-config
15782024-05-10T21:25:21.969ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:48221
15792024-05-10T21:25:21.969ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 78 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:48221 req_id = d3007e41-8bd8-4a99-a1a7-66b7a8ec094f response_code = 200 uri = /baseboard
15802024-05-10T21:25:39.157ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42270
15812024-05-10T21:25:39.210ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 52407 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:42270 req_id = fb2601e7-1056-48be-842a-fb0edc3db95c response_code = 204 uri = /switch-ports
15822024-05-10T21:25:39.210ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42270 req_id = c44de113-2790-4c5d-adad-dc2237532462 response_code = 200 uri = /network-bootstore-config
15832024-05-10T21:25:39.342ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57641
15842024-05-10T21:25:39.388ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 46397 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:57641 req_id = 6d9bc908-334c-47ef-bb6f-5ee36bad79e2 response_code = 204 uri = /switch-ports
15852024-05-10T21:25:39.388ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57641 req_id = ddf0fd28-b67c-49c9-8980-fa340d6f152e response_code = 200 uri = /network-bootstore-config
15862024-05-10T21:25:39.491ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63389
15872024-05-10T21:25:39.540ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 49448 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:63389 req_id = edc38a03-384b-4681-b289-f148b8ec53c6 response_code = 204 uri = /switch-ports
15882024-05-10T21:25:39.541ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63389 req_id = f0328466-9334-4098-a83b-decdfa739f2b response_code = 200 uri = /network-bootstore-config
15892024-05-10T21:25:50.644ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:52284 remote_addr = [fd00:1122:3344:101::d]:40200 sled_id = 3ae06dcf-597c-4d18-b2d7-37c1f02096d7
15902024-05-10T21:25:50.661ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 16673 local_addr = [fd00:1122:3344:101::1]:52284 method = GET remote_addr = [fd00:1122:3344:101::d]:40200 req_id = 6386876b-0c10-47d9-ad62-5de918f135e6 response_code = 200 sled_id = 3ae06dcf-597c-4d18-b2d7-37c1f02096d7 uri = //3ae06dcf-597c-4d18-b2d7-37c1f02096d7
15912024-05-10T21:25:52.013ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:57400
15922024-05-10T21:25:52.014ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 489 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:57400 req_id = 309fcfe3-cf55-425b-b319-5baf06449f2f response_code = 200 uri = /baseboard
15932024-05-10T21:26:09.051ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44546
15942024-05-10T21:26:09.099ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 48115 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:44546 req_id = cef7f82e-1b12-491b-b373-66ed0a835c57 response_code = 204 uri = /switch-ports
15952024-05-10T21:26:09.099ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56688
15962024-05-10T21:26:09.143ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 44283 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:56688 req_id = ab2e072b-6c98-40b7-9d2a-6095ba6fa43b response_code = 204 uri = /switch-ports
15972024-05-10T21:26:09.144ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44546 req_id = 221844e2-bb28-4df5-9bd7-10ef748c3dfc response_code = 200 uri = /network-bootstore-config
15982024-05-10T21:26:09.145ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 816 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56688 req_id = afdd0a9f-cdc1-4f4f-99c1-2f6b225c2da0 response_code = 200 uri = /network-bootstore-config
15992024-05-10T21:26:09.197ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39832
16002024-05-10T21:26:09.241ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 44242 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:39832 req_id = 9b7ec4ae-f7fe-4488-b7b6-0f02df634dde response_code = 204 uri = /switch-ports
16012024-05-10T21:26:09.241ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39832 req_id = 35289d6c-1491-4c18-9437-6c561cca8883 response_code = 200 uri = /network-bootstore-config
16022024-05-10T21:26:15.860ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:801
16032024-05-10T21:26:20.645ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 516 local_addr = [fd00:1122:3344:101::1]:52284 method = GET remote_addr = [fd00:1122:3344:101::d]:40200 req_id = b2ab197a-7c3d-4358-8a0b-9455cda934c9 response_code = 200 sled_id = 3ae06dcf-597c-4d18-b2d7-37c1f02096d7 uri = //3ae06dcf-597c-4d18-b2d7-37c1f02096d7
16042024-05-10T21:26:22.048ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:63894
16052024-05-10T21:26:22.048ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 138 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:63894 req_id = 7bfb2157-4031-4304-abe4-8f7e7a44f009 response_code = 200 uri = /baseboard
16062024-05-10T21:26:39.316ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64184
16072024-05-10T21:26:39.316ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58058
16082024-05-10T21:26:39.362ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 46028 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:64184 req_id = 1fe15bce-85c9-419f-918c-35332beeb3a9 response_code = 204 uri = /switch-ports
16092024-05-10T21:26:39.365ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 688 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64184 req_id = bd6a042c-b96b-4adf-b22e-83922c9f1ac1 response_code = 200 uri = /network-bootstore-config
16102024-05-10T21:26:39.404ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 87717 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:58058 req_id = 711d21ad-f45a-43b8-a7fc-02a84521e721 response_code = 204 uri = /switch-ports
16112024-05-10T21:26:39.404ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58058 req_id = a45138f4-9e14-4d46-b930-4af9ef3741d3 response_code = 200 uri = /network-bootstore-config
16122024-05-10T21:26:39.445ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34224
16132024-05-10T21:26:39.487ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 41887 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:34224 req_id = 0fe366fb-0811-4da6-bc5a-178f205ef972 response_code = 204 uri = /switch-ports
16142024-05-10T21:26:39.487ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34224 req_id = 966080cb-bcd5-4791-a33c-af25889008fd response_code = 200 uri = /network-bootstore-config
16152024-05-10T21:26:50.645ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 571 local_addr = [fd00:1122:3344:101::1]:52284 method = GET remote_addr = [fd00:1122:3344:101::d]:40200 req_id = 2f45317b-d525-4e60-b729-1eefc5ae8ebf response_code = 200 sled_id = 3ae06dcf-597c-4d18-b2d7-37c1f02096d7 uri = //3ae06dcf-597c-4d18-b2d7-37c1f02096d7
16162024-05-10T21:26:52.082ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:46851
16172024-05-10T21:26:52.083ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 97 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:46851 req_id = f496a9c5-2933-47fe-a71f-848ea1ceb6d4 response_code = 200 uri = /baseboard
16182024-05-10T21:27:08.984ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37534
16192024-05-10T21:27:09.033ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 49326 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:37534 req_id = 405534da-25f4-434f-b9d0-925eed536138 response_code = 204 uri = /switch-ports
16202024-05-10T21:27:09.033ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37534 req_id = d9149d23-9e5c-4d40-a298-4eba47bf8913 response_code = 200 uri = /network-bootstore-config
16212024-05-10T21:27:09.113ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44875
16222024-05-10T21:27:09.154ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 41205 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:44875 req_id = 541de943-5763-4090-a4de-345932108111 response_code = 204 uri = /switch-ports
16232024-05-10T21:27:09.154ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44875 req_id = 38b0f1cd-7335-4739-a159-c3e7636de6e2 response_code = 200 uri = /network-bootstore-config
16242024-05-10T21:27:09.195ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44649
16252024-05-10T21:27:09.237ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 42092 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:44649 req_id = 7936cb0f-49c0-482a-99cd-f93728adf8de response_code = 204 uri = /switch-ports
16262024-05-10T21:27:09.237ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44649 req_id = 0b39e11d-c35b-4599-a7bb-7b188ff80dce response_code = 200 uri = /network-bootstore-config
16272024-05-10T21:27:20.644ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 845 local_addr = [fd00:1122:3344:101::1]:52284 method = GET remote_addr = [fd00:1122:3344:101::d]:40200 req_id = e0f406df-7abc-47e3-8edd-8a131d38277a response_code = 200 sled_id = 3ae06dcf-597c-4d18-b2d7-37c1f02096d7 uri = //3ae06dcf-597c-4d18-b2d7-37c1f02096d7
16282024-05-10T21:27:22.115ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:51779
16292024-05-10T21:27:22.116ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 97 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:51779 req_id = 1c86d42d-3904-4596-a9d1-cda400f175c3 response_code = 200 uri = /baseboard
16302024-05-10T21:27:39.186ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54536
16312024-05-10T21:27:39.235ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 49032 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:54536 req_id = b0a9a88e-7f52-4ea8-accb-13c5c98c04e6 response_code = 204 uri = /switch-ports
16322024-05-10T21:27:39.235ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54536 req_id = 75fa8770-d844-46d4-832c-70f5000a6314 response_code = 200 uri = /network-bootstore-config
16332024-05-10T21:27:39.302ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52882
16342024-05-10T21:27:39.350ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 47526 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:52882 req_id = d7dbd92c-ca69-42b4-bd43-9c42e9f61723 response_code = 204 uri = /switch-ports
16352024-05-10T21:27:39.350ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39867
16362024-05-10T21:27:39.354ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 3242 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52882 req_id = 1bd271c9-8bdc-4916-baad-a72672085e23 response_code = 200 uri = /network-bootstore-config
16372024-05-10T21:27:39.395ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 44740 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:39867 req_id = 383f7df2-205e-4e39-93d9-e3ad20e575b7 response_code = 204 uri = /switch-ports
16382024-05-10T21:27:39.395ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39867 req_id = ed44807c-2501-49e6-a6c7-037dc5d39072 response_code = 200 uri = /network-bootstore-config
16392024-05-10T21:27:50.653ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 460 local_addr = [fd00:1122:3344:101::1]:52284 method = GET remote_addr = [fd00:1122:3344:101::d]:40200 req_id = 7a8beac6-5575-436f-ae68-3a7e2af73c1b response_code = 200 sled_id = 3ae06dcf-597c-4d18-b2d7-37c1f02096d7 uri = //3ae06dcf-597c-4d18-b2d7-37c1f02096d7
16402024-05-10T21:27:52.149ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:39241
16412024-05-10T21:27:52.149ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 92 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:39241 req_id = f4c782d5-17f8-4a69-babb-8249bc4cf56c response_code = 200 uri = /baseboard
16422024-05-10T21:28:09.039ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44499
16432024-05-10T21:28:09.087ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 48355 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:44499 req_id = 5ace5acd-2453-4d77-9bd1-ac29742df482 response_code = 204 uri = /switch-ports
16442024-05-10T21:28:09.088ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44499 req_id = e2b1d057-2619-4063-8ad1-e385782dd618 response_code = 200 uri = /network-bootstore-config
16452024-05-10T21:28:09.098ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34590
16462024-05-10T21:28:09.145ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 46652 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:34590 req_id = 15db1cf6-1e10-4291-883c-23c20f99a6ae response_code = 204 uri = /switch-ports
16472024-05-10T21:28:09.145ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34590 req_id = d5d53298-dad7-4402-ade7-e52033618d7e response_code = 200 uri = /network-bootstore-config
16482024-05-10T21:28:09.188ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39725
16492024-05-10T21:28:09.233ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 44531 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:39725 req_id = 5e50574d-1f6a-4570-b525-ff46a329c5d5 response_code = 204 uri = /switch-ports
16502024-05-10T21:28:09.233ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39725 req_id = d561638c-9fc5-436f-a7d0-91849df0b0b0 response_code = 200 uri = /network-bootstore-config
16512024-05-10T21:28:20.767ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 657 local_addr = [fd00:1122:3344:101::1]:52284 method = GET remote_addr = [fd00:1122:3344:101::d]:40200 req_id = 4dc5b5bc-c61d-46c8-b85e-4e683a82bf2e response_code = 200 sled_id = 3ae06dcf-597c-4d18-b2d7-37c1f02096d7 uri = //3ae06dcf-597c-4d18-b2d7-37c1f02096d7
16522024-05-10T21:28:22.182ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:63116
16532024-05-10T21:28:22.183ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 98 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:63116 req_id = 668c772e-3c0d-4fad-b18e-e294e3f78888 response_code = 200 uri = /baseboard
16542024-05-10T21:28:39.040ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55261
16552024-05-10T21:28:39.092ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 51157 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:55261 req_id = 0f73e6cf-0f7a-4d63-984b-969a68d5c330 response_code = 204 uri = /switch-ports
16562024-05-10T21:28:39.092ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55261 req_id = 8dda0ce4-29d1-47aa-9681-992223aeecf0 response_code = 200 uri = /network-bootstore-config
16572024-05-10T21:28:39.148ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45839
16582024-05-10T21:28:39.197ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 48324 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:45839 req_id = be713c4e-c933-4d49-8b99-3b6da3338d01 response_code = 204 uri = /switch-ports
16592024-05-10T21:28:39.197ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45839 req_id = 48925389-026f-42da-a7e5-743b95c23253 response_code = 200 uri = /network-bootstore-config
16602024-05-10T21:28:39.390ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59836
16612024-05-10T21:28:39.436ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 45839 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:59836 req_id = a7731c94-fcdd-40b9-a996-ff81cad2f168 response_code = 204 uri = /switch-ports
16622024-05-10T21:28:39.439ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59836 req_id = d1e26e20-4068-4bcc-92c7-6ccf00b2b10c response_code = 200 uri = /network-bootstore-config
16632024-05-10T21:28:50.766ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 449 local_addr = [fd00:1122:3344:101::1]:52284 method = GET remote_addr = [fd00:1122:3344:101::d]:40200 req_id = 689e8589-cdfd-4c4b-971f-f5b1e4e6601b response_code = 200 sled_id = 3ae06dcf-597c-4d18-b2d7-37c1f02096d7 uri = //3ae06dcf-597c-4d18-b2d7-37c1f02096d7
16642024-05-10T21:28:52.216ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:48653
16652024-05-10T21:28:52.216ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 83 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:48653 req_id = f2d1f577-6362-4476-858a-3566128c97bf response_code = 200 uri = /baseboard
16662024-05-10T21:29:08.956ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59232
16672024-05-10T21:29:09.007ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 50973 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:59232 req_id = 289c5328-328c-4a32-8693-bd46e2ab17ab response_code = 204 uri = /switch-ports
16682024-05-10T21:29:09.007ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59232 req_id = 8e51c01b-174b-43a7-a3e9-8d33279de1d7 response_code = 200 uri = /network-bootstore-config
16692024-05-10T21:29:09.059ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58041
16702024-05-10T21:29:09.106ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 47283 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:58041 req_id = 9bda4983-8371-4fce-ae53-70267cba45b8 response_code = 204 uri = /switch-ports
16712024-05-10T21:29:09.107ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58041 req_id = 87e3d7d5-57f5-42fd-b2e5-d9917f3e0cd5 response_code = 200 uri = /network-bootstore-config
16722024-05-10T21:29:09.207ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34092
16732024-05-10T21:29:09.250ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 43499 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:34092 req_id = e715c9ac-0b28-45b0-bf86-ac3dcdf2ee4d response_code = 204 uri = /switch-ports
16742024-05-10T21:29:09.251ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34092 req_id = 40aee254-bce0-484a-8680-52de6123cc8d response_code = 200 uri = /network-bootstore-config
16752024-05-10T21:29:20.768ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 454 local_addr = [fd00:1122:3344:101::1]:52284 method = GET remote_addr = [fd00:1122:3344:101::d]:40200 req_id = 346b316f-1677-45d1-8cfb-d036e7a45fe1 response_code = 200 sled_id = 3ae06dcf-597c-4d18-b2d7-37c1f02096d7 uri = //3ae06dcf-597c-4d18-b2d7-37c1f02096d7
16762024-05-10T21:29:22.249ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:39193
16772024-05-10T21:29:22.249ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 90 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:39193 req_id = 10ecef82-8c95-47c4-99ab-a0b195e55d4c response_code = 200 uri = /baseboard
16782024-05-10T21:29:39.048ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59671
16792024-05-10T21:29:39.050ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:525 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3076c844-8a4f-4e23-8343-ae2edafd59bc, kind: Service { id: e03d4432-8b77-4406-904d-ebd71cc9739e }, name: Name("external-dns-e03d4432-8b77-4406-904d-ebd71cc9739e"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 130, 3])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.1.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 9f5600e8-2094-4425-bdd8-3005882ee50f, kind: Service { id: 7325b560-f7aa-4399-a6c6-a3322f42d759 }, name: Name("external-dns-7325b560-f7aa-4399-a6c6-a3322f42d759"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 190])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.1.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 476144d9-7af0-48ae-ae6d-f7b1547a9af0, kind: Service { id: dd46fcb1-c07b-4880-9112-3895f2df61ed }, name: Name("nexus-dd46fcb1-c07b-4880-9112-3895f2df61ed"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 134, 174])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 6768c786-a56a-479c-a1a1-b0566791d10c, kind: Service { id: 2fc7758a-cae3-4d9b-ade9-3a7691598581 }, name: Name("nexus-2fc7758a-cae3-4d9b-ade9-3a7691598581"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 85])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: a28a0581-77ae-4cf2-b9a8-382fafb05295, kind: Service { id: 7bb2217a-5bab-47ca-8e9e-29f166894592 }, name: Name("nexus-7bb2217a-5bab-47ca-8e9e-29f166894592"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 221])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16802024-05-10T21:29:39.050ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16812024-05-10T21:29:39.050ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16822024-05-10T21:29:39.050ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte0" rules = []
16832024-05-10T21:29:39.050ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16842024-05-10T21:29:39.050ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16852024-05-10T21:29:39.050ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16862024-05-10T21:29:39.050ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 1168 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59671 req_id = ac286338-6bb0-4054-8bb0-92706b64f5b6 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16872024-05-10T21:29:39.115ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35971
16882024-05-10T21:29:39.115ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:525 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3076c844-8a4f-4e23-8343-ae2edafd59bc, kind: Service { id: e03d4432-8b77-4406-904d-ebd71cc9739e }, name: Name("external-dns-e03d4432-8b77-4406-904d-ebd71cc9739e"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 130, 3])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.1.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 9f5600e8-2094-4425-bdd8-3005882ee50f, kind: Service { id: 7325b560-f7aa-4399-a6c6-a3322f42d759 }, name: Name("external-dns-7325b560-f7aa-4399-a6c6-a3322f42d759"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 190])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.1.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 476144d9-7af0-48ae-ae6d-f7b1547a9af0, kind: Service { id: dd46fcb1-c07b-4880-9112-3895f2df61ed }, name: Name("nexus-dd46fcb1-c07b-4880-9112-3895f2df61ed"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 134, 174])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 6768c786-a56a-479c-a1a1-b0566791d10c, kind: Service { id: 2fc7758a-cae3-4d9b-ade9-3a7691598581 }, name: Name("nexus-2fc7758a-cae3-4d9b-ade9-3a7691598581"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 85])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: a28a0581-77ae-4cf2-b9a8-382fafb05295, kind: Service { id: 7bb2217a-5bab-47ca-8e9e-29f166894592 }, name: Name("nexus-7bb2217a-5bab-47ca-8e9e-29f166894592"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 221])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16892024-05-10T21:29:39.116ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16902024-05-10T21:29:39.116ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16912024-05-10T21:29:39.116ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte0" rules = []
16922024-05-10T21:29:39.116ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16932024-05-10T21:29:39.116ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16942024-05-10T21:29:39.116ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16952024-05-10T21:29:39.116ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 249 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35971 req_id = a53f7f39-c44d-4229-8569-9f3f418690d0 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16962024-05-10T21:29:39.138ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48667
16972024-05-10T21:29:39.186ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 48042 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:48667 req_id = 2437046d-d172-4d34-8b36-c2ab93a68334 response_code = 204 uri = /switch-ports
16982024-05-10T21:29:39.187ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 577 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48667 req_id = 5f1aa39c-e1da-460f-9672-868010581f96 response_code = 200 uri = /network-bootstore-config
16992024-05-10T21:29:39.240ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51148
17002024-05-10T21:29:39.240ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:525 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3076c844-8a4f-4e23-8343-ae2edafd59bc, kind: Service { id: e03d4432-8b77-4406-904d-ebd71cc9739e }, name: Name("external-dns-e03d4432-8b77-4406-904d-ebd71cc9739e"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 130, 3])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.1.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 9f5600e8-2094-4425-bdd8-3005882ee50f, kind: Service { id: 7325b560-f7aa-4399-a6c6-a3322f42d759 }, name: Name("external-dns-7325b560-f7aa-4399-a6c6-a3322f42d759"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 190])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.1.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 476144d9-7af0-48ae-ae6d-f7b1547a9af0, kind: Service { id: dd46fcb1-c07b-4880-9112-3895f2df61ed }, name: Name("nexus-dd46fcb1-c07b-4880-9112-3895f2df61ed"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 134, 174])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 6768c786-a56a-479c-a1a1-b0566791d10c, kind: Service { id: 2fc7758a-cae3-4d9b-ade9-3a7691598581 }, name: Name("nexus-2fc7758a-cae3-4d9b-ade9-3a7691598581"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 85])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: a28a0581-77ae-4cf2-b9a8-382fafb05295, kind: Service { id: 7bb2217a-5bab-47ca-8e9e-29f166894592 }, name: Name("nexus-7bb2217a-5bab-47ca-8e9e-29f166894592"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 221])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17012024-05-10T21:29:39.240ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17022024-05-10T21:29:39.240ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17032024-05-10T21:29:39.240ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte0" rules = []
17042024-05-10T21:29:39.240ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17052024-05-10T21:29:39.240ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17062024-05-10T21:29:39.240ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17072024-05-10T21:29:39.240ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 364 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51148 req_id = 5fabcf5a-d122-44dd-9039-4243665dd521 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17082024-05-10T21:29:39.403ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33623
17092024-05-10T21:29:39.448ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 45387 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:33623 req_id = b3331254-f2d7-4045-a5e3-550bd7b9e525 response_code = 204 uri = /switch-ports
17102024-05-10T21:29:39.449ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 737 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33623 req_id = 5e348b13-5871-4338-99a1-a8b11109b8a3 response_code = 200 uri = /network-bootstore-config
17112024-05-10T21:29:39.571ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41033
17122024-05-10T21:29:39.617ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 45291 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:41033 req_id = 9c176b9e-a323-47a5-be4c-8492d9c52f61 response_code = 204 uri = /switch-ports
17132024-05-10T21:29:39.617ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41033 req_id = f7995333-303c-48ce-8536-1ecbd4f2d42e response_code = 200 uri = /network-bootstore-config
17142024-05-10T21:29:50.766ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 495 local_addr = [fd00:1122:3344:101::1]:52284 method = GET remote_addr = [fd00:1122:3344:101::d]:40200 req_id = 32f49c2b-8d81-4d97-b462-b1e5f73ad174 response_code = 200 sled_id = 3ae06dcf-597c-4d18-b2d7-37c1f02096d7 uri = //3ae06dcf-597c-4d18-b2d7-37c1f02096d7
17152024-05-10T21:29:52.283ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:47314
17162024-05-10T21:29:52.284ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 667 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:47314 req_id = dac5df23-56af-400d-b1c9-df2733236b3c response_code = 200 uri = /baseboard
17172024-05-10T21:30:08.863ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63794
17182024-05-10T21:30:08.914ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 51421 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:63794 req_id = 3b48ca97-df2f-4ae3-962b-cfdb764c3604 response_code = 204 uri = /switch-ports
17192024-05-10T21:30:08.915ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63794 req_id = 12818b85-5233-4d1d-8a46-7bbb0c2a241a response_code = 200 uri = /network-bootstore-config
17202024-05-10T21:30:09.109ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49834
17212024-05-10T21:30:09.148ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 39583 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:49834 req_id = c9ba91e5-727b-49e6-a5b1-fb91045cc014 response_code = 204 uri = /switch-ports
17222024-05-10T21:30:09.149ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49834 req_id = 35fe319f-339f-40db-9567-0a1fbe66d72e response_code = 200 uri = /network-bootstore-config
17232024-05-10T21:30:09.191ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38508
17242024-05-10T21:30:09.237ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 45898 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:38508 req_id = 07a3870a-7c3c-471a-87d7-b6b3bef35eb2 response_code = 204 uri = /switch-ports
17252024-05-10T21:30:09.238ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38508 req_id = a5aaa677-5ffe-4517-96d2-14ca6ef9fe92 response_code = 200 uri = /network-bootstore-config
17262024-05-10T21:30:20.767ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 498 local_addr = [fd00:1122:3344:101::1]:52284 method = GET remote_addr = [fd00:1122:3344:101::d]:40200 req_id = 47d14e23-84d0-4bfb-aed1-bd8147b8dad4 response_code = 200 sled_id = 3ae06dcf-597c-4d18-b2d7-37c1f02096d7 uri = //3ae06dcf-597c-4d18-b2d7-37c1f02096d7
17272024-05-10T21:30:22.237ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56383
17282024-05-10T21:30:22.248ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:546 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: ef2e9d19-cd8b-46cf-a858-e214928f4968, kind: Instance { id: ad3c3a26-88d8-4e2a-8352-8fd346279818 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 246, 22, 128])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.0.0, prefix: 22 })), vni: Vni(14099819), primary: true, slot: 0 }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: ef2e9d19-cd8b-46cf-a858-e214928f4968, kind: Instance { id: ad3c3a26-88d8-4e2a-8352-8fd346279818 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 246, 22, 128])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.0.0, prefix: 22 })), vni: Vni(14099819), primary: true, slot: 0 }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: ef2e9d19-cd8b-46cf-a858-e214928f4968, kind: Instance { id: ad3c3a26-88d8-4e2a-8352-8fd346279818 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 246, 22, 128])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.0.0, prefix: 22 })), vni: Vni(14099819), primary: true, slot: 0 }], filter_hosts: Some([Vpc(Vni(14099819))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: ef2e9d19-cd8b-46cf-a858-e214928f4968, kind: Instance { id: ad3c3a26-88d8-4e2a-8352-8fd346279818 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 246, 22, 128])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.0.0, prefix: 22 })), vni: Vni(14099819), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-cc423af6c35", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 6d10e6a7-8edf-45ed-afd0-f4814c79630c, read_only_parent: Some(Volume { block_size: 512, id: b0a42eec-24a8-4a4d-abb8-c4ff98ab81cc, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: c68082d9-6693-4b85-9403-4536dd047af1, key: Some("uhquUFFnQw6QXUQGexrVgl2SM0O2hE+Lnvm6SqeMXKI="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::15]:19002", "[fd00:1122:3344:101::1a]:19001", "[fd00:1122:3344:101::18]:19002"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 6d10e6a7-8edf-45ed-afd0-f4814c79630c, key: Some("Kecon2icVFiPMXvG1Yc06qvM0VclilA+xAGf/gB1RJQ="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::16]:19000", "[fd00:1122:3344:101::1a]:19002", "[fd00:1122:3344:101::14]:19000"] } }] } }], cloud_init_bytes: Some("6zyQTVNXSU40LjEAAgEBAAIAAioA+AEAKgBAAAAAAAAAAAAAAAApeFY0EmNpZGF0YSAgICAgRkFUMTIgICAOH75bfKwiwHQLVrQOuwcAzRBe6/Ay5M0WzRnr/lRoaXMgaXMgbm90IGEgYm9vdGFibGUgZGlzay4gIFBsZWFzZSBpbnNlcnQgYSBib290YWJsZSBmbG9wcHkgYW5kDQpwcmVzcyBhbnkga2V5IHRvIHRyeSBhZ2FpbiAuLi4gDQoAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAVar4////DwAAAAAAAAAA8P//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////D/j///8PAAAAAAAAAADw//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////8PY2lkYXRhICAgICAIAAAAAAAAAAAAAAAAAAAAAAAAAABBbQBlAHQAYQAtAA8A1GQAYQB0AGEAAAD//wAA/////01FVEEtRH4xICAgAAAUy6uqWKpYAADLq6pYAgC3AAAAQXUAcwBlAHIALQAPALBkAGEAdABhAAAA//8AAP////9VU0VSLUR+MSAgIAAAFMurqliqWAAAy6uqWAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAHsiaW5zdGFuY2UtaWQiOiJhZDNjM2EyNi04OGQ4LTRlMmEtODM1Mi04ZmQzNDYyNzk4MTgiLCJsb2NhbC1ob3N0bmFtZSI6ImxvY2Fsc2hhcmsiLCJwdWJsaWMta2V5cyI6WyJzc2gtZWQyNTUxOSBBQUFBQzNOemFDMWxaREkxTlRFNUFBQUFJTEx5Sno3bWxuRG92NC84bWJMQm96dVRoRWs4YU5sRzNyaTlQM2VDcHRraCJdfQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA") } instance_id = ad3c3a26-88d8-4e2a-8352-8fd346279818 instance_runtime = InstanceRuntimeState { propolis_id: Some(6182ec66-497a-4e01-b9cc-9718ced2da39), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-05-10T21:30:21.845829526Z } metadata = InstanceMetadata { silo_id: 47e71290-fa42-43c0-acb1-5a418035ba16, project_id: 45ce0783-2703-487d-910e-d5b22706e48e } propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = 6182ec66-497a-4e01-b9cc-9718ced2da39 vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(1), time_updated: 2024-05-10T21:30:21.797479Z }
17292024-05-10T21:30:22.248ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:580 instance_id = ad3c3a26-88d8-4e2a-8352-8fd346279818
17302024-05-10T21:30:22.249ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:938 instance_id = ad3c3a26-88d8-4e2a-8352-8fd346279818 propolis_id = 6182ec66-497a-4e01-b9cc-9718ced2da39 state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: ef2e9d19-cd8b-46cf-a858-e214928f4968, kind: Instance { id: ad3c3a26-88d8-4e2a-8352-8fd346279818 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 246, 22, 128])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.0.0, prefix: 22 })), vni: Vni(14099819), primary: true, slot: 0 }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: ef2e9d19-cd8b-46cf-a858-e214928f4968, kind: Instance { id: ad3c3a26-88d8-4e2a-8352-8fd346279818 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 246, 22, 128])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.0.0, prefix: 22 })), vni: Vni(14099819), primary: true, slot: 0 }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: ef2e9d19-cd8b-46cf-a858-e214928f4968, kind: Instance { id: ad3c3a26-88d8-4e2a-8352-8fd346279818 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 246, 22, 128])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.0.0, prefix: 22 })), vni: Vni(14099819), primary: true, slot: 0 }], filter_hosts: Some([Vpc(Vni(14099819))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: ef2e9d19-cd8b-46cf-a858-e214928f4968, kind: Instance { id: ad3c3a26-88d8-4e2a-8352-8fd346279818 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 246, 22, 128])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.0.0, prefix: 22 })), vni: Vni(14099819), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-cc423af6c35", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 6d10e6a7-8edf-45ed-afd0-f4814c79630c, read_only_parent: Some(Volume { block_size: 512, id: b0a42eec-24a8-4a4d-abb8-c4ff98ab81cc, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: c68082d9-6693-4b85-9403-4536dd047af1, key: Some("uhquUFFnQw6QXUQGexrVgl2SM0O2hE+Lnvm6SqeMXKI="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::15]:19002", "[fd00:1122:3344:101::1a]:19001", "[fd00:1122:3344:101::18]:19002"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 6d10e6a7-8edf-45ed-afd0-f4814c79630c, key: Some("Kecon2icVFiPMXvG1Yc06qvM0VclilA+xAGf/gB1RJQ="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::16]:19000", "[fd00:1122:3344:101::1a]:19002", "[fd00:1122:3344:101::14]:19000"] } }] } }], cloud_init_bytes: Some("6zyQTVNXSU40LjEAAgEBAAIAAioA+AEAKgBAAAAAAAAAAAAAAAApeFY0EmNpZGF0YSAgICAgRkFUMTIgICAOH75bfKwiwHQLVrQOuwcAzRBe6/Ay5M0WzRnr/lRoaXMgaXMgbm90IGEgYm9vdGFibGUgZGlzay4gIFBsZWFzZSBpbnNlcnQgYSBib290YWJsZSBmbG9wcHkgYW5kDQpwcmVzcyBhbnkga2V5IHRvIHRyeSBhZ2FpbiAuLi4gDQoAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAVar4////DwAAAAAAAAAA8P//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////D/j///8PAAAAAAAAAADw//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////8PY2lkYXRhICAgICAIAAAAAAAAAAAAAAAAAAAAAAAAAABBbQBlAHQAYQAtAA8A1GQAYQB0AGEAAAD//wAA/////01FVEEtRH4xICAgAAAUy6uqWKpYAADLq6pYAgC3AAAAQXUAcwBlAHIALQAPALBkAGEAdABhAAAA//8AAP////9VU0VSLUR+MSAgIAAAFMurqliqWAAAy6uqWAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAHsiaW5zdGFuY2UtaWQiOiJhZDNjM2EyNi04OGQ4LTRlMmEtODM1Mi04ZmQzNDYyNzk4MTgiLCJsb2NhbC1ob3N0bmFtZSI6ImxvY2Fsc2hhcmsiLCJwdWJsaWMta2V5cyI6WyJzc2gtZWQyNTUxOSBBQUFBQzNOemFDMWxaREkxTlRFNUFBQUFJTEx5Sno3bWxuRG92NC84bWJMQm96dVRoRWs4YU5sRzNyaTlQM2VDcHRraCJdfQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA") }, instance_runtime: InstanceRuntimeState { propolis_id: Some(6182ec66-497a-4e01-b9cc-9718ced2da39), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-05-10T21:30:21.845829526Z }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(1), time_updated: 2024-05-10T21:30:21.797479Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400 }
17312024-05-10T21:30:22.253ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 14679 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56383 req_id = 3c0d0a39-a8e9-4e06-a2b6-aa5cd89e5c17 response_code = 200 uri = /instances/ad3c3a26-88d8-4e2a-8352-8fd346279818
17322024-05-10T21:30:22.318ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:63938
17332024-05-10T21:30:22.318ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 65 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:63938 req_id = 0fdb1103-d0da-4f88-a900-3722813d4cc7 response_code = 200 uri = /baseboard
17342024-05-10T21:30:22.346ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37366
17352024-05-10T21:30:22.348ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 2475 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37366 req_id = a8aa6ec9-233e-4c84-9d07-5ddd8b0ac3ea response_code = 200 uri = /instances/ad3c3a26-88d8-4e2a-8352-8fd346279818/state
17362024-05-10T21:30:22.369ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:394 port = Port { inner: PortInner { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 246, 22, 128]), slot: 0, vni: Vni { inner: 14099819 }, gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 }, vnic: "vopte6" } }
17372024-05-10T21:30:22.370ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
17382024-05-10T21:30:22.407ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_6182ec66-497a-4e01-b9cc-9718ced2da39 file = illumos-utils/src/zone.rs:315 instance_id = ad3c3a26-88d8-4e2a-8352-8fd346279818
17392024-05-10T21:30:22.430ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_6182ec66-497a-4e01-b9cc-9718ced2da39 file = illumos-utils/src/zone.rs:354 instance_id = ad3c3a26-88d8-4e2a-8352-8fd346279818
17402024-05-10T21:30:23.709ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_6182ec66-497a-4e01-b9cc-9718ced2da39: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlInstance0"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::1:0"/> <propval type="astring" name="listen_port" value="12400"/> <propval type="astring" name="metric_addr" value="[fd00:1122:3344:101::c]:12221"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = ad3c3a26-88d8-4e2a-8352-8fd346279818
17412024-05-10T21:30:23.709ZINFOSledAgent (InstanceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 instance_id = ad3c3a26-88d8-4e2a-8352-8fd346279818 zone = oxz_propolis-server_6182ec66-497a-4e01-b9cc-9718ced2da39
17422024-05-10T21:30:23.877ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_6182ec66-497a-4e01-b9cc-9718ced2da39") failed: Property not found. retry in 55.663858ms file = illumos-utils/src/svc.rs:36 instance_id = ad3c3a26-88d8-4e2a-8352-8fd346279818 zone = oxz_propolis-server_6182ec66-497a-4e01-b9cc-9718ced2da39
17432024-05-10T21:30:23.946ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_6182ec66-497a-4e01-b9cc-9718ced2da39") failed: Property not found. retry in 71.808117ms file = illumos-utils/src/svc.rs:36 instance_id = ad3c3a26-88d8-4e2a-8352-8fd346279818 zone = oxz_propolis-server_6182ec66-497a-4e01-b9cc-9718ced2da39
17442024-05-10T21:30:24.033ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_6182ec66-497a-4e01-b9cc-9718ced2da39") failed: Property not found. retry in 187.111241ms file = illumos-utils/src/svc.rs:36 instance_id = ad3c3a26-88d8-4e2a-8352-8fd346279818 zone = oxz_propolis-server_6182ec66-497a-4e01-b9cc-9718ced2da39
17452024-05-10T21:30:24.233ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_6182ec66-497a-4e01-b9cc-9718ced2da39") failed: Property not found. retry in 462.863041ms file = illumos-utils/src/svc.rs:36 instance_id = ad3c3a26-88d8-4e2a-8352-8fd346279818 zone = oxz_propolis-server_6182ec66-497a-4e01-b9cc-9718ced2da39
17462024-05-10T21:30:24.707ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_6182ec66-497a-4e01-b9cc-9718ced2da39") failed: Property not found. retry in 998.150957ms file = illumos-utils/src/svc.rs:36 instance_id = ad3c3a26-88d8-4e2a-8352-8fd346279818 zone = oxz_propolis-server_6182ec66-497a-4e01-b9cc-9718ced2da39
17472024-05-10T21:30:25.717ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_6182ec66-497a-4e01-b9cc-9718ced2da39") failed: Property not found. retry in 1.184212203s file = illumos-utils/src/svc.rs:36 instance_id = ad3c3a26-88d8-4e2a-8352-8fd346279818 zone = oxz_propolis-server_6182ec66-497a-4e01-b9cc-9718ced2da39
17482024-05-10T21:30:26.282ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:300
17492024-05-10T21:30:26.282ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
17502024-05-10T21:30:26.318ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:289 next_cleanup = Instant { tv_sec: 2317, tv_nsec: 95546006 } time_to_next_cleanup = 599.99999589s
17512024-05-10T21:30:26.912ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_6182ec66-497a-4e01-b9cc-9718ced2da39") failed: Property not found. retry in 1.482403139s file = illumos-utils/src/svc.rs:36 instance_id = ad3c3a26-88d8-4e2a-8352-8fd346279818 zone = oxz_propolis-server_6182ec66-497a-4e01-b9cc-9718ced2da39
17522024-05-10T21:30:28.423ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_6182ec66-497a-4e01-b9cc-9718ced2da39 file = sled-agent/src/instance.rs:1423 instance_id = ad3c3a26-88d8-4e2a-8352-8fd346279818
17532024-05-10T21:30:28.432ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_6182ec66-497a-4e01-b9cc-9718ced2da39") failed: Property not found. retry in 70.722064ms file = illumos-utils/src/svc.rs:36 instance_id = ad3c3a26-88d8-4e2a-8352-8fd346279818
17542024-05-10T21:30:28.512ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_6182ec66-497a-4e01-b9cc-9718ced2da39") failed: Property not found. retry in 57.182385ms file = illumos-utils/src/svc.rs:36 instance_id = ad3c3a26-88d8-4e2a-8352-8fd346279818
17552024-05-10T21:30:28.580ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_6182ec66-497a-4e01-b9cc-9718ced2da39") failed: Property not found. retry in 179.327176ms file = illumos-utils/src/svc.rs:36 instance_id = ad3c3a26-88d8-4e2a-8352-8fd346279818
17562024-05-10T21:30:28.769ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_6182ec66-497a-4e01-b9cc-9718ced2da39") failed: Property not found. retry in 565.453982ms file = illumos-utils/src/svc.rs:36 instance_id = ad3c3a26-88d8-4e2a-8352-8fd346279818
17572024-05-10T21:30:29.345ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:1432 instance_id = ad3c3a26-88d8-4e2a-8352-8fd346279818
17582024-05-10T21:30:29.379ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:1446 instance_id = ad3c3a26-88d8-4e2a-8352-8fd346279818
17592024-05-10T21:30:29.380ZINFOSledAgent (InstanceManager): Sending ensure request to propolis: InstanceEnsureRequest { cloud_init_bytes: Some("6zyQTVNXSU40LjEAAgEBAAIAAioA+AEAKgBAAAAAAAAAAAAAAAApeFY0EmNpZGF0YSAgICAgRkFUMTIgICAOH75bfKwiwHQLVrQOuwcAzRBe6/Ay5M0WzRnr/lRoaXMgaXMgbm90IGEgYm9vdGFibGUgZGlzay4gIFBsZWFzZSBpbnNlcnQgYSBib290YWJsZSBmbG9wcHkgYW5kDQpwcmVzcyBhbnkga2V5IHRvIHRyeSBhZ2FpbiAuLi4gDQoAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAVar4////DwAAAAAAAAAA8P//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////D/j///8PAAAAAAAAAADw//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////8PY2lkYXRhICAgICAIAAAAAAAAAAAAAAAAAAAAAAAAAABBbQBlAHQAYQAtAA8A1GQAYQB0AGEAAAD//wAA/////01FVEEtRH4xICAgAAAUy6uqWKpYAADLq6pYAgC3AAAAQXUAcwBlAHIALQAPALBkAGEAdABhAAAA//8AAP////9VU0VSLUR+MSAgIAAAFMurqliqWAAAy6uqWAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAHsiaW5zdGFuY2UtaWQiOiJhZDNjM2EyNi04OGQ4LTRlMmEtODM1Mi04ZmQzNDYyNzk4MTgiLCJsb2NhbC1ob3N0bmFtZSI6ImxvY2Fsc2hhcmsiLCJwdWJsaWMta2V5cyI6WyJzc2gtZWQyNTUxOSBBQUFBQzNOemFDMWxaREkxTlRFNUFBQUFJTEx5Sno3bWxuRG92NC84bWJMQm96dVRoRWs4YU5sRzNyaTlQM2VDcHRraCJdfQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA"), disks: [DiskRequest { device: "nvme", name: "disk-cc423af6c35", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 6d10e6a7-8edf-45ed-afd0-f4814c79630c, read_only_parent: Some(Volume { block_size: 512, id: b0a42eec-24a8-4a4d-abb8-c4ff98ab81cc, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: c68082d9-6693-4b85-9403-4536dd047af1, key: Some("uhquUFFnQw6QXUQGexrVgl2SM0O2hE+Lnvm6SqeMXKI="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::15]:19002", "[fd00:1122:3344:101::1a]:19001", "[fd00:1122:3344:101::18]:19002"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 6d10e6a7-8edf-45ed-afd0-f4814c79630c, key: Some("Kecon2icVFiPMXvG1Yc06qvM0VclilA+xAGf/gB1RJQ="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::16]:19000", "[fd00:1122:3344:101::1a]:19002", "[fd00:1122:3344:101::14]:19000"] } }] } }], migrate: None, nics: [NetworkInterfaceRequest { name: "vopte6", slot: Slot(0) }], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Test description", id: ad3c3a26-88d8-4e2a-8352-8fd346279818, image_id: 00000000-0000-0000-0000-000000000000, memory: 1024, metadata: InstanceMetadata { project_id: 45ce0783-2703-487d-910e-d5b22706e48e, silo_id: 47e71290-fa42-43c0-acb1-5a418035ba16 }, name: "localshark", vcpus: 2 } } file = sled-agent/src/instance.rs:685 instance_id = ad3c3a26-88d8-4e2a-8352-8fd346279818
17602024-05-10T21:30:29.488ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:687 instance_id = ad3c3a26-88d8-4e2a-8352-8fd346279818
17612024-05-10T21:30:29.488ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Starting), migration_status: NoMigration, time: 2024-05-10T21:30:29.488753358Z } file = sled-agent/src/instance.rs:569 instance_id = ad3c3a26-88d8-4e2a-8352-8fd346279818
17622024-05-10T21:30:29.488ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:591 instance_id = ad3c3a26-88d8-4e2a-8352-8fd346279818 new_instance_state = InstanceRuntimeState { propolis_id: Some(6182ec66-497a-4e01-b9cc-9718ced2da39), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-05-10T21:30:21.845829526Z } new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-05-10T21:30:29.488753358Z } propolis_id = 6182ec66-497a-4e01-b9cc-9718ced2da39
17632024-05-10T21:30:29.488ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:491 instance_id = ad3c3a26-88d8-4e2a-8352-8fd346279818 state = SledInstanceState { instance_state: InstanceRuntimeState { propolis_id: Some(6182ec66-497a-4e01-b9cc-9718ced2da39), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-05-10T21:30:21.845829526Z }, propolis_id: 6182ec66-497a-4e01-b9cc-9718ced2da39, vmm_state: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-05-10T21:30:29.488753358Z } }
17642024-05-10T21:30:29.534ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_status: NoMigration, time: 2024-05-10T21:30:29.534835444Z } file = sled-agent/src/instance.rs:569 instance_id = ad3c3a26-88d8-4e2a-8352-8fd346279818
17652024-05-10T21:30:29.534ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:591 instance_id = ad3c3a26-88d8-4e2a-8352-8fd346279818 new_instance_state = InstanceRuntimeState { propolis_id: Some(6182ec66-497a-4e01-b9cc-9718ced2da39), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-05-10T21:30:21.845829526Z } new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(3), time_updated: 2024-05-10T21:30:29.534835444Z } propolis_id = 6182ec66-497a-4e01-b9cc-9718ced2da39
17662024-05-10T21:30:29.534ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:491 instance_id = ad3c3a26-88d8-4e2a-8352-8fd346279818 state = SledInstanceState { instance_state: InstanceRuntimeState { propolis_id: Some(6182ec66-497a-4e01-b9cc-9718ced2da39), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-05-10T21:30:21.845829526Z }, propolis_id: 6182ec66-497a-4e01-b9cc-9718ced2da39, vmm_state: VmmRuntimeState { state: Running, gen: Generation(3), time_updated: 2024-05-10T21:30:29.534835444Z } }
17672024-05-10T21:30:38.794ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43729
17682024-05-10T21:30:38.795ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 1337 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43729 req_id = 30212f2c-dd7f-4c85-b3be-c7304d930cf3 response_code = 200 uri = /instances/ad3c3a26-88d8-4e2a-8352-8fd346279818/state
17692024-05-10T21:30:38.980ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50062
17702024-05-10T21:30:38.982ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 1344 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50062 req_id = 2a5a7e60-c11b-43d7-9ce7-ae3bc2a3abd4 response_code = 200 uri = /instances/ad3c3a26-88d8-4e2a-8352-8fd346279818/state
17712024-05-10T21:30:39.070ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51823
17722024-05-10T21:30:39.070ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51823 req_id = 2d9f02de-0018-436e-8b88-fb0ee18e8b62 response_code = 200 uri = /instances/ad3c3a26-88d8-4e2a-8352-8fd346279818/state
17732024-05-10T21:30:39.108ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63312
17742024-05-10T21:30:39.159ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 50492 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:63312 req_id = 5c5b15c2-2552-4292-8834-cac1bc5b7c5b response_code = 204 uri = /switch-ports
17752024-05-10T21:30:39.159ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63312 req_id = dec5e702-3880-4c2f-a9b3-5626776550c6 response_code = 200 uri = /network-bootstore-config
17762024-05-10T21:30:39.352ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41574
17772024-05-10T21:30:39.396ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 43512 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:41574 req_id = 31785b14-3d5b-432d-ba58-39f5320b6017 response_code = 204 uri = /switch-ports
17782024-05-10T21:30:39.396ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41574 req_id = 2d8ec14e-4f99-42bc-bfe0-6d9729fd88b1 response_code = 200 uri = /network-bootstore-config
17792024-05-10T21:30:39.496ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49130
17802024-05-10T21:30:39.540ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 44223 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:49130 req_id = 88aaf4f3-55a2-4041-b06e-f3ece80191a3 response_code = 204 uri = /switch-ports
17812024-05-10T21:30:39.544ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 717 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49130 req_id = 629b40aa-9d4f-475e-a148-156ad60b14b8 response_code = 200 uri = /network-bootstore-config
17822024-05-10T21:30:39.588ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41309
17832024-05-10T21:30:39.589ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 555 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41309 req_id = 5e8d732b-ba83-4a21-a7c7-af584e489eb7 response_code = 200 uri = /instances/ad3c3a26-88d8-4e2a-8352-8fd346279818/state
17842024-05-10T21:30:39.589ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_status: NoMigration, time: 2024-05-10T21:30:39.589282949Z } file = sled-agent/src/instance.rs:569 instance_id = ad3c3a26-88d8-4e2a-8352-8fd346279818
17852024-05-10T21:30:39.589ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:591 instance_id = ad3c3a26-88d8-4e2a-8352-8fd346279818 new_instance_state = InstanceRuntimeState { propolis_id: Some(6182ec66-497a-4e01-b9cc-9718ced2da39), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-05-10T21:30:21.845829526Z } new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(5), time_updated: 2024-05-10T21:30:39.589282949Z } propolis_id = 6182ec66-497a-4e01-b9cc-9718ced2da39
17862024-05-10T21:30:39.589ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:491 instance_id = ad3c3a26-88d8-4e2a-8352-8fd346279818 state = SledInstanceState { instance_state: InstanceRuntimeState { propolis_id: Some(6182ec66-497a-4e01-b9cc-9718ced2da39), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-05-10T21:30:21.845829526Z }, propolis_id: 6182ec66-497a-4e01-b9cc-9718ced2da39, vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(5), time_updated: 2024-05-10T21:30:39.589282949Z } }
17872024-05-10T21:30:39.608ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_status: NoMigration, time: 2024-05-10T21:30:39.608115044Z } file = sled-agent/src/instance.rs:569 instance_id = ad3c3a26-88d8-4e2a-8352-8fd346279818
17882024-05-10T21:30:39.608ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:591 instance_id = ad3c3a26-88d8-4e2a-8352-8fd346279818 new_instance_state = InstanceRuntimeState { propolis_id: None, dst_propolis_id: None, migration_id: None, gen: Generation(5), time_updated: 2024-05-10T21:30:39.608115044Z } new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(6), time_updated: 2024-05-10T21:30:39.608115044Z } propolis_id = 6182ec66-497a-4e01-b9cc-9718ced2da39
17892024-05-10T21:30:39.608ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:606 instance_id = ad3c3a26-88d8-4e2a-8352-8fd346279818
17902024-05-10T21:30:39.608ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
17912024-05-10T21:30:39.608ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
17922024-05-10T21:30:39.608ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/6742bbd6-6bec-4f6b-94f3-002a53fc9f01/debug/bundle/zone", "/pool/int/8becec77-7597-498a-9704-3ae75204e470/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/d7867297-5592-4803-bd09-620387b7253d/crypt/debug", "/pool/ext/7482ebc0-5237-4ab2-bef7-e62e772ad207/crypt/debug", "/pool/ext/4a2a1aac-5879-491f-b914-3e863f8ce4c3/crypt/debug", "/pool/ext/c20ef2f7-458a-4b20-ab01-0ef15666a084/crypt/debug", "/pool/ext/c78aa9ff-15c2-42ef-a938-4f9e1a276bc9/crypt/debug", "/pool/ext/b315123f-de7f-4c95-94ec-6ebbaf4bb37f/crypt/debug", "/pool/ext/be007fc9-c18b-4eb9-b039-d1acd6258caa/crypt/debug", "/pool/ext/d1ca4b9b-c237-46f9-b5f2-dacd6333114b/crypt/debug", "/pool/ext/6827078d-a479-42be-8ba6-18589f19cebd/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:437 zone_name = oxz_propolis-server_6182ec66-497a-4e01-b9cc-9718ced2da39
17932024-05-10T21:30:40.224ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1230 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_6182ec66-497a-4e01-b9cc-9718ced2da39", bundle_id: a81d46bd-ac93-42a2-b010-fa56e4d97af8 }, time_created: 2024-05-10T21:30:39.608659246Z, version: 0, cause: TerminatedInstance }
17942024-05-10T21:30:40.224ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_6182ec66-497a-4e01-b9cc-9718ced2da39 file = sled-agent/src/instance.rs:780 instance_id = ad3c3a26-88d8-4e2a-8352-8fd346279818
17952024-05-10T21:30:41.978ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:269 instance_id = ad3c3a26-88d8-4e2a-8352-8fd346279818
17962024-05-10T21:30:42.002ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:491 instance_id = ad3c3a26-88d8-4e2a-8352-8fd346279818 state = SledInstanceState { instance_state: InstanceRuntimeState { propolis_id: None, dst_propolis_id: None, migration_id: None, gen: Generation(5), time_updated: 2024-05-10T21:30:39.608115044Z }, propolis_id: 6182ec66-497a-4e01-b9cc-9718ced2da39, vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-05-10T21:30:42.002320152Z } }
17972024-05-10T21:30:42.074ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60692
17982024-05-10T21:30:42.074ZWARNSledAgent (PortManager): unset_virtual_nic_host unimplmented file = illumos-utils/src/opte/port_manager.rs:620
17992024-05-10T21:30:42.074ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 643 local_addr = [fd00:1122:3344:101::1]:12345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:60692 req_id = 9e73e14b-2763-433e-bea2-dd6fcde0c040 response_code = 204 uri = /v2p/ef2e9d19-cd8b-46cf-a858-e214928f4968
18002024-05-10T21:30:42.362ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:491 instance_id = ad3c3a26-88d8-4e2a-8352-8fd346279818 state = SledInstanceState { instance_state: InstanceRuntimeState { propolis_id: None, dst_propolis_id: None, migration_id: None, gen: Generation(5), time_updated: 2024-05-10T21:30:39.608115044Z }, propolis_id: 6182ec66-497a-4e01-b9cc-9718ced2da39, vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-05-10T21:30:42.002320152Z } }
18012024-05-10T21:30:42.365ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:723 instance_id = ad3c3a26-88d8-4e2a-8352-8fd346279818