Max level shown:
1 [ Apr 3 10:07:37 Enabled. ]
2 [ Apr 3 10:07:37 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Apr 3 10:07:37 Method "start" exited with status 0. ]
4 [ Apr 3 10:07:37 Rereading configuration. ]
5 [ Apr 3 10:07:37 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72024-04-03T10:07:37.214ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:163
82024-04-03T10:07:37.214ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:253
92024-04-03T10:07:37.268ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:260
102024-04-03T10:07:37.268ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112024-04-03T10:07:37.385ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122024-04-03T10:07:37.394ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132024-04-03T10:07:37.403ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:270 path = /var/run/oxide/
142024-04-03T10:07:38.007ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:87 prefix = Ipv6Prefix { addr: fdb0:18c0:4d0d:9fb2::, len: 64 }
152024-04-03T10:07:38.147ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:115
162024-04-03T10:07:38.147ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:127
172024-04-03T10:07:38.147ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:137
182024-04-03T10:07:38.147ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:157 sled_mode = Scrimlet { asic: SoftNpuZone }
192024-04-03T10:07:38.147ZINFOSledAgent (DumpSetup-archival): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:291
202024-04-03T10:07:38.147ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:609
212024-04-03T10:07:38.147ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:801
222024-04-03T10:07:38.150ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "buskin", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:535
232024-04-03T10:07:38.150ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:658
242024-04-03T10:07:38.150ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:171
252024-04-03T10:07:38.150ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:716
262024-04-03T10:07:38.150ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:227 vdev = /scratch/m2_0.vdev
272024-04-03T10:07:38.150ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot file = sled-agent/src/hardware_monitor.rs:261 underlay_network_info = None
282024-04-03T10:07:38.150ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" }, variant: M2, slot: 1024 }), tx: ... } file = sled-storage/src/manager.rs:381
292024-04-03T10:07:38.150ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" }
302024-04-03T10:07:38.151ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:111 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" } path = /scratch/m2_0.vdev
312024-04-03T10:07:38.162ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:301
322024-04-03T10:07:38.162ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:312 id = 01c49d73-3192-415f-8980-20cd04381a9e
332024-04-03T10:07:38.262ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: 01c49d73-3192-415f-8980-20cd04381a9e, kind: Internal }
342024-04-03T10:07:38.466ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:381
352024-04-03T10:07:38.466ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:227 vdev = /scratch/m2_1.vdev
362024-04-03T10:07:38.466ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" }
372024-04-03T10:07:38.466ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-M2" }, variant: M2, slot: 1025 }), tx: ... } file = sled-storage/src/manager.rs:381
382024-04-03T10:07:38.466ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-M2" }
392024-04-03T10:07:38.466ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:111 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-M2" } path = /scratch/m2_1.vdev
402024-04-03T10:07:38.474ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:301
412024-04-03T10:07:38.474ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:312 id = 65806d03-995e-4ce6-8ef1-b0fb41706a5a
422024-04-03T10:07:38.559ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-M2" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: 65806d03-995e-4ce6-8ef1-b0fb41706a5a, kind: Internal }
432024-04-03T10:07:38.761ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:227 vdev = /scratch/u2_0.vdev
442024-04-03T10:07:38.761ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 01c49d73-3192-415f-8980-20cd04381a9e, kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-M2" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-M2" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: 65806d03-995e-4ce6-8ef1-b0fb41706a5a, kind: Internal } }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
452024-04-03T10:07:38.761ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" }, variant: U2, slot: 1026 }), tx: ... } file = sled-storage/src/manager.rs:381
462024-04-03T10:07:38.761ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" }
472024-04-03T10:07:38.761ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:227 vdev = /scratch/u2_1.vdev
482024-04-03T10:07:38.761ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 01c49d73-3192-415f-8980-20cd04381a9e, kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" }, variant: U2, slot: 1026 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-M2" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-M2" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: 65806d03-995e-4ce6-8ef1-b0fb41706a5a, kind: Internal } }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
492024-04-03T10:07:38.761ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" }, variant: U2, slot: 1027 }), tx: ... } file = sled-storage/src/manager.rs:381
502024-04-03T10:07:38.761ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" }
512024-04-03T10:07:38.761ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:227 vdev = /scratch/u2_2.vdev
522024-04-03T10:07:38.761ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 01c49d73-3192-415f-8980-20cd04381a9e, kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" }, variant: U2, slot: 1026 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-M2" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-M2" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: 65806d03-995e-4ce6-8ef1-b0fb41706a5a, kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" }, variant: U2, slot: 1027 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
532024-04-03T10:07:38.761ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" }, variant: U2, slot: 1028 }), tx: ... } file = sled-storage/src/manager.rs:381
542024-04-03T10:07:38.761ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" }
552024-04-03T10:07:38.761ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:227 vdev = /scratch/u2_3.vdev
562024-04-03T10:07:38.761ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 01c49d73-3192-415f-8980-20cd04381a9e, kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" }, variant: U2, slot: 1026 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-M2" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-M2" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: 65806d03-995e-4ce6-8ef1-b0fb41706a5a, kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" }, variant: U2, slot: 1027 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" }, variant: U2, slot: 1028 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
572024-04-03T10:07:38.761ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" }, variant: U2, slot: 1029 }), tx: ... } file = sled-storage/src/manager.rs:381
582024-04-03T10:07:38.761ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" }
592024-04-03T10:07:38.761ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:227 vdev = /scratch/u2_4.vdev
602024-04-03T10:07:38.761ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2" }, variant: U2, slot: 1030 }), tx: ... } file = sled-storage/src/manager.rs:381
612024-04-03T10:07:38.762ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2" }
622024-04-03T10:07:38.762ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 01c49d73-3192-415f-8980-20cd04381a9e, kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" }, variant: U2, slot: 1026 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-M2" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-M2" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: 65806d03-995e-4ce6-8ef1-b0fb41706a5a, kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" }, variant: U2, slot: 1027 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" }, variant: U2, slot: 1028 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" }, variant: U2, slot: 1029 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
632024-04-03T10:07:38.762ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:227 vdev = /scratch/u2_5.vdev
642024-04-03T10:07:38.762ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2" }, variant: U2, slot: 1031 }), tx: ... } file = sled-storage/src/manager.rs:381
652024-04-03T10:07:38.762ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2" }
662024-04-03T10:07:38.762ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 01c49d73-3192-415f-8980-20cd04381a9e, kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" }, variant: U2, slot: 1026 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-M2" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-M2" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: 65806d03-995e-4ce6-8ef1-b0fb41706a5a, kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" }, variant: U2, slot: 1027 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" }, variant: U2, slot: 1028 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" }, variant: U2, slot: 1029 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2" }, variant: U2, slot: 1030 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
672024-04-03T10:07:38.762ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:227 vdev = /scratch/u2_6.vdev
682024-04-03T10:07:38.762ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-6", model: "synthetic-model-U2" }, variant: U2, slot: 1032 }), tx: ... } file = sled-storage/src/manager.rs:381
692024-04-03T10:07:38.762ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 01c49d73-3192-415f-8980-20cd04381a9e, kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" }, variant: U2, slot: 1026 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-M2" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-M2" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: 65806d03-995e-4ce6-8ef1-b0fb41706a5a, kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" }, variant: U2, slot: 1027 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" }, variant: U2, slot: 1028 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" }, variant: U2, slot: 1029 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2" }, variant: U2, slot: 1030 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2" }, variant: U2, slot: 1031 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
702024-04-03T10:07:38.762ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-6", model: "synthetic-model-U2" }
712024-04-03T10:07:38.762ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:227 vdev = /scratch/u2_7.vdev
722024-04-03T10:07:38.762ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-7", model: "synthetic-model-U2" }, variant: U2, slot: 1033 }), tx: ... } file = sled-storage/src/manager.rs:381
732024-04-03T10:07:38.762ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-7", model: "synthetic-model-U2" }
742024-04-03T10:07:38.762ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 01c49d73-3192-415f-8980-20cd04381a9e, kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" }, variant: U2, slot: 1026 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-M2" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-M2" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: 65806d03-995e-4ce6-8ef1-b0fb41706a5a, kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" }, variant: U2, slot: 1027 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" }, variant: U2, slot: 1028 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" }, variant: U2, slot: 1029 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2" }, variant: U2, slot: 1030 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2" }, variant: U2, slot: 1031 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-6", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-6", model: "synthetic-model-U2" }, variant: U2, slot: 1032 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
752024-04-03T10:07:38.762ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:227 vdev = /scratch/u2_8.vdev
762024-04-03T10:07:38.762ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-8", model: "synthetic-model-U2" }, variant: U2, slot: 1034 }), tx: ... } file = sled-storage/src/manager.rs:381
772024-04-03T10:07:38.762ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-8", model: "synthetic-model-U2" }
782024-04-03T10:07:38.762ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 01c49d73-3192-415f-8980-20cd04381a9e, kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" }, variant: U2, slot: 1026 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-M2" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-M2" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: 65806d03-995e-4ce6-8ef1-b0fb41706a5a, kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" }, variant: U2, slot: 1027 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" }, variant: U2, slot: 1028 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" }, variant: U2, slot: 1029 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2" }, variant: U2, slot: 1030 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2" }, variant: U2, slot: 1031 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-6", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-6", model: "synthetic-model-U2" }, variant: U2, slot: 1032 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-7", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-7", model: "synthetic-model-U2" }, variant: U2, slot: 1033 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
792024-04-03T10:07:38.762ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:87
802024-04-03T10:07:38.762ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" } file = sled-agent/src/long_running_tasks.rs:89
812024-04-03T10:07:38.762ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 01c49d73-3192-415f-8980-20cd04381a9e, kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" }, variant: U2, slot: 1026 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-M2" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-M2" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: 65806d03-995e-4ce6-8ef1-b0fb41706a5a, kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" }, variant: U2, slot: 1027 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" }, variant: U2, slot: 1028 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" }, variant: U2, slot: 1029 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2" }, variant: U2, slot: 1030 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2" }, variant: U2, slot: 1031 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-6", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-6", model: "synthetic-model-U2" }, variant: U2, slot: 1032 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-7", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-7", model: "synthetic-model-U2" }, variant: U2, slot: 1033 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-8", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-8", model: "synthetic-model-U2" }, variant: U2, slot: 1034 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
822024-04-03T10:07:38.762ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
832024-04-03T10:07:38.762ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:195
842024-04-03T10:07:38.762ZINFOSledAgent (bootstore): No ledger in /pool/int/01c49d73-3192-415f-8980-20cd04381a9e/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
852024-04-03T10:07:38.762ZINFOSledAgent (bootstore): No ledger in /pool/int/65806d03-995e-4ce6-8ef1-b0fb41706a5a/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
862024-04-03T10:07:38.762ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-buskin-i86pc
872024-04-03T10:07:38.762ZINFOSledAgent (bootstore): No ledger in /pool/int/01c49d73-3192-415f-8980-20cd04381a9e/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
882024-04-03T10:07:38.762ZINFOSledAgent (bootstore): No ledger in /pool/int/65806d03-995e-4ce6-8ef1-b0fb41706a5a/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
892024-04-03T10:07:38.762ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-buskin-i86pc
902024-04-03T10:07:38.762ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:200
912024-04-03T10:07:38.762ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:215
922024-04-03T10:07:38.773ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:701
932024-04-03T10:07:38.773ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:289 next_cleanup = Instant { tv_sec: 1606, tv_nsec: 1983128 } time_to_next_cleanup = 599.999929239s
942024-04-03T10:07:38.773ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3588
952024-04-03T10:07:38.773ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
962024-04-03T10:07:38.773ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/01c49d73-3192-415f-8980-20cd04381a9e/config/sled-agent-request.json file = common/src/ledger.rs:188
972024-04-03T10:07:38.773ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/65806d03-995e-4ce6-8ef1-b0fb41706a5a/config/sled-agent-request.json file = common/src/ledger.rs:188
982024-04-03T10:07:38.776ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:195 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80
992024-04-03T10:07:38.776ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:44 local_addr = [fdb0:18c0:4d0d:9fb2::1]:12346
1002024-04-03T10:07:38.776ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.1.164, last: 10.151.1.173, }, ), ], external_dns_ips: [ 10.151.1.164, 10.151.1.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV1 { rack_subnet: Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56, }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV1 { routes: [ RouteConfig { destination: V4( Ipv4Network { addr: 0.0.0.0, prefix: 0, }, ), nexthop: 10.151.1.100, }, ], addresses: [ V4( Ipv4Network { addr: 10.151.1.174, prefix: 24, }, ), ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: None, bgp_peers: [], autoneg: false, }, ], bgp: [], bfd: [], }, } file = sled-agent/src/rack_setup/service.rs:997
1012024-04-03T10:07:38.776ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:60
1022024-04-03T10:07:38.776ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
1032024-04-03T10:07:38.776ZINFOSledAgent (RSS): No ledger in /pool/int/01c49d73-3192-415f-8980-20cd04381a9e/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1042024-04-03T10:07:38.776ZINFOSledAgent (RSS): No ledger in /pool/int/65806d03-995e-4ce6-8ef1-b0fb41706a5a/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1052024-04-03T10:07:38.776ZINFOSledAgent (RSS): RSS configuration has not been fully applied yet file = sled-agent/src/rack_setup/service.rs:1057
1062024-04-03T10:07:38.776ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
1072024-04-03T10:07:38.776ZINFOSledAgent (RSS): No ledger in /pool/int/01c49d73-3192-415f-8980-20cd04381a9e/config/rss-sled-plan.json file = common/src/ledger.rs:188
1082024-04-03T10:07:38.776ZINFOSledAgent (RSS): No ledger in /pool/int/65806d03-995e-4ce6-8ef1-b0fb41706a5a/config/rss-sled-plan.json file = common/src/ledger.rs:188
1092024-04-03T10:07:38.776ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1098
1102024-04-03T10:07:38.776ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:118
1112024-04-03T10:07:38.776ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:9fb2::1 file = sled-agent/src/rack_setup/plan/sled.rs:91
1122024-04-03T10:07:38.777ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
1132024-04-03T10:07:38.777ZINFOSledAgent (RSS): Writing ledger to /pool/int/01c49d73-3192-415f-8980-20cd04381a9e/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:199
1142024-04-03T10:07:38.777ZINFOSledAgent (RSS): Writing ledger to /pool/int/65806d03-995e-4ce6-8ef1-b0fb41706a5a/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:199
1152024-04-03T10:07:38.777ZINFOSledAgent (RSS): Sled plan written to storage file = sled-agent/src/rack_setup/plan/sled.rs:138
1162024-04-03T10:07:38.777ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1131
1172024-04-03T10:07:38.777ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
1182024-04-03T10:07:38.777ZINFOSledAgent (bootstore): Writing ledger to /pool/int/01c49d73-3192-415f-8980-20cd04381a9e/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
1192024-04-03T10:07:38.778ZINFOSledAgent (bootstore): Writing ledger to /pool/int/65806d03-995e-4ce6-8ef1-b0fb41706a5a/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
1202024-04-03T10:07:38.778ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
1212024-04-03T10:07:38.778ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:217 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: aa5c4df3-cd22-4b16-be8c-4ae0b07c237e, rack_id: b85ae885-2925-429b-842f-b57ce9e9b6a0, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net(Ipv6Network { addr: fd00:1122:3344:101::, prefix: 64 }) } } } target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
1222024-04-03T10:07:38.778ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:66 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:36762
1232024-04-03T10:07:38.778ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: aa5c4df3-cd22-4b16-be8c-4ae0b07c237e, rack_id: b85ae885-2925-429b-842f-b57ce9e9b6a0, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net(Ipv6Network { addr: fd00:1122:3344:101::, prefix: 64 }) } } } file = sled-agent/src/bootstrap/server.rs:356
1242024-04-03T10:07:38.778ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:371
1252024-04-03T10:07:38.778ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:381
1262024-04-03T10:07:38.778ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:530
1272024-04-03T10:07:38.778ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1282024-04-03T10:07:38.778ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:87 prefix = Ipv6Prefix { addr: fd00:1122:3344:101::, len: 64 }
1292024-04-03T10:07:38.778ZINFOSledAgent (StorageManager): No ledger in /pool/int/01c49d73-3192-415f-8980-20cd04381a9e/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_ledger
1302024-04-03T10:07:38.778ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:60
1312024-04-03T10:07:38.778ZINFOSledAgent (StorageManager): No ledger in /pool/int/65806d03-995e-4ce6-8ef1-b0fb41706a5a/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_ledger
1322024-04-03T10:07:38.778ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:519
1332024-04-03T10:07:38.778ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:547
1342024-04-03T10:07:38.781ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:3819
1352024-04-03T10:07:38.788ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" }
1362024-04-03T10:07:38.797ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" }
1372024-04-03T10:07:38.807ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" }
1382024-04-03T10:07:38.816ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" }
1392024-04-03T10:07:38.824ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2" }
1402024-04-03T10:07:38.833ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2" }
1412024-04-03T10:07:38.841ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-6", model: "synthetic-model-U2" }
1422024-04-03T10:07:38.850ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-7", model: "synthetic-model-U2" }
1432024-04-03T10:07:38.858ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-8", model: "synthetic-model-U2" }
1442024-04-03T10:07:38.858ZINFOSledAgent (StorageManager): No disks to be automatically managed file = sled-storage/src/manager.rs:558
1452024-04-03T10:07:38.858ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
1462024-04-03T10:07:38.858ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:370
1472024-04-03T10:07:38.858ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:339
1482024-04-03T10:07:38.858ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:449 result = DisksManagementResult { status: [] }
1492024-04-03T10:07:38.879ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:315
1502024-04-03T10:07:38.896ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:354
1512024-04-03T10:07:38.914ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:355 sled_id = aa5c4df3-cd22-4b16-be8c-4ae0b07c237e
1522024-04-03T10:07:38.914ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
1532024-04-03T10:07:38.914ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:367 sled_id = aa5c4df3-cd22-4b16-be8c-4ae0b07c237e
1542024-04-03T10:07:38.914ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:164
1552024-04-03T10:07:38.918ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 92.164365ms DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "70fa0daf-981d-449f-9000-9423caff0abf", "content-length": "124", "date": "Wed, 03 Apr 2024 10:07:38 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "70fa0daf-981d-449f-9000-9423caff0abf" } file = clients/ddm-admin-client/src/lib.rs:178
1562024-04-03T10:07:38.928ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_01c49d73-3192-415f-8980-20cd04381a9e/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1572024-04-03T10:07:38.952ZINFOSledAgent: successfully created encrypted zvol: name="oxi_01c49d73-3192-415f-8980-20cd04381a9e/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1582024-04-03T10:07:38.952ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_01c49d73-3192-415f-8980-20cd04381a9e/swap" file = sled-agent/src/swap_device.rs:96
1592024-04-03T10:07:38.957ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:382 sled_id = aa5c4df3-cd22-4b16-be8c-4ae0b07c237e
1602024-04-03T10:07:38.957ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:126
1612024-04-03T10:07:38.957ZINFOSledAgent (BackingFs): Ensuring dataset oxi_01c49d73-3192-415f-8980-20cd04381a9e/backing/fmd file = sled-agent/src/backing_fs.rs:136
1622024-04-03T10:07:39.011ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:164
1632024-04-03T10:07:39.011ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 155.362922ms DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "4bcfa17b-d1eb-4134-a3f4-6d50799442ca", "content-length": "124", "date": "Wed, 03 Apr 2024 10:07:39 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "4bcfa17b-d1eb-4134-a3f4-6d50799442ca" } file = clients/ddm-admin-client/src/lib.rs:178
1642024-04-03T10:07:39.024ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:170
1652024-04-03T10:07:39.168ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:164
1662024-04-03T10:07:39.168ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 214.678082ms DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "6a8f0117-7dcb-4498-949c-77d71c300ffc", "content-length": "124", "date": "Wed, 03 Apr 2024 10:07:39 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "6a8f0117-7dcb-4498-949c-77d71c300ffc" } file = clients/ddm-admin-client/src/lib.rs:178
1672024-04-03T10:07:39.241ZINFOSledAgent (BackingFs): Mounting oxi_01c49d73-3192-415f-8980-20cd04381a9e/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:178
1682024-04-03T10:07:39.253ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:186
1692024-04-03T10:07:39.253ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:186
1702024-04-03T10:07:39.253ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:186
1712024-04-03T10:07:39.253ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:192
1722024-04-03T10:07:39.385ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:164
1732024-04-03T10:07:39.385ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 152.837903ms DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "6884034c-683f-4f0b-8523-0eefe3f95533", "content-length": "124", "date": "Wed, 03 Apr 2024 10:07:39 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "6884034c-683f-4f0b-8523-0eefe3f95533" } file = clients/ddm-admin-client/src/lib.rs:178
1742024-04-03T10:07:39.539ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:164
1752024-04-03T10:07:39.539ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 215.187255ms DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "d7a98ab3-8c93-48b4-b15b-2f4d9936b11b", "content-length": "124", "date": "Wed, 03 Apr 2024 10:07:39 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "d7a98ab3-8c93-48b4-b15b-2f4d9936b11b" } file = clients/ddm-admin-client/src/lib.rs:178
1762024-04-03T10:07:39.756ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:164
1772024-04-03T10:07:39.757ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 338.334533ms DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "5c5b9bd3-c9ac-4786-84ee-8446d0ec642e", "content-length": "124", "date": "Wed, 03 Apr 2024 10:07:39 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "5c5b9bd3-c9ac-4786-84ee-8446d0ec642e" } file = clients/ddm-admin-client/src/lib.rs:178
1782024-04-03T10:07:39.966ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:90 sled_id = aa5c4df3-cd22-4b16-be8c-4ae0b07c237e
1792024-04-03T10:07:40.015ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:266 sled_id = aa5c4df3-cd22-4b16-be8c-4ae0b07c237e
1802024-04-03T10:07:40.015ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:274 sled_id = aa5c4df3-cd22-4b16-be8c-4ae0b07c237e
1812024-04-03T10:07:40.015ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:983 underlay_address = fd00:1122:3344:101::1
1822024-04-03T10:07:40.015ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:60
1832024-04-03T10:07:40.016ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:195 local_addr = [fd00:1122:3344:101::1]:12345
1842024-04-03T10:07:40.016ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:426
1852024-04-03T10:07:40.016ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
1862024-04-03T10:07:40.016ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/01c49d73-3192-415f-8980-20cd04381a9e/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
1872024-04-03T10:07:40.016ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/65806d03-995e-4ce6-8ef1-b0fb41706a5a/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
1882024-04-03T10:07:40.016ZWARNSledAgent: failed to register as a metric producer with Nexus error = "Metric registration error: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/metrics/producers): error trying to connect: dns error: proto error: io error: No route to host (os error 148)" file = sled-agent/src/sled_agent.rs:1178 retry_after = 335.911134ms sled_id = aa5c4df3-cd22-4b16-be8c-4ae0b07c237e
1892024-04-03T10:07:40.017ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
1902024-04-03T10:07:40.017ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot file = sled-agent/src/hardware_monitor.rs:261 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV1 { rack_subnet: Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [PortConfigV1 { routes: [RouteConfig { destination: V4(Ipv4Network { addr: 0.0.0.0, prefix: 0 }), nexthop: 10.151.1.100 }], addresses: [V4(Ipv4Network { addr: 10.151.1.174, prefix: 24 })], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: None, bgp_peers: [], autoneg: false }], bgp: [], bfd: [] })))
1912024-04-03T10:07:40.017ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3588
1922024-04-03T10:07:40.017ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:73 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:36762
1932024-04-03T10:07:40.017ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:108 peer = [fdb0:18c0:4d0d:9fb2::1]:12346
1942024-04-03T10:07:40.017ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:232 target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
1952024-04-03T10:07:40.197ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
1962024-04-03T10:07:40.197ZINFOSledAgent (RSS): No ledger in /pool/int/01c49d73-3192-415f-8980-20cd04381a9e/config/rss-service-plan-v3.json file = common/src/ledger.rs:188
1972024-04-03T10:07:40.197ZINFOSledAgent (RSS): No ledger in /pool/int/65806d03-995e-4ce6-8ef1-b0fb41706a5a/config/rss-service-plan-v3.json file = common/src/ledger.rs:188
1982024-04-03T10:07:40.197ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
1992024-04-03T10:07:40.197ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
2002024-04-03T10:07:40.197ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:164
2012024-04-03T10:07:40.202ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/aa5c4df3-cd22-4b16-be8c-4ae0b07c237e): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:619 sled_id = aa5c4df3-cd22-4b16-be8c-4ae0b07c237e
2022024-04-03T10:07:40.229ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59822
2032024-04-03T10:07:40.229ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
2042024-04-03T10:07:40.229ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 220 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:59822 req_id = a0b6a440-80a6-4ae3-91fa-0d71209c3466 response_code = 200 uri = /inventory
2052024-04-03T10:07:40.258ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34217
2062024-04-03T10:07:40.258ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:34217 req_id = c483a9b2-bed8-461b-8d2a-5a19fd0cf9bd response_code = 200 uri = /sled-role
2072024-04-03T10:07:40.260ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
2082024-04-03T10:07:40.260ZINFOSledAgent (RSS): Writing ledger to /pool/int/01c49d73-3192-415f-8980-20cd04381a9e/config/.rss-service-plan-v3.json.tmp file = common/src/ledger.rs:199
2092024-04-03T10:07:40.260ZINFOSledAgent (RSS): Writing ledger to /pool/int/65806d03-995e-4ce6-8ef1-b0fb41706a5a/config/.rss-service-plan-v3.json.tmp file = common/src/ledger.rs:199
2102024-04-03T10:07:40.260ZINFOSledAgent (RSS): Service plan written to storage file = sled-agent/src/rack_setup/plan/service.rs:802
2112024-04-03T10:07:40.291ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { disks: [OmicronPhysicalDiskConfig { id: 2e4cc369-bcc6-44fa-86b8-87ef82e882be, identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" }, pool_id: 36614205-9374-49cf-8904-cb3f4aa78846 }, OmicronPhysicalDiskConfig { id: 4b26fba5-1eec-42cd-a435-31764e6e3b71, identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" }, pool_id: 6b96699f-97d9-48d8-b1c0-05be5951e087 }, OmicronPhysicalDiskConfig { id: a278e2cd-bf49-4b90-ab1a-e0e48d7c2298, identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" }, pool_id: 5735529a-b898-4275-88a6-00a9444d8997 }, OmicronPhysicalDiskConfig { id: c857cc61-83e2-426d-a80b-8172642546fe, identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" }, pool_id: 4533d42a-5c24-4d2c-8caa-2a74a63c16c3 }, OmicronPhysicalDiskConfig { id: e3a3c941-ccb3-4012-938b-19f71cd1ce14, identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2" }, pool_id: 474bd740-7e4d-443a-9485-0c3e8b3716ec }, OmicronPhysicalDiskConfig { id: 260bcab7-5955-4fa8-9c7e-0396abc56030, identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2" }, pool_id: f14b76c3-7994-4bb4-962a-4f772a3dd8b9 }, OmicronPhysicalDiskConfig { id: 451ba920-1ef7-4e89-9abd-6ee283193a49, identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-6", model: "synthetic-model-U2" }, pool_id: a0234d98-6d13-4518-a6ed-6616f80ec892 }, OmicronPhysicalDiskConfig { id: 9cd870e7-dc3a-4adf-907f-877c2b9c6b10, identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-7", model: "synthetic-model-U2" }, pool_id: 5df238e3-5630-4184-a188-36117b1a7b7b }, OmicronPhysicalDiskConfig { id: ba4c84f1-e0dc-43a3-9e16-ec53def507bc, identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-8", model: "synthetic-model-U2" }, pool_id: 2e47e008-76df-41d9-b268-da990559f786 }], generation: Generation(1) } file = sled-agent/src/rack_setup/service.rs:344 sled_address = [fd00:1122:3344:101::1]:12345
2122024-04-03T10:07:40.291ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36274
2132024-04-03T10:07:40.292ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(1), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" }, id: 2e4cc369-bcc6-44fa-86b8-87ef82e882be, pool_id: 36614205-9374-49cf-8904-cb3f4aa78846 }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" }, id: 4b26fba5-1eec-42cd-a435-31764e6e3b71, pool_id: 6b96699f-97d9-48d8-b1c0-05be5951e087 }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" }, id: a278e2cd-bf49-4b90-ab1a-e0e48d7c2298, pool_id: 5735529a-b898-4275-88a6-00a9444d8997 }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" }, id: c857cc61-83e2-426d-a80b-8172642546fe, pool_id: 4533d42a-5c24-4d2c-8caa-2a74a63c16c3 }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2" }, id: e3a3c941-ccb3-4012-938b-19f71cd1ce14, pool_id: 474bd740-7e4d-443a-9485-0c3e8b3716ec }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2" }, id: 260bcab7-5955-4fa8-9c7e-0396abc56030, pool_id: f14b76c3-7994-4bb4-962a-4f772a3dd8b9 }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-6", model: "synthetic-model-U2" }, id: 451ba920-1ef7-4e89-9abd-6ee283193a49, pool_id: a0234d98-6d13-4518-a6ed-6616f80ec892 }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-7", model: "synthetic-model-U2" }, id: 9cd870e7-dc3a-4adf-907f-877c2b9c6b10, pool_id: 5df238e3-5630-4184-a188-36117b1a7b7b }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-8", model: "synthetic-model-U2" }, id: ba4c84f1-e0dc-43a3-9e16-ec53def507bc, pool_id: 2e47e008-76df-41d9-b268-da990559f786 }] }, tx: ... } file = sled-storage/src/manager.rs:381
2142024-04-03T10:07:40.292ZINFOSledAgent (StorageManager): No ledger in /pool/int/01c49d73-3192-415f-8980-20cd04381a9e/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2152024-04-03T10:07:40.292ZINFOSledAgent (StorageManager): No ledger in /pool/int/65806d03-995e-4ce6-8ef1-b0fb41706a5a/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2162024-04-03T10:07:40.292ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:681 request = omicron_physical_disks_ensure
2172024-04-03T10:07:40.292ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:339
2182024-04-03T10:07:40.292ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" } file = sled-storage/src/resources.rs:379
2192024-04-03T10:07:40.292ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
2202024-04-03T10:07:40.292ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:111 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" } path = /scratch/u2_0.vdev
2212024-04-03T10:07:40.372ZWARNSledAgent: failed to register as a metric producer with Nexus error = "Metric registration error: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/metrics/producers): error trying to connect: dns error: proto error: io error: No route to host (os error 148)" file = sled-agent/src/sled_agent.rs:1178 retry_after = 621.759173ms sled_id = aa5c4df3-cd22-4b16-be8c-4ae0b07c237e
2222024-04-03T10:07:40.379ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:301
2232024-04-03T10:07:40.379ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:307 id = 36614205-9374-49cf-8904-cb3f4aa78846
2242024-04-03T10:07:41.160ZWARNSledAgent: failed to register as a metric producer with Nexus error = "Metric registration error: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/metrics/producers): error trying to connect: dns error: proto error: io error: No route to host (os error 148)" file = sled-agent/src/sled_agent.rs:1178 retry_after = 1.076138854s sled_id = aa5c4df3-cd22-4b16-be8c-4ae0b07c237e
2252024-04-03T10:07:41.160ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/aa5c4df3-cd22-4b16-be8c-4ae0b07c237e): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = aa5c4df3-cd22-4b16-be8c-4ae0b07c237e
2262024-04-03T10:07:41.342ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: 36614205-9374-49cf-8904-cb3f4aa78846, kind: External }
2272024-04-03T10:07:41.525ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" } file = sled-storage/src/dataset.rs:332
2282024-04-03T10:07:41.525ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" } epoch = 0 file = sled-storage/src/dataset.rs:334
2292024-04-03T10:07:41.525ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" } epoch = 0 file = sled-storage/src/dataset.rs:338
2302024-04-03T10:07:41.525ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" } epoch = 0 file = sled-storage/src/dataset.rs:340
2312024-04-03T10:07:41.525ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2322024-04-03T10:07:41.525ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:38 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2332024-04-03T10:07:41.525ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
2342024-04-03T10:07:42.080ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/aa5c4df3-cd22-4b16-be8c-4ae0b07c237e): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:619 sled_id = aa5c4df3-cd22-4b16-be8c-4ae0b07c237e
2352024-04-03T10:07:42.082ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:57
2362024-04-03T10:07:42.325ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/aa5c4df3-cd22-4b16-be8c-4ae0b07c237e): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = aa5c4df3-cd22-4b16-be8c-4ae0b07c237e
2372024-04-03T10:07:42.326ZWARNSledAgent: failed to register as a metric producer with Nexus error = "Metric registration error: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/metrics/producers): error trying to connect: dns error: proto error: io error: No route to host (os error 148)" file = sled-agent/src/sled_agent.rs:1178 retry_after = 2.129254861s sled_id = aa5c4df3-cd22-4b16-be8c-4ae0b07c237e
2382024-04-03T10:07:42.332ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_36614205-9374-49cf-8904-cb3f4aa78846/crypt/zone file = sled-storage/src/dataset.rs:395
2392024-04-03T10:07:42.827ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_switch
2402024-04-03T10:07:43.586ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 26.071679ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2412024-04-03T10:07:43.962ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/aa5c4df3-cd22-4b16-be8c-4ae0b07c237e): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = aa5c4df3-cd22-4b16-be8c-4ae0b07c237e
2422024-04-03T10:07:43.963ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 100.701885ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2432024-04-03T10:07:44.370ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/aa5c4df3-cd22-4b16-be8c-4ae0b07c237e): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:619 sled_id = aa5c4df3-cd22-4b16-be8c-4ae0b07c237e
2442024-04-03T10:07:44.575ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 142.914732ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2452024-04-03T10:07:45.012ZWARNSledAgent: failed to register as a metric producer with Nexus error = "Metric registration error: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/metrics/producers): error trying to connect: dns error: proto error: io error: No route to host (os error 148)" file = sled-agent/src/sled_agent.rs:1178 retry_after = 5.547278663s sled_id = aa5c4df3-cd22-4b16-be8c-4ae0b07c237e
2462024-04-03T10:07:45.012ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/aa5c4df3-cd22-4b16-be8c-4ae0b07c237e): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = aa5c4df3-cd22-4b16-be8c-4ae0b07c237e
2472024-04-03T10:07:45.251ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 307.04829ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2482024-04-03T10:07:45.272ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_36614205-9374-49cf-8904-cb3f4aa78846 file = sled-storage/src/dataset.rs:480
2492024-04-03T10:07:45.508ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" } file = sled-storage/src/resources.rs:477
2502024-04-03T10:07:45.508ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" } file = sled-storage/src/resources.rs:394
2512024-04-03T10:07:45.508ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" } file = sled-storage/src/resources.rs:379
2522024-04-03T10:07:45.508ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
2532024-04-03T10:07:45.508ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:111 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" } path = /scratch/u2_1.vdev
2542024-04-03T10:07:45.816ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:301
2552024-04-03T10:07:45.816ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:307 id = 6b96699f-97d9-48d8-b1c0-05be5951e087
2562024-04-03T10:07:47.023ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: 6b96699f-97d9-48d8-b1c0-05be5951e087, kind: External }
2572024-04-03T10:07:47.258ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" } file = sled-storage/src/dataset.rs:332
2582024-04-03T10:07:47.258ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" } epoch = 0 file = sled-storage/src/dataset.rs:334
2592024-04-03T10:07:47.258ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" } epoch = 0 file = sled-storage/src/dataset.rs:338
2602024-04-03T10:07:47.258ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" } epoch = 0 file = sled-storage/src/dataset.rs:340
2612024-04-03T10:07:47.258ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2622024-04-03T10:07:47.258ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:38 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2632024-04-03T10:07:47.258ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
2642024-04-03T10:07:47.732ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/aa5c4df3-cd22-4b16-be8c-4ae0b07c237e): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = aa5c4df3-cd22-4b16-be8c-4ae0b07c237e
2652024-04-03T10:07:47.732ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/aa5c4df3-cd22-4b16-be8c-4ae0b07c237e): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:619 sled_id = aa5c4df3-cd22-4b16-be8c-4ae0b07c237e
2662024-04-03T10:07:47.981ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 434.868742ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2672024-04-03T10:07:48.508ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:57
2682024-04-03T10:07:49.018ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_6b96699f-97d9-48d8-b1c0-05be5951e087/crypt/zone file = sled-storage/src/dataset.rs:395
2692024-04-03T10:07:49.535ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/aa5c4df3-cd22-4b16-be8c-4ae0b07c237e): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:619 sled_id = aa5c4df3-cd22-4b16-be8c-4ae0b07c237e
2702024-04-03T10:07:49.535ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/aa5c4df3-cd22-4b16-be8c-4ae0b07c237e): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = aa5c4df3-cd22-4b16-be8c-4ae0b07c237e
2712024-04-03T10:07:50.456ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:278 sled_id = aa5c4df3-cd22-4b16-be8c-4ae0b07c237e
2722024-04-03T10:07:50.460ZINFOSledAgent (ServiceManager): Ensuring tfportrear0_0/ll exists in zone file = sled-agent/src/services.rs:2286
2732024-04-03T10:07:50.537ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/aa5c4df3-cd22-4b16-be8c-4ae0b07c237e): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = aa5c4df3-cd22-4b16-be8c-4ae0b07c237e
2742024-04-03T10:07:50.542ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_6b96699f-97d9-48d8-b1c0-05be5951e087 file = sled-storage/src/dataset.rs:480
2752024-04-03T10:07:50.551ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" } file = sled-storage/src/resources.rs:477
2762024-04-03T10:07:50.551ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" } file = sled-storage/src/resources.rs:394
2772024-04-03T10:07:50.551ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" } file = sled-storage/src/resources.rs:379
2782024-04-03T10:07:50.551ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
2792024-04-03T10:07:50.551ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:111 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" } path = /scratch/u2_2.vdev
2802024-04-03T10:07:50.561ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:301
2812024-04-03T10:07:50.561ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:307 id = 5735529a-b898-4275-88a6-00a9444d8997
2822024-04-03T10:07:50.655ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: 5735529a-b898-4275-88a6-00a9444d8997, kind: External }
2832024-04-03T10:07:50.664ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" } file = sled-storage/src/dataset.rs:332
2842024-04-03T10:07:50.664ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" } epoch = 0 file = sled-storage/src/dataset.rs:334
2852024-04-03T10:07:50.664ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" } epoch = 0 file = sled-storage/src/dataset.rs:338
2862024-04-03T10:07:50.664ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" } epoch = 0 file = sled-storage/src/dataset.rs:340
2872024-04-03T10:07:50.664ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
2882024-04-03T10:07:50.664ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:38 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
2892024-04-03T10:07:50.664ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
2902024-04-03T10:07:50.668ZWARNSledAgent: failed to register as a metric producer with Nexus error = "Metric registration error: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/metrics/producers): error trying to connect: dns error: proto error: io error: No route to host (os error 148)" file = sled-agent/src/sled_agent.rs:1178 retry_after = 11.113926031s sled_id = aa5c4df3-cd22-4b16-be8c-4ae0b07c237e
2912024-04-03T10:07:50.701ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:57
2922024-04-03T10:07:50.708ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_5735529a-b898-4275-88a6-00a9444d8997/crypt/zone file = sled-storage/src/dataset.rs:395
2932024-04-03T10:07:50.834ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_5735529a-b898-4275-88a6-00a9444d8997 file = sled-storage/src/dataset.rs:480
2942024-04-03T10:07:50.842ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" } file = sled-storage/src/resources.rs:477
2952024-04-03T10:07:50.842ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" } file = sled-storage/src/resources.rs:394
2962024-04-03T10:07:50.842ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" } file = sled-storage/src/resources.rs:379
2972024-04-03T10:07:50.842ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
2982024-04-03T10:07:50.842ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:111 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" } path = /scratch/u2_3.vdev
2992024-04-03T10:07:50.852ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:301
3002024-04-03T10:07:50.852ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:307 id = 4533d42a-5c24-4d2c-8caa-2a74a63c16c3
3012024-04-03T10:07:50.945ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: 4533d42a-5c24-4d2c-8caa-2a74a63c16c3, kind: External }
3022024-04-03T10:07:50.953ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" } file = sled-storage/src/dataset.rs:332
3032024-04-03T10:07:50.953ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" } epoch = 0 file = sled-storage/src/dataset.rs:334
3042024-04-03T10:07:50.953ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" } epoch = 0 file = sled-storage/src/dataset.rs:338
3052024-04-03T10:07:50.953ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" } epoch = 0 file = sled-storage/src/dataset.rs:340
3062024-04-03T10:07:50.953ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3072024-04-03T10:07:50.953ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:38 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3082024-04-03T10:07:50.953ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
3092024-04-03T10:07:50.988ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:57
3102024-04-03T10:07:50.997ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_4533d42a-5c24-4d2c-8caa-2a74a63c16c3/crypt/zone file = sled-storage/src/dataset.rs:395
3112024-04-03T10:07:51.119ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_4533d42a-5c24-4d2c-8caa-2a74a63c16c3 file = sled-storage/src/dataset.rs:480
3122024-04-03T10:07:51.127ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" } file = sled-storage/src/resources.rs:477
3132024-04-03T10:07:51.127ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" } file = sled-storage/src/resources.rs:394
3142024-04-03T10:07:51.127ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2" } file = sled-storage/src/resources.rs:379
3152024-04-03T10:07:51.127ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
3162024-04-03T10:07:51.127ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:111 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2" } path = /scratch/u2_4.vdev
3172024-04-03T10:07:51.137ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:301
3182024-04-03T10:07:51.137ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:307 id = 474bd740-7e4d-443a-9485-0c3e8b3716ec
3192024-04-03T10:07:51.232ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: 474bd740-7e4d-443a-9485-0c3e8b3716ec, kind: External }
3202024-04-03T10:07:51.240ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2" } file = sled-storage/src/dataset.rs:332
3212024-04-03T10:07:51.240ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2" } epoch = 0 file = sled-storage/src/dataset.rs:334
3222024-04-03T10:07:51.240ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2" } epoch = 0 file = sled-storage/src/dataset.rs:338
3232024-04-03T10:07:51.240ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2" } epoch = 0 file = sled-storage/src/dataset.rs:340
3242024-04-03T10:07:51.240ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3252024-04-03T10:07:51.240ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:38 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3262024-04-03T10:07:51.240ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
3272024-04-03T10:07:51.277ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:57
3282024-04-03T10:07:51.285ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_474bd740-7e4d-443a-9485-0c3e8b3716ec/crypt/zone file = sled-storage/src/dataset.rs:395
3292024-04-03T10:07:51.411ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_474bd740-7e4d-443a-9485-0c3e8b3716ec file = sled-storage/src/dataset.rs:480
3302024-04-03T10:07:51.420ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2" } file = sled-storage/src/resources.rs:477
3312024-04-03T10:07:51.420ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2" } file = sled-storage/src/resources.rs:394
3322024-04-03T10:07:51.420ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2" } file = sled-storage/src/resources.rs:379
3332024-04-03T10:07:51.420ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
3342024-04-03T10:07:51.420ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:111 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2" } path = /scratch/u2_5.vdev
3352024-04-03T10:07:51.429ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:301
3362024-04-03T10:07:51.429ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:307 id = f14b76c3-7994-4bb4-962a-4f772a3dd8b9
3372024-04-03T10:07:51.525ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: f14b76c3-7994-4bb4-962a-4f772a3dd8b9, kind: External }
3382024-04-03T10:07:51.532ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2" } file = sled-storage/src/dataset.rs:332
3392024-04-03T10:07:51.532ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2" } epoch = 0 file = sled-storage/src/dataset.rs:334
3402024-04-03T10:07:51.532ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2" } epoch = 0 file = sled-storage/src/dataset.rs:338
3412024-04-03T10:07:51.532ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2" } epoch = 0 file = sled-storage/src/dataset.rs:340
3422024-04-03T10:07:51.532ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3432024-04-03T10:07:51.532ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:38 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3442024-04-03T10:07:51.532ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
3452024-04-03T10:07:51.536ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/aa5c4df3-cd22-4b16-be8c-4ae0b07c237e): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:619 sled_id = aa5c4df3-cd22-4b16-be8c-4ae0b07c237e
3462024-04-03T10:07:51.539ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/aa5c4df3-cd22-4b16-be8c-4ae0b07c237e): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = aa5c4df3-cd22-4b16-be8c-4ae0b07c237e
3472024-04-03T10:07:51.568ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:57
3482024-04-03T10:07:51.576ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_f14b76c3-7994-4bb4-962a-4f772a3dd8b9/crypt/zone file = sled-storage/src/dataset.rs:395
3492024-04-03T10:07:51.700ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_f14b76c3-7994-4bb4-962a-4f772a3dd8b9 file = sled-storage/src/dataset.rs:480
3502024-04-03T10:07:51.709ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2" } file = sled-storage/src/resources.rs:477
3512024-04-03T10:07:51.709ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2" } file = sled-storage/src/resources.rs:394
3522024-04-03T10:07:51.709ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-6", model: "synthetic-model-U2" } file = sled-storage/src/resources.rs:379
3532024-04-03T10:07:51.709ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
3542024-04-03T10:07:51.709ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:111 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-6", model: "synthetic-model-U2" } path = /scratch/u2_6.vdev
3552024-04-03T10:07:51.719ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:301
3562024-04-03T10:07:51.719ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:307 id = a0234d98-6d13-4518-a6ed-6616f80ec892
3572024-04-03T10:07:51.810ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-6", model: "synthetic-model-U2" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: a0234d98-6d13-4518-a6ed-6616f80ec892, kind: External }
3582024-04-03T10:07:51.818ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-6", model: "synthetic-model-U2" } file = sled-storage/src/dataset.rs:332
3592024-04-03T10:07:51.818ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-6", model: "synthetic-model-U2" } epoch = 0 file = sled-storage/src/dataset.rs:334
3602024-04-03T10:07:51.818ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-6", model: "synthetic-model-U2" } epoch = 0 file = sled-storage/src/dataset.rs:338
3612024-04-03T10:07:51.818ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-6", model: "synthetic-model-U2" } epoch = 0 file = sled-storage/src/dataset.rs:340
3622024-04-03T10:07:51.818ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3632024-04-03T10:07:51.818ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:38 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3642024-04-03T10:07:51.818ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
3652024-04-03T10:07:51.853ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:57
3662024-04-03T10:07:51.860ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_a0234d98-6d13-4518-a6ed-6616f80ec892/crypt/zone file = sled-storage/src/dataset.rs:395
3672024-04-03T10:07:51.974ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_a0234d98-6d13-4518-a6ed-6616f80ec892 file = sled-storage/src/dataset.rs:480
3682024-04-03T10:07:51.982ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-6", model: "synthetic-model-U2" } file = sled-storage/src/resources.rs:477
3692024-04-03T10:07:51.982ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-6", model: "synthetic-model-U2" } file = sled-storage/src/resources.rs:394
3702024-04-03T10:07:51.982ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-7", model: "synthetic-model-U2" } file = sled-storage/src/resources.rs:379
3712024-04-03T10:07:51.982ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
3722024-04-03T10:07:51.982ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:111 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-7", model: "synthetic-model-U2" } path = /scratch/u2_7.vdev
3732024-04-03T10:07:51.993ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:301
3742024-04-03T10:07:51.993ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:307 id = 5df238e3-5630-4184-a188-36117b1a7b7b
3752024-04-03T10:07:52.087ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-7", model: "synthetic-model-U2" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: 5df238e3-5630-4184-a188-36117b1a7b7b, kind: External }
3762024-04-03T10:07:52.095ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-7", model: "synthetic-model-U2" } file = sled-storage/src/dataset.rs:332
3772024-04-03T10:07:52.095ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-7", model: "synthetic-model-U2" } epoch = 0 file = sled-storage/src/dataset.rs:334
3782024-04-03T10:07:52.095ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-7", model: "synthetic-model-U2" } epoch = 0 file = sled-storage/src/dataset.rs:338
3792024-04-03T10:07:52.095ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-7", model: "synthetic-model-U2" } epoch = 0 file = sled-storage/src/dataset.rs:340
3802024-04-03T10:07:52.095ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
3812024-04-03T10:07:52.095ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:38 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
3822024-04-03T10:07:52.095ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
3832024-04-03T10:07:52.131ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:57
3842024-04-03T10:07:52.140ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_5df238e3-5630-4184-a188-36117b1a7b7b/crypt/zone file = sled-storage/src/dataset.rs:395
3852024-04-03T10:07:52.264ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_5df238e3-5630-4184-a188-36117b1a7b7b file = sled-storage/src/dataset.rs:480
3862024-04-03T10:07:52.273ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-7", model: "synthetic-model-U2" } file = sled-storage/src/resources.rs:477
3872024-04-03T10:07:52.273ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-7", model: "synthetic-model-U2" } file = sled-storage/src/resources.rs:394
3882024-04-03T10:07:52.273ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-8", model: "synthetic-model-U2" } file = sled-storage/src/resources.rs:379
3892024-04-03T10:07:52.273ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
3902024-04-03T10:07:52.273ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:111 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-8", model: "synthetic-model-U2" } path = /scratch/u2_8.vdev
3912024-04-03T10:07:52.283ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:301
3922024-04-03T10:07:52.283ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:307 id = 2e47e008-76df-41d9-b268-da990559f786
3932024-04-03T10:07:52.377ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-8", model: "synthetic-model-U2" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: 2e47e008-76df-41d9-b268-da990559f786, kind: External }
3942024-04-03T10:07:52.384ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-8", model: "synthetic-model-U2" } file = sled-storage/src/dataset.rs:332
3952024-04-03T10:07:52.384ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-8", model: "synthetic-model-U2" } epoch = 0 file = sled-storage/src/dataset.rs:334
3962024-04-03T10:07:52.384ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-8", model: "synthetic-model-U2" } epoch = 0 file = sled-storage/src/dataset.rs:338
3972024-04-03T10:07:52.384ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-8", model: "synthetic-model-U2" } epoch = 0 file = sled-storage/src/dataset.rs:340
3982024-04-03T10:07:52.384ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
3992024-04-03T10:07:52.385ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:38 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4002024-04-03T10:07:52.385ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
4012024-04-03T10:07:52.418ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:57
4022024-04-03T10:07:52.425ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_2e47e008-76df-41d9-b268-da990559f786/crypt/zone file = sled-storage/src/dataset.rs:395
4032024-04-03T10:07:52.542ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/aa5c4df3-cd22-4b16-be8c-4ae0b07c237e): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = aa5c4df3-cd22-4b16-be8c-4ae0b07c237e
4042024-04-03T10:07:52.546ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_2e47e008-76df-41d9-b268-da990559f786 file = sled-storage/src/dataset.rs:480
4052024-04-03T10:07:52.554ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-8", model: "synthetic-model-U2" } file = sled-storage/src/resources.rs:477
4062024-04-03T10:07:52.554ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-8", model: "synthetic-model-U2" } file = sled-storage/src/resources.rs:394
4072024-04-03T10:07:52.554ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/01c49d73-3192-415f-8980-20cd04381a9e/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4082024-04-03T10:07:52.554ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 01c49d73-3192-415f-8980-20cd04381a9e, kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" }, variant: U2, slot: 1026 }, zpool_name: ZpoolName { id: 36614205-9374-49cf-8904-cb3f4aa78846, kind: External } })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-M2" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-M2" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: 65806d03-995e-4ce6-8ef1-b0fb41706a5a, kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" }, variant: U2, slot: 1027 }, zpool_name: ZpoolName { id: 6b96699f-97d9-48d8-b1c0-05be5951e087, kind: External } })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" }, variant: U2, slot: 1028 }, zpool_name: ZpoolName { id: 5735529a-b898-4275-88a6-00a9444d8997, kind: External } })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" }, variant: U2, slot: 1029 }, zpool_name: ZpoolName { id: 4533d42a-5c24-4d2c-8caa-2a74a63c16c3, kind: External } })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2" }, variant: U2, slot: 1030 }, zpool_name: ZpoolName { id: 474bd740-7e4d-443a-9485-0c3e8b3716ec, kind: External } })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2" }, variant: U2, slot: 1031 }, zpool_name: ZpoolName { id: f14b76c3-7994-4bb4-962a-4f772a3dd8b9, kind: External } })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-6", model: "synthetic-model-U2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-6", model: "synthetic-model-U2" }, variant: U2, slot: 1032 }, zpool_name: ZpoolName { id: a0234d98-6d13-4518-a6ed-6616f80ec892, kind: External } })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-7", model: "synthetic-model-U2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-7", model: "synthetic-model-U2" }, variant: U2, slot: 1033 }, zpool_name: ZpoolName { id: 5df238e3-5630-4184-a188-36117b1a7b7b, kind: External } })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-8", model: "synthetic-model-U2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-8", model: "synthetic-model-U2" }, variant: U2, slot: 1034 }, zpool_name: ZpoolName { id: 2e47e008-76df-41d9-b268-da990559f786, kind: External } }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
4092024-04-03T10:07:52.554ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/65806d03-995e-4ce6-8ef1-b0fb41706a5a/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4102024-04-03T10:07:52.554ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 12262814 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:36274 req_id = 86fdb19f-c5e1-4d07-9c2d-84cad0132ccb response_code = 200 uri = /omicron-physical-disks
4112024-04-03T10:07:52.585ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: 0e04e52c-490d-4b79-9cc6-e5adae4e5501, underlay_address: fd00:1122:3344:1::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 36614205-9374-49cf-8904-cb3f4aa78846, kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: c60e57f5-2712-45fb-af0b-bc0ff46e083c, underlay_address: fd00:1122:3344:2::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6b96699f-97d9-48d8-b1c0-05be5951e087, kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 586c70fe-6c95-438f-be65-3daafd7be41b, underlay_address: fd00:1122:3344:3::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5735529a-b898-4275-88a6-00a9444d8997, kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:427 sled_address = [fd00:1122:3344:101::1]:12345
4122024-04-03T10:07:52.585ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62760
4132024-04-03T10:07:52.586ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 0e04e52c-490d-4b79-9cc6-e5adae4e5501, dataset_name: DatasetName { pool_name: ZpoolName { id: 36614205-9374-49cf-8904-cb3f4aa78846, kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
4142024-04-03T10:07:52.586ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 0e04e52c-490d-4b79-9cc6-e5adae4e5501, dataset_name: DatasetName { pool_name: ZpoolName { id: 36614205-9374-49cf-8904-cb3f4aa78846, kind: External }, kind: InternalDns }, responder: ... }
4152024-04-03T10:07:52.638ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c60e57f5-2712-45fb-af0b-bc0ff46e083c, dataset_name: DatasetName { pool_name: ZpoolName { id: 6b96699f-97d9-48d8-b1c0-05be5951e087, kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
4162024-04-03T10:07:52.639ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: c60e57f5-2712-45fb-af0b-bc0ff46e083c, dataset_name: DatasetName { pool_name: ZpoolName { id: 6b96699f-97d9-48d8-b1c0-05be5951e087, kind: External }, kind: InternalDns }, responder: ... }
4172024-04-03T10:07:52.689ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 586c70fe-6c95-438f-be65-3daafd7be41b, dataset_name: DatasetName { pool_name: ZpoolName { id: 5735529a-b898-4275-88a6-00a9444d8997, kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
4182024-04-03T10:07:52.689ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 586c70fe-6c95-438f-be65-3daafd7be41b, dataset_name: DatasetName { pool_name: ZpoolName { id: 5735529a-b898-4275-88a6-00a9444d8997, kind: External }, kind: InternalDns }, responder: ... }
4192024-04-03T10:07:52.739ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
4202024-04-03T10:07:52.739ZINFOSledAgent (ServiceManager): No ledger in /pool/int/01c49d73-3192-415f-8980-20cd04381a9e/config/omicron-zones.json file = common/src/ledger.rs:188
4212024-04-03T10:07:52.739ZINFOSledAgent (ServiceManager): No ledger in /pool/int/65806d03-995e-4ce6-8ef1-b0fb41706a5a/config/omicron-zones.json file = common/src/ledger.rs:188
4222024-04-03T10:07:52.739ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
4232024-04-03T10:07:52.785ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
4242024-04-03T10:07:52.785ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
4252024-04-03T10:07:52.785ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
4262024-04-03T10:07:52.839ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_c60e57f5-2712-45fb-af0b-bc0ff46e083c file = illumos-utils/src/zone.rs:315
4272024-04-03T10:07:52.843ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_0e04e52c-490d-4b79-9cc6-e5adae4e5501 file = illumos-utils/src/zone.rs:315
4282024-04-03T10:07:52.846ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_586c70fe-6c95-438f-be65-3daafd7be41b file = illumos-utils/src/zone.rs:315
4292024-04-03T10:07:52.859ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_c60e57f5-2712-45fb-af0b-bc0ff46e083c file = illumos-utils/src/zone.rs:354
4302024-04-03T10:07:52.864ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_0e04e52c-490d-4b79-9cc6-e5adae4e5501 file = illumos-utils/src/zone.rs:354
4312024-04-03T10:07:52.868ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_586c70fe-6c95-438f-be65-3daafd7be41b file = illumos-utils/src/zone.rs:354
4322024-04-03T10:07:53.536ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/aa5c4df3-cd22-4b16-be8c-4ae0b07c237e): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:619 sled_id = aa5c4df3-cd22-4b16-be8c-4ae0b07c237e
4332024-04-03T10:07:53.544ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/aa5c4df3-cd22-4b16-be8c-4ae0b07c237e): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = aa5c4df3-cd22-4b16-be8c-4ae0b07c237e
4342024-04-03T10:07:54.517ZINFOSledAgent (ServiceManager): Ensuring bootstrap address fdb0:18c0:4d0d:9fb2::2 exists in switch zone file = sled-agent/src/services.rs:2303
4352024-04-03T10:07:54.517ZINFOSledAgent (ServiceManager): Adding bootstrap address file = illumos-utils/src/running_zone.rs:626 zone = oxz_switch
4362024-04-03T10:07:54.546ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/aa5c4df3-cd22-4b16-be8c-4ae0b07c237e): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = aa5c4df3-cd22-4b16-be8c-4ae0b07c237e
4372024-04-03T10:07:55.210ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_c60e57f5-2712-45fb-af0b-bc0ff46e083c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService1"/> <propval type="astring" name="gateway" value="fd00:1122:3344:2::2"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:2::1"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value="[fd00:1122:3344:2::1]:5353"/> <propval type="astring" name="dns_address" value="[fd00:1122:3344:2::1]:53"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
4382024-04-03T10:07:55.210ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:87 prefix = Ipv6Prefix { addr: fd00:1122:3344:2::, len: 64 }
4392024-04-03T10:07:55.210ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_internal_dns_c60e57f5-2712-45fb-af0b-bc0ff46e083c
4402024-04-03T10:07:55.695ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_0e04e52c-490d-4b79-9cc6-e5adae4e5501: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService2"/> <propval type="astring" name="gateway" value="fd00:1122:3344:1::2"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:1::1"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value="[fd00:1122:3344:1::1]:5353"/> <propval type="astring" name="dns_address" value="[fd00:1122:3344:1::1]:53"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
4412024-04-03T10:07:56.173ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:87 prefix = Ipv6Prefix { addr: fd00:1122:3344:1::, len: 64 }
4422024-04-03T10:07:56.173ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_586c70fe-6c95-438f-be65-3daafd7be41b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService3"/> <propval type="astring" name="gateway" value="fd00:1122:3344:3::2"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:3::1"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value="[fd00:1122:3344:3::1]:5353"/> <propval type="astring" name="dns_address" value="[fd00:1122:3344:3::1]:53"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
4432024-04-03T10:07:56.173ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:87 prefix = Ipv6Prefix { addr: fd00:1122:3344:3::, len: 64 }
4442024-04-03T10:07:56.182ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c60e57f5-2712-45fb-af0b-bc0ff46e083c") failed: Property not found. retry in 41.128988ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c60e57f5-2712-45fb-af0b-bc0ff46e083c
4452024-04-03T10:07:56.182ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_internal_dns_0e04e52c-490d-4b79-9cc6-e5adae4e5501
4462024-04-03T10:07:56.185ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_internal_dns_586c70fe-6c95-438f-be65-3daafd7be41b
4472024-04-03T10:07:56.234ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c60e57f5-2712-45fb-af0b-bc0ff46e083c") failed: Property not found. retry in 52.767512ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c60e57f5-2712-45fb-af0b-bc0ff46e083c
4482024-04-03T10:07:56.296ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c60e57f5-2712-45fb-af0b-bc0ff46e083c") failed: Property not found. retry in 182.837787ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c60e57f5-2712-45fb-af0b-bc0ff46e083c
4492024-04-03T10:07:56.314ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_586c70fe-6c95-438f-be65-3daafd7be41b") failed: Property not found. retry in 67.676894ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_586c70fe-6c95-438f-be65-3daafd7be41b
4502024-04-03T10:07:56.321ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0e04e52c-490d-4b79-9cc6-e5adae4e5501") failed: Property not found. retry in 58.861085ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0e04e52c-490d-4b79-9cc6-e5adae4e5501
4512024-04-03T10:07:56.478ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0e04e52c-490d-4b79-9cc6-e5adae4e5501") failed: Property not found. retry in 139.259899ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0e04e52c-490d-4b79-9cc6-e5adae4e5501
4522024-04-03T10:07:56.592ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_586c70fe-6c95-438f-be65-3daafd7be41b") failed: Property not found. retry in 111.607178ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_586c70fe-6c95-438f-be65-3daafd7be41b
4532024-04-03T10:07:56.669ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c60e57f5-2712-45fb-af0b-bc0ff46e083c") failed: Property not found. retry in 316.998298ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c60e57f5-2712-45fb-af0b-bc0ff46e083c
4542024-04-03T10:07:56.693ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0e04e52c-490d-4b79-9cc6-e5adae4e5501") failed: Property not found. retry in 122.434001ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0e04e52c-490d-4b79-9cc6-e5adae4e5501
4552024-04-03T10:07:56.727ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_586c70fe-6c95-438f-be65-3daafd7be41b") failed: Property not found. retry in 227.879981ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_586c70fe-6c95-438f-be65-3daafd7be41b
4562024-04-03T10:07:56.853ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0e04e52c-490d-4b79-9cc6-e5adae4e5501") failed: Property not found. retry in 235.235863ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0e04e52c-490d-4b79-9cc6-e5adae4e5501
4572024-04-03T10:07:56.965ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_586c70fe-6c95-438f-be65-3daafd7be41b") failed: Property not found. retry in 506.213276ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_586c70fe-6c95-438f-be65-3daafd7be41b
4582024-04-03T10:07:56.997ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c60e57f5-2712-45fb-af0b-bc0ff46e083c") failed: Property not found. retry in 802.562114ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c60e57f5-2712-45fb-af0b-bc0ff46e083c
4592024-04-03T10:07:57.098ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0e04e52c-490d-4b79-9cc6-e5adae4e5501") failed: Property not found. retry in 832.78782ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0e04e52c-490d-4b79-9cc6-e5adae4e5501
4602024-04-03T10:07:57.480ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_586c70fe-6c95-438f-be65-3daafd7be41b") failed: Property not found. retry in 1.097028452s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_586c70fe-6c95-438f-be65-3daafd7be41b
4612024-04-03T10:07:57.808ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c60e57f5-2712-45fb-af0b-bc0ff46e083c") failed: Property not found. retry in 765.89394ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c60e57f5-2712-45fb-af0b-bc0ff46e083c
4622024-04-03T10:07:57.942ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0e04e52c-490d-4b79-9cc6-e5adae4e5501") failed: Property not found. retry in 1.233482282s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0e04e52c-490d-4b79-9cc6-e5adae4e5501
4632024-04-03T10:07:58.583ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c60e57f5-2712-45fb-af0b-bc0ff46e083c") failed: Property not found. retry in 609.693373ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c60e57f5-2712-45fb-af0b-bc0ff46e083c
4642024-04-03T10:07:58.590ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_586c70fe-6c95-438f-be65-3daafd7be41b") failed: Property not found. retry in 1.081569046s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_586c70fe-6c95-438f-be65-3daafd7be41b
4652024-04-03T10:07:59.184ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0e04e52c-490d-4b79-9cc6-e5adae4e5501") failed: Property not found. retry in 747.824584ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0e04e52c-490d-4b79-9cc6-e5adae4e5501
4662024-04-03T10:07:59.189ZINFOSledAgent (ServiceManager): Forwarding bootstrap traffic via oxBootstrap0 to fe80::8:20ff:fe56:bf6f file = sled-agent/src/services.rs:2310
4672024-04-03T10:07:59.195ZINFOSledAgent (ServiceManager): Zone not using gateway (even though underlay is up) file = sled-agent/src/services.rs:2371
4682024-04-03T10:07:59.201ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c60e57f5-2712-45fb-af0b-bc0ff46e083c") failed: Property not found. retry in 724.02374ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c60e57f5-2712-45fb-af0b-bc0ff46e083c
4692024-04-03T10:07:59.319ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2556
4702024-04-03T10:07:59.563ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2720
4712024-04-03T10:07:59.680ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_586c70fe-6c95-438f-be65-3daafd7be41b") failed: Property not found. retry in 1.313903403s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_586c70fe-6c95-438f-be65-3daafd7be41b
4722024-04-03T10:07:59.750ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2435
4732024-04-03T10:07:59.934ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c60e57f5-2712-45fb-af0b-bc0ff46e083c") failed: Property not found. retry in 1.438753224s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c60e57f5-2712-45fb-af0b-bc0ff46e083c
4742024-04-03T10:07:59.942ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0e04e52c-490d-4b79-9cc6-e5adae4e5501") failed: Property not found. retry in 704.763226ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0e04e52c-490d-4b79-9cc6-e5adae4e5501
4752024-04-03T10:08:00.052ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2470
4762024-04-03T10:08:00.255ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:2758
4772024-04-03T10:08:00.443ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:2785
4782024-04-03T10:08:00.655ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0e04e52c-490d-4b79-9cc6-e5adae4e5501") failed: Property not found. retry in 1.169733605s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0e04e52c-490d-4b79-9cc6-e5adae4e5501
4792024-04-03T10:08:00.663ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2664
4802024-04-03T10:08:00.846ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2464
4812024-04-03T10:08:00.856ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:3843 new = [fd00:1122:3344:101::2, ::1] old = [::1]
4822024-04-03T10:08:00.856ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:3859
4832024-04-03T10:08:00.856ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:609 zone = oxz_switch
4842024-04-03T10:08:01.001ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_586c70fe-6c95-438f-be65-3daafd7be41b") failed: Property not found. retry in 1.047688275s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_586c70fe-6c95-438f-be65-3daafd7be41b
4852024-04-03T10:08:01.415ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:3867
4862024-04-03T10:08:01.421ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:3923
4872024-04-03T10:08:01.579ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:3985
4882024-04-03T10:08:01.696ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:3966 rack_subnet = fd00:1122:3344::
4892024-04-03T10:08:01.721ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4008
4902024-04-03T10:08:01.823ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4035
4912024-04-03T10:08:01.943ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:364
4922024-04-03T10:08:01.975ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:412
4932024-04-03T10:08:02.007ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:589
4942024-04-03T10:08:02.007ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:627
4952024-04-03T10:08:02.007ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:630 uptime = 3
4962024-04-03T10:08:02.007ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.1.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: None,\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:434
4972024-04-03T10:08:02.072ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2997 zone = oxz_internal_dns_c60e57f5-2712-45fb-af0b-bc0ff46e083c
4982024-04-03T10:08:02.072ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2997 zone = oxz_internal_dns_0e04e52c-490d-4b79-9cc6-e5adae4e5501
4992024-04-03T10:08:02.072ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2997 zone = oxz_internal_dns_586c70fe-6c95-438f-be65-3daafd7be41b
5002024-04-03T10:08:02.072ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/01c49d73-3192-415f-8980-20cd04381a9e/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
5012024-04-03T10:08:02.073ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/65806d03-995e-4ce6-8ef1-b0fb41706a5a/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
5022024-04-03T10:08:02.073ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 9487266 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:62760 req_id = 388d987b-6da7-45b5-9486-09be250cdc15 response_code = 204 uri = /omicron-zones
5032024-04-03T10:08:02.074ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:545
5042024-04-03T10:08:02.086ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:381
5052024-04-03T10:08:02.086ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" }
5062024-04-03T10:08:02.086ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" }
5072024-04-03T10:08:02.086ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-M2" }
5082024-04-03T10:08:02.086ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" }
5092024-04-03T10:08:02.086ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" }
5102024-04-03T10:08:02.086ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" }
5112024-04-03T10:08:02.086ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2" }
5122024-04-03T10:08:02.086ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2" }
5132024-04-03T10:08:02.086ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-6", model: "synthetic-model-U2" }
5142024-04-03T10:08:02.086ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-7", model: "synthetic-model-U2" }
5152024-04-03T10:08:02.086ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-8", model: "synthetic-model-U2" }
5162024-04-03T10:08:02.123ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 51.565964ms) dns_config_addr = [fd00:1122:3344:1::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:1::1]:5353/config): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:565
5172024-04-03T10:08:02.175ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 150.256384ms) dns_config_addr = [fd00:1122:3344:1::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:1::1]:5353/config): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:565
5182024-04-03T10:08:02.343ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:545
5192024-04-03T10:08:02.392ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:545
5202024-04-03T10:08:02.438ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:581
5212024-04-03T10:08:02.438ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:258
5222024-04-03T10:08:02.470ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:275
5232024-04-03T10:08:02.470ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:300
5242024-04-03T10:08:02.470ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:192
5252024-04-03T10:08:02.499ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: 0e04e52c-490d-4b79-9cc6-e5adae4e5501, underlay_address: fd00:1122:3344:1::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 36614205-9374-49cf-8904-cb3f4aa78846, kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: c60e57f5-2712-45fb-af0b-bc0ff46e083c, underlay_address: fd00:1122:3344:2::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6b96699f-97d9-48d8-b1c0-05be5951e087, kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 586c70fe-6c95-438f-be65-3daafd7be41b, underlay_address: fd00:1122:3344:3::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5735529a-b898-4275-88a6-00a9444d8997, kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 54c5d8c0-1ab1-438b-8fc8-cf20c5890176, underlay_address: fd00:1122:3344:101::1b, zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: bb983f09-798b-4c43-a004-7d375876fd95, kind: Service { id: 54c5d8c0-1ab1-438b-8fc8-cf20c5890176 }, name: Name("ntp-54c5d8c0-1ab1-438b-8fc8-cf20c5890176"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 235, 216])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.3.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:427 sled_address = [fd00:1122:3344:101::1]:12345
5262024-04-03T10:08:02.499ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43306
5272024-04-03T10:08:02.499ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 0e04e52c-490d-4b79-9cc6-e5adae4e5501, dataset_name: DatasetName { pool_name: ZpoolName { id: 36614205-9374-49cf-8904-cb3f4aa78846, kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
5282024-04-03T10:08:02.499ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 0e04e52c-490d-4b79-9cc6-e5adae4e5501, dataset_name: DatasetName { pool_name: ZpoolName { id: 36614205-9374-49cf-8904-cb3f4aa78846, kind: External }, kind: InternalDns }, responder: ... }
5292024-04-03T10:08:02.519ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c60e57f5-2712-45fb-af0b-bc0ff46e083c, dataset_name: DatasetName { pool_name: ZpoolName { id: 6b96699f-97d9-48d8-b1c0-05be5951e087, kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
5302024-04-03T10:08:02.519ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: c60e57f5-2712-45fb-af0b-bc0ff46e083c, dataset_name: DatasetName { pool_name: ZpoolName { id: 6b96699f-97d9-48d8-b1c0-05be5951e087, kind: External }, kind: InternalDns }, responder: ... }
5312024-04-03T10:08:02.537ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 586c70fe-6c95-438f-be65-3daafd7be41b, dataset_name: DatasetName { pool_name: ZpoolName { id: 5735529a-b898-4275-88a6-00a9444d8997, kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
5322024-04-03T10:08:02.537ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 586c70fe-6c95-438f-be65-3daafd7be41b, dataset_name: DatasetName { pool_name: ZpoolName { id: 5735529a-b898-4275-88a6-00a9444d8997, kind: External }, kind: InternalDns }, responder: ... }
5332024-04-03T10:08:02.554ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
5342024-04-03T10:08:02.554ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/01c49d73-3192-415f-8980-20cd04381a9e/config/omicron-zones.json file = common/src/ledger.rs:177
5352024-04-03T10:08:02.555ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/65806d03-995e-4ce6-8ef1-b0fb41706a5a/config/omicron-zones.json file = common/src/ledger.rs:177
5362024-04-03T10:08:02.555ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
5372024-04-03T10:08:02.566ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:258
5382024-04-03T10:08:02.598ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:275
5392024-04-03T10:08:02.599ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:300
5402024-04-03T10:08:02.599ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:192
5412024-04-03T10:08:02.645ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:394 port = Port { inner: PortInner { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 235, 216]), slot: 0, vni: Vni { inner: 100 }, gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 }, vnic: "vopte0" } }
5422024-04-03T10:08:02.645ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1277 zone_type = ntp
5432024-04-03T10:08:02.645ZINFOSledAgent (ServiceManager): no nat entry found for: V4( Ipv4Network { addr: 10.151.1.169, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:102
5442024-04-03T10:08:02.645ZINFOSledAgent (ServiceManager): creating nat entry for: V4( Ipv4Network { addr: 10.151.1.169, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:109
5452024-04-03T10:08:02.646ZINFOSledAgent (ServiceManager): creation of nat entry successful for: V4( Ipv4Network { addr: 10.151.1.169, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:137
5462024-04-03T10:08:02.647ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
5472024-04-03T10:08:02.671ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_54c5d8c0-1ab1-438b-8fc8-cf20c5890176 file = illumos-utils/src/zone.rs:315
5482024-04-03T10:08:02.690ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_54c5d8c0-1ab1-438b-8fc8-cf20c5890176 file = illumos-utils/src/zone.rs:354
5492024-04-03T10:08:03.846ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_54c5d8c0-1ab1-438b-8fc8-cf20c5890176: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService4"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::1b"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value="fd00:1122:3344:100::/56"/> <propval type="boolean" name="boundary" value="true"/> <propval type="astring" name="server" value="0.pool.ntp.org"/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value="vopte0"/> <propval type="astring" name="gateway" value="172.30.3.1"/> <propval type="astring" name="ip" value="172.30.3.5"/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
5502024-04-03T10:08:03.846ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_ntp_54c5d8c0-1ab1-438b-8fc8-cf20c5890176
5512024-04-03T10:08:03.981ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_54c5d8c0-1ab1-438b-8fc8-cf20c5890176") failed: Property not found. retry in 49.33812ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_54c5d8c0-1ab1-438b-8fc8-cf20c5890176
5522024-04-03T10:08:04.039ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_54c5d8c0-1ab1-438b-8fc8-cf20c5890176") failed: Property not found. retry in 143.241753ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_54c5d8c0-1ab1-438b-8fc8-cf20c5890176
5532024-04-03T10:08:04.197ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_54c5d8c0-1ab1-438b-8fc8-cf20c5890176") failed: Property not found. retry in 180.715282ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_54c5d8c0-1ab1-438b-8fc8-cf20c5890176
5542024-04-03T10:08:04.388ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_54c5d8c0-1ab1-438b-8fc8-cf20c5890176") failed: Property not found. retry in 415.274719ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_54c5d8c0-1ab1-438b-8fc8-cf20c5890176
5552024-04-03T10:08:04.812ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_54c5d8c0-1ab1-438b-8fc8-cf20c5890176") failed: Property not found. retry in 435.345099ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_54c5d8c0-1ab1-438b-8fc8-cf20c5890176
5562024-04-03T10:08:05.258ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_54c5d8c0-1ab1-438b-8fc8-cf20c5890176") failed: Property not found. retry in 1.380045021s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_54c5d8c0-1ab1-438b-8fc8-cf20c5890176
5572024-04-03T10:08:05.336ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45511
5582024-04-03T10:08:05.337ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 720 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45511 req_id = f36eaa10-5b73-4ce5-a2ff-29a0c3cefb8f response_code = 200 uri = /baseboard
5592024-04-03T10:08:06.648ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_54c5d8c0-1ab1-438b-8fc8-cf20c5890176") failed: Property not found. retry in 995.384062ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_54c5d8c0-1ab1-438b-8fc8-cf20c5890176
5602024-04-03T10:08:06.785ZWARNSledAgent: failed to register as a metric producer with Nexus error = "Metric registration error: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/metrics/producers): error trying to connect: dns error: no record found for Query { name: Name(\\"_nexus._tcp.control-plane.oxide.internal.\\"), query_type: SRV, query_class: IN }" file = sled-agent/src/sled_agent.rs:1178 retry_after = 15.018760808s sled_id = aa5c4df3-cd22-4b16-be8c-4ae0b07c237e
5612024-04-03T10:08:07.652ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_54c5d8c0-1ab1-438b-8fc8-cf20c5890176") failed: Property not found. retry in 1.244263649s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_54c5d8c0-1ab1-438b-8fc8-cf20c5890176
5622024-04-03T10:08:08.916ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2997 zone = oxz_ntp_54c5d8c0-1ab1-438b-8fc8-cf20c5890176
5632024-04-03T10:08:08.916ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/01c49d73-3192-415f-8980-20cd04381a9e/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
5642024-04-03T10:08:08.917ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/65806d03-995e-4ce6-8ef1-b0fb41706a5a/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
5652024-04-03T10:08:08.917ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 6418162 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:43306 req_id = 92651668-898b-4d90-b125-5905937c5c49 response_code = 204 uri = /omicron-zones
5662024-04-03T10:08:08.919ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:622
5672024-04-03T10:08:08.948ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:602
5682024-04-03T10:08:08.948ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:65368
5692024-04-03T10:08:08.959ZINFOSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_54c5d8c0-1ab1-438b-8fc8-cf20c5890176': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3574
5702024-04-03T10:08:08.959ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:837 latency_us = 11227 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:65368 req_id = 44383f6c-b855-4bc3-813a-e7c7340862bd response_code = 500 uri = /timesync
5712024-04-03T10:08:08.961ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:652
5722024-04-03T10:08:09.048ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:602
5732024-04-03T10:08:09.049ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37211
5742024-04-03T10:08:11.058ZINFOSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_54c5d8c0-1ab1-438b-8fc8-cf20c5890176': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3574
5752024-04-03T10:08:11.058ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:837 latency_us = 2009174 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:37211 req_id = f8cae4c2-0644-494c-bdac-1eb2014a272c response_code = 500 uri = /timesync
5762024-04-03T10:08:11.060ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:652
5772024-04-03T10:08:11.153ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:602
5782024-04-03T10:08:11.153ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46723
5792024-04-03T10:08:11.162ZINFOSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_54c5d8c0-1ab1-438b-8fc8-cf20c5890176': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3574
5802024-04-03T10:08:11.162ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:837 latency_us = 9149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46723 req_id = 2266d93c-510b-40e3-9b5e-7708228103a9 response_code = 500 uri = /timesync
5812024-04-03T10:08:11.166ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:652
5822024-04-03T10:08:11.270ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:602
5832024-04-03T10:08:11.270ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38095
5842024-04-03T10:08:15.279ZINFOSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_54c5d8c0-1ab1-438b-8fc8-cf20c5890176': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3574
5852024-04-03T10:08:15.279ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:837 latency_us = 4009211 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:38095 req_id = 37eed24c-1865-4d8a-a3ac-b52b91ff7bf3 response_code = 500 uri = /timesync
5862024-04-03T10:08:15.282ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:652
5872024-04-03T10:08:15.407ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:602
5882024-04-03T10:08:15.407ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48199
5892024-04-03T10:08:15.415ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 7892 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:48199 req_id = 2e130808-8a13-41f1-821a-eb49d8616b36 response_code = 200 uri = /timesync
5902024-04-03T10:08:15.416ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1712138894.2422132, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:630
5912024-04-03T10:08:15.416ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:652
5922024-04-03T10:08:15.720ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:602
5932024-04-03T10:08:15.720ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53512
5942024-04-03T10:08:15.729ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 8153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:53512 req_id = 5ee2074c-6cb5-4956-a245-3bd61467ba64 response_code = 200 uri = /timesync
5952024-04-03T10:08:15.730ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1712138894.2422132, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:630
5962024-04-03T10:08:15.730ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:652
5972024-04-03T10:08:16.038ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:602
5982024-04-03T10:08:16.039ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55076
5992024-04-03T10:08:16.047ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 8505 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:55076 req_id = 43a87d5f-3b80-48e3-a6dc-34cfd6fb675e response_code = 200 uri = /timesync
6002024-04-03T10:08:16.050ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1712138894.2422132, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:630
6012024-04-03T10:08:16.050ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:652
6022024-04-03T10:08:16.370ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:602
6032024-04-03T10:08:16.370ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64346
6042024-04-03T10:08:16.377ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 7328 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:64346 req_id = d134c46c-2211-4f31-90e9-61312e1921c2 response_code = 200 uri = /timesync
6052024-04-03T10:08:16.379ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1712138894.2422132, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:630
6062024-04-03T10:08:16.379ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:652
6072024-04-03T10:08:16.944ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:602
6082024-04-03T10:08:16.944ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62578
6092024-04-03T10:08:16.952ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 8147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:62578 req_id = 2bb3c8cf-c9f6-4264-9417-b7678fa5c9c0 response_code = 200 uri = /timesync
6102024-04-03T10:08:16.954ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1712138894.2422132, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:630
6112024-04-03T10:08:16.954ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:652
6122024-04-03T10:08:17.403ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:602
6132024-04-03T10:08:17.403ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42364
6142024-04-03T10:08:17.412ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 8681 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42364 req_id = 74ec8967-945b-483b-a5a0-67e0a171a98a response_code = 200 uri = /timesync
6152024-04-03T10:08:17.413ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1712138894.2422132, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:630
6162024-04-03T10:08:17.413ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:652
6172024-04-03T10:08:17.717ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:602
6182024-04-03T10:08:17.717ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51087
6192024-04-03T10:08:17.727ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 9861 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:51087 req_id = a6adbc71-e1eb-499b-854d-909a9bc8c0e5 response_code = 200 uri = /timesync
6202024-04-03T10:08:17.729ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1712138894.2422132, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:630
6212024-04-03T10:08:17.729ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:652
6222024-04-03T10:08:18.545ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:602
6232024-04-03T10:08:18.545ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44055
6242024-04-03T10:08:18.553ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 7963 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:44055 req_id = 0c361bd2-9629-4b8e-9875-97ee0686d6f4 response_code = 200 uri = /timesync
6252024-04-03T10:08:18.556ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1712138894.2422132, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:630
6262024-04-03T10:08:18.556ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:652
6272024-04-03T10:08:19.588ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:602
6282024-04-03T10:08:19.588ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51858
6292024-04-03T10:08:19.596ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 7490 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:51858 req_id = fa2dba5e-bb6a-45a6-960e-ae1b5c58234f response_code = 200 uri = /timesync
6302024-04-03T10:08:19.598ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1712138894.2422132, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:630
6312024-04-03T10:08:19.598ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:652
6322024-04-03T10:08:20.444ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:602
6332024-04-03T10:08:20.444ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44251
6342024-04-03T10:08:20.463ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 19561 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:44251 req_id = 30eaae4c-c8a6-4055-8170-d20f6a358d5f response_code = 200 uri = /timesync
6352024-04-03T10:08:20.466ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 1163513799, ip_addr: 69.89.207.199, stratum: 2, ref_time: 1712138899.2606192, correction: -0.038620371 } file = sled-agent/src/rack_setup/service.rs:630
6362024-04-03T10:08:20.466ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1210
6372024-04-03T10:08:20.495ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 0e04e52c-490d-4b79-9cc6-e5adae4e5501, underlay_address: fd00:1122:3344:1::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 36614205-9374-49cf-8904-cb3f4aa78846, kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: c60e57f5-2712-45fb-af0b-bc0ff46e083c, underlay_address: fd00:1122:3344:2::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6b96699f-97d9-48d8-b1c0-05be5951e087, kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 586c70fe-6c95-438f-be65-3daafd7be41b, underlay_address: fd00:1122:3344:3::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5735529a-b898-4275-88a6-00a9444d8997, kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 54c5d8c0-1ab1-438b-8fc8-cf20c5890176, underlay_address: fd00:1122:3344:101::1b, zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: bb983f09-798b-4c43-a004-7d375876fd95, kind: Service { id: 54c5d8c0-1ab1-438b-8fc8-cf20c5890176 }, name: Name("ntp-54c5d8c0-1ab1-438b-8fc8-cf20c5890176"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 235, 216])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.3.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 11685285-c0ca-4aa1-9b75-f46dccb6d656, underlay_address: fd00:1122:3344:101::3, zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 36614205-9374-49cf-8904-cb3f4aa78846, kind: External } } } }, OmicronZoneConfig { id: ea8792b7-14fc-4019-98d6-831452c676ab, underlay_address: fd00:1122:3344:101::4, zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6b96699f-97d9-48d8-b1c0-05be5951e087, kind: External } } } }, OmicronZoneConfig { id: d57be767-d5bf-4ae1-a63a-e2d6e438bf64, underlay_address: fd00:1122:3344:101::5, zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5735529a-b898-4275-88a6-00a9444d8997, kind: External } } } }, OmicronZoneConfig { id: ebd15857-ca2c-4b36-b21c-496bb0330c21, underlay_address: fd00:1122:3344:101::6, zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 4533d42a-5c24-4d2c-8caa-2a74a63c16c3, kind: External } } } }, OmicronZoneConfig { id: 0a4a83f7-d6ae-4102-9eac-7ae6b9522ff8, underlay_address: fd00:1122:3344:101::7, zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 474bd740-7e4d-443a-9485-0c3e8b3716ec, kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:427 sled_address = [fd00:1122:3344:101::1]:12345
6382024-04-03T10:08:20.495ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59882
6392024-04-03T10:08:20.495ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 0e04e52c-490d-4b79-9cc6-e5adae4e5501, dataset_name: DatasetName { pool_name: ZpoolName { id: 36614205-9374-49cf-8904-cb3f4aa78846, kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
6402024-04-03T10:08:20.495ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 0e04e52c-490d-4b79-9cc6-e5adae4e5501, dataset_name: DatasetName { pool_name: ZpoolName { id: 36614205-9374-49cf-8904-cb3f4aa78846, kind: External }, kind: InternalDns }, responder: ... }
6412024-04-03T10:08:20.514ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c60e57f5-2712-45fb-af0b-bc0ff46e083c, dataset_name: DatasetName { pool_name: ZpoolName { id: 6b96699f-97d9-48d8-b1c0-05be5951e087, kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
6422024-04-03T10:08:20.514ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: c60e57f5-2712-45fb-af0b-bc0ff46e083c, dataset_name: DatasetName { pool_name: ZpoolName { id: 6b96699f-97d9-48d8-b1c0-05be5951e087, kind: External }, kind: InternalDns }, responder: ... }
6432024-04-03T10:08:20.533ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 586c70fe-6c95-438f-be65-3daafd7be41b, dataset_name: DatasetName { pool_name: ZpoolName { id: 5735529a-b898-4275-88a6-00a9444d8997, kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
6442024-04-03T10:08:20.533ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 586c70fe-6c95-438f-be65-3daafd7be41b, dataset_name: DatasetName { pool_name: ZpoolName { id: 5735529a-b898-4275-88a6-00a9444d8997, kind: External }, kind: InternalDns }, responder: ... }
6452024-04-03T10:08:20.551ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 11685285-c0ca-4aa1-9b75-f46dccb6d656, dataset_name: DatasetName { pool_name: ZpoolName { id: 36614205-9374-49cf-8904-cb3f4aa78846, kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
6462024-04-03T10:08:20.551ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 11685285-c0ca-4aa1-9b75-f46dccb6d656, dataset_name: DatasetName { pool_name: ZpoolName { id: 36614205-9374-49cf-8904-cb3f4aa78846, kind: External }, kind: CockroachDb }, responder: ... }
6472024-04-03T10:08:20.601ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: ea8792b7-14fc-4019-98d6-831452c676ab, dataset_name: DatasetName { pool_name: ZpoolName { id: 6b96699f-97d9-48d8-b1c0-05be5951e087, kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
6482024-04-03T10:08:20.601ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: ea8792b7-14fc-4019-98d6-831452c676ab, dataset_name: DatasetName { pool_name: ZpoolName { id: 6b96699f-97d9-48d8-b1c0-05be5951e087, kind: External }, kind: CockroachDb }, responder: ... }
6492024-04-03T10:08:20.655ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d57be767-d5bf-4ae1-a63a-e2d6e438bf64, dataset_name: DatasetName { pool_name: ZpoolName { id: 5735529a-b898-4275-88a6-00a9444d8997, kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
6502024-04-03T10:08:20.655ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: d57be767-d5bf-4ae1-a63a-e2d6e438bf64, dataset_name: DatasetName { pool_name: ZpoolName { id: 5735529a-b898-4275-88a6-00a9444d8997, kind: External }, kind: CockroachDb }, responder: ... }
6512024-04-03T10:08:20.705ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: ebd15857-ca2c-4b36-b21c-496bb0330c21, dataset_name: DatasetName { pool_name: ZpoolName { id: 4533d42a-5c24-4d2c-8caa-2a74a63c16c3, kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
6522024-04-03T10:08:20.705ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: ebd15857-ca2c-4b36-b21c-496bb0330c21, dataset_name: DatasetName { pool_name: ZpoolName { id: 4533d42a-5c24-4d2c-8caa-2a74a63c16c3, kind: External }, kind: CockroachDb }, responder: ... }
6532024-04-03T10:08:20.754ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 0a4a83f7-d6ae-4102-9eac-7ae6b9522ff8, dataset_name: DatasetName { pool_name: ZpoolName { id: 474bd740-7e4d-443a-9485-0c3e8b3716ec, kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
6542024-04-03T10:08:20.754ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 0a4a83f7-d6ae-4102-9eac-7ae6b9522ff8, dataset_name: DatasetName { pool_name: ZpoolName { id: 474bd740-7e4d-443a-9485-0c3e8b3716ec, kind: External }, kind: CockroachDb }, responder: ... }
6552024-04-03T10:08:20.806ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
6562024-04-03T10:08:20.806ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/01c49d73-3192-415f-8980-20cd04381a9e/config/omicron-zones.json file = common/src/ledger.rs:177
6572024-04-03T10:08:20.806ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/65806d03-995e-4ce6-8ef1-b0fb41706a5a/config/omicron-zones.json file = common/src/ledger.rs:177
6582024-04-03T10:08:20.806ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
6592024-04-03T10:08:20.891ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
6602024-04-03T10:08:20.891ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
6612024-04-03T10:08:20.891ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
6622024-04-03T10:08:20.891ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
6632024-04-03T10:08:20.891ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
6642024-04-03T10:08:20.977ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_11685285-c0ca-4aa1-9b75-f46dccb6d656 file = illumos-utils/src/zone.rs:315
6652024-04-03T10:08:20.981ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_ea8792b7-14fc-4019-98d6-831452c676ab file = illumos-utils/src/zone.rs:315
6662024-04-03T10:08:20.984ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_d57be767-d5bf-4ae1-a63a-e2d6e438bf64 file = illumos-utils/src/zone.rs:315
6672024-04-03T10:08:20.988ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_ebd15857-ca2c-4b36-b21c-496bb0330c21 file = illumos-utils/src/zone.rs:315
6682024-04-03T10:08:20.993ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_0a4a83f7-d6ae-4102-9eac-7ae6b9522ff8 file = illumos-utils/src/zone.rs:315
6692024-04-03T10:08:20.998ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_11685285-c0ca-4aa1-9b75-f46dccb6d656 file = illumos-utils/src/zone.rs:354
6702024-04-03T10:08:21.003ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_ea8792b7-14fc-4019-98d6-831452c676ab file = illumos-utils/src/zone.rs:354
6712024-04-03T10:08:21.007ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_d57be767-d5bf-4ae1-a63a-e2d6e438bf64 file = illumos-utils/src/zone.rs:354
6722024-04-03T10:08:21.012ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_ebd15857-ca2c-4b36-b21c-496bb0330c21 file = illumos-utils/src/zone.rs:354
6732024-04-03T10:08:21.016ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_0a4a83f7-d6ae-4102-9eac-7ae6b9522ff8 file = illumos-utils/src/zone.rs:354
6742024-04-03T10:08:24.597ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_ebd15857-ca2c-4b36-b21c-496bb0330c21: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService8"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::6"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::6"/> <propval type="astring" name="listen_port" value="32221"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:3::1" /> <value_node value="fd00:1122:3344:2::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6752024-04-03T10:08:24.597ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_cockroachdb_ebd15857-ca2c-4b36-b21c-496bb0330c21
6762024-04-03T10:08:24.603ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_ea8792b7-14fc-4019-98d6-831452c676ab: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService6"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::4"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::4"/> <propval type="astring" name="listen_port" value="32221"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:3::1" /> <value_node value="fd00:1122:3344:2::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6772024-04-03T10:08:24.603ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_cockroachdb_ea8792b7-14fc-4019-98d6-831452c676ab
6782024-04-03T10:08:24.612ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_d57be767-d5bf-4ae1-a63a-e2d6e438bf64: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService7"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::5"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::5"/> <propval type="astring" name="listen_port" value="32221"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:3::1" /> <value_node value="fd00:1122:3344:2::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6792024-04-03T10:08:24.612ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_cockroachdb_d57be767-d5bf-4ae1-a63a-e2d6e438bf64
6802024-04-03T10:08:24.671ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_0a4a83f7-d6ae-4102-9eac-7ae6b9522ff8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService9"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::7"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::7"/> <propval type="astring" name="listen_port" value="32221"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:3::1" /> <value_node value="fd00:1122:3344:2::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6812024-04-03T10:08:24.671ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_cockroachdb_0a4a83f7-d6ae-4102-9eac-7ae6b9522ff8
6822024-04-03T10:08:24.722ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_11685285-c0ca-4aa1-9b75-f46dccb6d656: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService5"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::3"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::3"/> <propval type="astring" name="listen_port" value="32221"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:3::1" /> <value_node value="fd00:1122:3344:2::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6832024-04-03T10:08:24.722ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_cockroachdb_11685285-c0ca-4aa1-9b75-f46dccb6d656
6842024-04-03T10:08:24.746ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ebd15857-ca2c-4b36-b21c-496bb0330c21") failed: Property not found. retry in 48.025058ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ebd15857-ca2c-4b36-b21c-496bb0330c21
6852024-04-03T10:08:24.754ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ea8792b7-14fc-4019-98d6-831452c676ab") failed: Property not found. retry in 72.589098ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ea8792b7-14fc-4019-98d6-831452c676ab
6862024-04-03T10:08:24.761ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d57be767-d5bf-4ae1-a63a-e2d6e438bf64") failed: Property not found. retry in 57.928174ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d57be767-d5bf-4ae1-a63a-e2d6e438bf64
6872024-04-03T10:08:24.803ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ebd15857-ca2c-4b36-b21c-496bb0330c21") failed: Property not found. retry in 53.420723ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ebd15857-ca2c-4b36-b21c-496bb0330c21
6882024-04-03T10:08:24.848ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0a4a83f7-d6ae-4102-9eac-7ae6b9522ff8") failed: Property not found. retry in 74.975373ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0a4a83f7-d6ae-4102-9eac-7ae6b9522ff8
6892024-04-03T10:08:24.920ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d57be767-d5bf-4ae1-a63a-e2d6e438bf64") failed: Property not found. retry in 133.696788ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d57be767-d5bf-4ae1-a63a-e2d6e438bf64
6902024-04-03T10:08:25.032ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ea8792b7-14fc-4019-98d6-831452c676ab") failed: Property not found. retry in 123.639879ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ea8792b7-14fc-4019-98d6-831452c676ab
6912024-04-03T10:08:25.101ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ebd15857-ca2c-4b36-b21c-496bb0330c21") failed: Property not found. retry in 222.186225ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ebd15857-ca2c-4b36-b21c-496bb0330c21
6922024-04-03T10:08:25.267ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0a4a83f7-d6ae-4102-9eac-7ae6b9522ff8") failed: Property not found. retry in 52.855088ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0a4a83f7-d6ae-4102-9eac-7ae6b9522ff8
6932024-04-03T10:08:25.699ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ea8792b7-14fc-4019-98d6-831452c676ab") failed: Property not found. retry in 268.327447ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ea8792b7-14fc-4019-98d6-831452c676ab
6942024-04-03T10:08:25.735ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d57be767-d5bf-4ae1-a63a-e2d6e438bf64") failed: Property not found. retry in 179.887265ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d57be767-d5bf-4ae1-a63a-e2d6e438bf64
6952024-04-03T10:08:25.758ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ebd15857-ca2c-4b36-b21c-496bb0330c21") failed: Property not found. retry in 546.24364ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ebd15857-ca2c-4b36-b21c-496bb0330c21
6962024-04-03T10:08:26.014ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0a4a83f7-d6ae-4102-9eac-7ae6b9522ff8") failed: Property not found. retry in 289.877992ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0a4a83f7-d6ae-4102-9eac-7ae6b9522ff8
6972024-04-03T10:08:26.158ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_11685285-c0ca-4aa1-9b75-f46dccb6d656") failed: Property not found. retry in 74.216106ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_11685285-c0ca-4aa1-9b75-f46dccb6d656
6982024-04-03T10:08:27.176ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ea8792b7-14fc-4019-98d6-831452c676ab") failed: Property not found. retry in 288.603492ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ea8792b7-14fc-4019-98d6-831452c676ab
6992024-04-03T10:08:27.210ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d57be767-d5bf-4ae1-a63a-e2d6e438bf64") failed: Property not found. retry in 334.663112ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d57be767-d5bf-4ae1-a63a-e2d6e438bf64
7002024-04-03T10:08:27.232ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ebd15857-ca2c-4b36-b21c-496bb0330c21") failed: Property not found. retry in 899.821039ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ebd15857-ca2c-4b36-b21c-496bb0330c21
7012024-04-03T10:08:27.255ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0a4a83f7-d6ae-4102-9eac-7ae6b9522ff8") failed: Property not found. retry in 318.394451ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0a4a83f7-d6ae-4102-9eac-7ae6b9522ff8
7022024-04-03T10:08:27.281ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_11685285-c0ca-4aa1-9b75-f46dccb6d656") failed: Property not found. retry in 108.73616ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_11685285-c0ca-4aa1-9b75-f46dccb6d656
7032024-04-03T10:08:27.400ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_11685285-c0ca-4aa1-9b75-f46dccb6d656") failed: Property not found. retry in 142.541283ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_11685285-c0ca-4aa1-9b75-f46dccb6d656
7042024-04-03T10:08:27.473ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ea8792b7-14fc-4019-98d6-831452c676ab") failed: Property not found. retry in 751.206041ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ea8792b7-14fc-4019-98d6-831452c676ab
7052024-04-03T10:08:27.554ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_11685285-c0ca-4aa1-9b75-f46dccb6d656") failed: Property not found. retry in 378.232283ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_11685285-c0ca-4aa1-9b75-f46dccb6d656
7062024-04-03T10:08:27.565ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d57be767-d5bf-4ae1-a63a-e2d6e438bf64") failed: Property not found. retry in 693.951683ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d57be767-d5bf-4ae1-a63a-e2d6e438bf64
7072024-04-03T10:08:27.583ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0a4a83f7-d6ae-4102-9eac-7ae6b9522ff8") failed: Property not found. retry in 763.768256ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0a4a83f7-d6ae-4102-9eac-7ae6b9522ff8
7082024-04-03T10:08:27.943ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_11685285-c0ca-4aa1-9b75-f46dccb6d656") failed: Property not found. retry in 637.665027ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_11685285-c0ca-4aa1-9b75-f46dccb6d656
7092024-04-03T10:08:28.139ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ebd15857-ca2c-4b36-b21c-496bb0330c21") failed: Property not found. retry in 1.287686068s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ebd15857-ca2c-4b36-b21c-496bb0330c21
7102024-04-03T10:08:28.232ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ea8792b7-14fc-4019-98d6-831452c676ab") failed: Property not found. retry in 864.149562ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ea8792b7-14fc-4019-98d6-831452c676ab
7112024-04-03T10:08:28.266ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d57be767-d5bf-4ae1-a63a-e2d6e438bf64") failed: Property not found. retry in 1.248941219s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d57be767-d5bf-4ae1-a63a-e2d6e438bf64
7122024-04-03T10:08:28.354ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0a4a83f7-d6ae-4102-9eac-7ae6b9522ff8") failed: Property not found. retry in 1.271122248s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0a4a83f7-d6ae-4102-9eac-7ae6b9522ff8
7132024-04-03T10:08:28.587ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_11685285-c0ca-4aa1-9b75-f46dccb6d656") failed: Property not found. retry in 603.820279ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_11685285-c0ca-4aa1-9b75-f46dccb6d656
7142024-04-03T10:08:29.102ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ea8792b7-14fc-4019-98d6-831452c676ab") failed: Property not found. retry in 1.195776446s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ea8792b7-14fc-4019-98d6-831452c676ab
7152024-04-03T10:08:29.200ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_11685285-c0ca-4aa1-9b75-f46dccb6d656") failed: Property not found. retry in 574.318398ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_11685285-c0ca-4aa1-9b75-f46dccb6d656
7162024-04-03T10:08:29.432ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ebd15857-ca2c-4b36-b21c-496bb0330c21") failed: Property not found. retry in 1.433419371s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ebd15857-ca2c-4b36-b21c-496bb0330c21
7172024-04-03T10:08:29.522ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d57be767-d5bf-4ae1-a63a-e2d6e438bf64") failed: Property not found. retry in 1.120687282s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d57be767-d5bf-4ae1-a63a-e2d6e438bf64
7182024-04-03T10:08:29.630ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0a4a83f7-d6ae-4102-9eac-7ae6b9522ff8") failed: Property not found. retry in 1.408689757s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0a4a83f7-d6ae-4102-9eac-7ae6b9522ff8
7192024-04-03T10:08:29.782ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_11685285-c0ca-4aa1-9b75-f46dccb6d656") failed: Property not found. retry in 1.492922228s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_11685285-c0ca-4aa1-9b75-f46dccb6d656
7202024-04-03T10:08:30.307ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ea8792b7-14fc-4019-98d6-831452c676ab") failed: Property not found. retry in 569.606669ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ea8792b7-14fc-4019-98d6-831452c676ab
7212024-04-03T10:08:30.653ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d57be767-d5bf-4ae1-a63a-e2d6e438bf64") failed: Property not found. retry in 1.075336226s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d57be767-d5bf-4ae1-a63a-e2d6e438bf64
7222024-04-03T10:08:30.871ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ebd15857-ca2c-4b36-b21c-496bb0330c21") failed: Property not found. retry in 715.192308ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ebd15857-ca2c-4b36-b21c-496bb0330c21
7232024-04-03T10:08:30.884ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ea8792b7-14fc-4019-98d6-831452c676ab") failed: Property not found. retry in 644.39405ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ea8792b7-14fc-4019-98d6-831452c676ab
7242024-04-03T10:08:31.045ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0a4a83f7-d6ae-4102-9eac-7ae6b9522ff8") failed: Property not found. retry in 1.436567553s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0a4a83f7-d6ae-4102-9eac-7ae6b9522ff8
7252024-04-03T10:08:31.280ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_11685285-c0ca-4aa1-9b75-f46dccb6d656") failed: Property not found. retry in 1.012745435s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_11685285-c0ca-4aa1-9b75-f46dccb6d656
7262024-04-03T10:08:31.534ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ea8792b7-14fc-4019-98d6-831452c676ab") failed: Property not found. retry in 621.190267ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ea8792b7-14fc-4019-98d6-831452c676ab
7272024-04-03T10:08:31.591ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ebd15857-ca2c-4b36-b21c-496bb0330c21") failed: Property not found. retry in 571.962042ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ebd15857-ca2c-4b36-b21c-496bb0330c21
7282024-04-03T10:08:31.734ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d57be767-d5bf-4ae1-a63a-e2d6e438bf64") failed: Property not found. retry in 510.347591ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d57be767-d5bf-4ae1-a63a-e2d6e438bf64
7292024-04-03T10:08:32.163ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ea8792b7-14fc-4019-98d6-831452c676ab") failed: Property not found. retry in 996.050379ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ea8792b7-14fc-4019-98d6-831452c676ab
7302024-04-03T10:08:32.173ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ebd15857-ca2c-4b36-b21c-496bb0330c21") failed: Property not found. retry in 1.271001099s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ebd15857-ca2c-4b36-b21c-496bb0330c21
7312024-04-03T10:08:32.253ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d57be767-d5bf-4ae1-a63a-e2d6e438bf64") failed: Property not found. retry in 957.178262ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d57be767-d5bf-4ae1-a63a-e2d6e438bf64
7322024-04-03T10:08:32.298ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_11685285-c0ca-4aa1-9b75-f46dccb6d656") failed: Property not found. retry in 736.256847ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_11685285-c0ca-4aa1-9b75-f46dccb6d656
7332024-04-03T10:08:32.488ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0a4a83f7-d6ae-4102-9eac-7ae6b9522ff8") failed: Property not found. retry in 720.895963ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0a4a83f7-d6ae-4102-9eac-7ae6b9522ff8
7342024-04-03T10:08:33.044ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_11685285-c0ca-4aa1-9b75-f46dccb6d656") failed: Property not found. retry in 659.957503ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_11685285-c0ca-4aa1-9b75-f46dccb6d656
7352024-04-03T10:08:33.167ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ea8792b7-14fc-4019-98d6-831452c676ab") failed: Property not found. retry in 1.199108731s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ea8792b7-14fc-4019-98d6-831452c676ab
7362024-04-03T10:08:33.216ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d57be767-d5bf-4ae1-a63a-e2d6e438bf64") failed: Property not found. retry in 512.509314ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d57be767-d5bf-4ae1-a63a-e2d6e438bf64
7372024-04-03T10:08:33.225ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0a4a83f7-d6ae-4102-9eac-7ae6b9522ff8") failed: Property not found. retry in 1.353349768s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0a4a83f7-d6ae-4102-9eac-7ae6b9522ff8
7382024-04-03T10:08:33.450ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ebd15857-ca2c-4b36-b21c-496bb0330c21") failed: Property not found. retry in 728.121964ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ebd15857-ca2c-4b36-b21c-496bb0330c21
7392024-04-03T10:08:34.597ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2997 zone = oxz_cockroachdb_11685285-c0ca-4aa1-9b75-f46dccb6d656
7402024-04-03T10:08:34.597ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2997 zone = oxz_cockroachdb_ea8792b7-14fc-4019-98d6-831452c676ab
7412024-04-03T10:08:34.597ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2997 zone = oxz_cockroachdb_d57be767-d5bf-4ae1-a63a-e2d6e438bf64
7422024-04-03T10:08:34.597ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2997 zone = oxz_cockroachdb_ebd15857-ca2c-4b36-b21c-496bb0330c21
7432024-04-03T10:08:34.597ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2997 zone = oxz_cockroachdb_0a4a83f7-d6ae-4102-9eac-7ae6b9522ff8
7442024-04-03T10:08:34.597ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/01c49d73-3192-415f-8980-20cd04381a9e/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7452024-04-03T10:08:34.597ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/65806d03-995e-4ce6-8ef1-b0fb41706a5a/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7462024-04-03T10:08:34.598ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 14139445 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:59882 req_id = 4ef917e5-82f3-4b1b-840e-9d035e7511b1 response_code = 204 uri = /omicron-zones
7472024-04-03T10:08:34.630ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51067
7482024-04-03T10:08:34.663ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService9/omicron6 in oxz_cockroachdb_0a4a83f7-d6ae-4102-9eac-7ae6b9522ff8: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_0a4a83f7-d6ae-4102-9eac-7ae6b9522ff8 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService9/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Address object not found file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:837 latency_us = 33164 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:51067 req_id = b908f588-666d-4f1b-adf8-f069d52f36c6 response_code = 500 uri = /cockroachdb
7492024-04-03T10:08:34.663ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "b908f588-666d-4f1b-adf8-f069d52f36c6", "content-length": "124", "date": "Wed, 03 Apr 2024 10:08:34 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "b908f588-666d-4f1b-adf8-f069d52f36c6" } file = sled-agent/src/rack_setup/service.rs:952 retry_after = 89.985103ms
7502024-04-03T10:08:34.787ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::7]:32221 file = sled-agent/src/services.rs:3408
7512024-04-03T10:08:57.332ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3426
7522024-04-03T10:09:08.162ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3449
7532024-04-03T10:09:08.163ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 33413844 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:51067 req_id = 4ae15371-b680-4f59-b70a-a53347355b53 response_code = 204 uri = /cockroachdb
7542024-04-03T10:09:08.165ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46416
7552024-04-03T10:09:08.214ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: 0e04e52c-490d-4b79-9cc6-e5adae4e5501, underlay_address: fd00:1122:3344:1::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 36614205-9374-49cf-8904-cb3f4aa78846, kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: c60e57f5-2712-45fb-af0b-bc0ff46e083c, underlay_address: fd00:1122:3344:2::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6b96699f-97d9-48d8-b1c0-05be5951e087, kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 586c70fe-6c95-438f-be65-3daafd7be41b, underlay_address: fd00:1122:3344:3::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5735529a-b898-4275-88a6-00a9444d8997, kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 54c5d8c0-1ab1-438b-8fc8-cf20c5890176, underlay_address: fd00:1122:3344:101::1b, zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: bb983f09-798b-4c43-a004-7d375876fd95, kind: Service { id: 54c5d8c0-1ab1-438b-8fc8-cf20c5890176 }, name: Name("ntp-54c5d8c0-1ab1-438b-8fc8-cf20c5890176"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 235, 216])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.3.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 11685285-c0ca-4aa1-9b75-f46dccb6d656, underlay_address: fd00:1122:3344:101::3, zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 36614205-9374-49cf-8904-cb3f4aa78846, kind: External } } } }, OmicronZoneConfig { id: ea8792b7-14fc-4019-98d6-831452c676ab, underlay_address: fd00:1122:3344:101::4, zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6b96699f-97d9-48d8-b1c0-05be5951e087, kind: External } } } }, OmicronZoneConfig { id: d57be767-d5bf-4ae1-a63a-e2d6e438bf64, underlay_address: fd00:1122:3344:101::5, zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5735529a-b898-4275-88a6-00a9444d8997, kind: External } } } }, OmicronZoneConfig { id: ebd15857-ca2c-4b36-b21c-496bb0330c21, underlay_address: fd00:1122:3344:101::6, zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 4533d42a-5c24-4d2c-8caa-2a74a63c16c3, kind: External } } } }, OmicronZoneConfig { id: 0a4a83f7-d6ae-4102-9eac-7ae6b9522ff8, underlay_address: fd00:1122:3344:101::7, zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 474bd740-7e4d-443a-9485-0c3e8b3716ec, kind: External } } } }, OmicronZoneConfig { id: 2fbdcbcd-ff1b-4375-856b-f7f3530b0e63, underlay_address: fd00:1122:3344:101::8, zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 36614205-9374-49cf-8904-cb3f4aa78846, kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.1.164:53, nic: NetworkInterface { id: ca540654-e6f9-4b30-91a7-31a69dccc214, kind: Service { id: 2fbdcbcd-ff1b-4375-856b-f7f3530b0e63 }, name: Name("external-dns-2fbdcbcd-ff1b-4375-856b-f7f3530b0e63"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 171, 128])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.1.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 } } }, OmicronZoneConfig { id: ad48337a-add3-4214-9d0f-f8db41e43622, underlay_address: fd00:1122:3344:101::9, zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6b96699f-97d9-48d8-b1c0-05be5951e087, kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.1.165:53, nic: NetworkInterface { id: 29c3cb1c-6a3c-4abd-8bb7-8bea59f6be3d, kind: Service { id: ad48337a-add3-4214-9d0f-f8db41e43622 }, name: Name("external-dns-ad48337a-add3-4214-9d0f-f8db41e43622"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 146])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.1.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 } } }, OmicronZoneConfig { id: c0f8db76-0c38-4867-b869-53c2384889d1, underlay_address: fd00:1122:3344:101::a, zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.1.166, nic: NetworkInterface { id: fd90c162-dbc9-42fc-9e1c-4bc8ada50b0d, kind: Service { id: c0f8db76-0c38-4867-b869-53c2384889d1 }, name: Name("nexus-c0f8db76-0c38-4867-b869-53c2384889d1"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 191])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: adc64792-b7f1-4498-a95d-8e860b5867bf, underlay_address: fd00:1122:3344:101::b, zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.1.167, nic: NetworkInterface { id: a247066b-a5a9-4604-ac40-d39a30123e5d, kind: Service { id: adc64792-b7f1-4498-a95d-8e860b5867bf }, name: Name("nexus-adc64792-b7f1-4498-a95d-8e860b5867bf"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 158])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: e35963e6-a05d-4aaa-a3e2-d78509c59004, underlay_address: fd00:1122:3344:101::c, zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.1.168, nic: NetworkInterface { id: e7200b46-4b53-4370-a961-3eb08273ac04, kind: Service { id: e35963e6-a05d-4aaa-a3e2-d78509c59004 }, name: Name("nexus-e35963e6-a05d-4aaa-a3e2-d78509c59004"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 252, 19])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: eff9cae2-d3de-4f90-b501-6553b5ad9c11, underlay_address: fd00:1122:3344:101::d, zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: 498d9e47-b1b3-4a91-a9ab-1b36877185b9, underlay_address: fd00:1122:3344:101::e, zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 36614205-9374-49cf-8904-cb3f4aa78846, kind: External } } } }, OmicronZoneConfig { id: 61c01227-a384-41a8-bc59-455062631a0d, underlay_address: fd00:1122:3344:101::f, zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: e26e39ef-02c9-4887-939e-4ec196eb3ce0, underlay_address: fd00:1122:3344:101::10, zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: 80bb8934-38d8-48bc-aa7e-eea4a490a555, underlay_address: fd00:1122:3344:101::11, zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: e53f8ac5-d09d-406d-9a03-3edf1a9aecce, underlay_address: fd00:1122:3344:101::12, zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 36614205-9374-49cf-8904-cb3f4aa78846, kind: External } } } }, OmicronZoneConfig { id: f8615f1a-8ae7-4cc1-96a8-b7e86d5a6767, underlay_address: fd00:1122:3344:101::13, zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6b96699f-97d9-48d8-b1c0-05be5951e087, kind: External } } } }, OmicronZoneConfig { id: c4d3bf20-ae50-40b6-af25-d9a472abc430, underlay_address: fd00:1122:3344:101::14, zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5735529a-b898-4275-88a6-00a9444d8997, kind: External } } } }, OmicronZoneConfig { id: 397924c0-2b87-42bd-adce-1a37f31bd063, underlay_address: fd00:1122:3344:101::15, zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 4533d42a-5c24-4d2c-8caa-2a74a63c16c3, kind: External } } } }, OmicronZoneConfig { id: df36c634-5f4d-4fe1-987c-2dbd6a1ad52a, underlay_address: fd00:1122:3344:101::16, zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 474bd740-7e4d-443a-9485-0c3e8b3716ec, kind: External } } } }, OmicronZoneConfig { id: a530ec6b-c8ab-4990-a9b9-f6bb7be02742, underlay_address: fd00:1122:3344:101::17, zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f14b76c3-7994-4bb4-962a-4f772a3dd8b9, kind: External } } } }, OmicronZoneConfig { id: da41d7a4-e925-4040-b523-178b3850bd7c, underlay_address: fd00:1122:3344:101::18, zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a0234d98-6d13-4518-a6ed-6616f80ec892, kind: External } } } }, OmicronZoneConfig { id: ddcb991a-c8a0-472d-a34d-1dcd46abb727, underlay_address: fd00:1122:3344:101::19, zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5df238e3-5630-4184-a188-36117b1a7b7b, kind: External } } } }, OmicronZoneConfig { id: c0d8975f-0e34-474b-a84c-10dd693605b9, underlay_address: fd00:1122:3344:101::1a, zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2e47e008-76df-41d9-b268-da990559f786, kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:427 sled_address = [fd00:1122:3344:101::1]:12345
7562024-04-03T10:09:08.215ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40271
7572024-04-03T10:09:08.217ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 0e04e52c-490d-4b79-9cc6-e5adae4e5501, dataset_name: DatasetName { pool_name: ZpoolName { id: 36614205-9374-49cf-8904-cb3f4aa78846, kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
7582024-04-03T10:09:08.217ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 0e04e52c-490d-4b79-9cc6-e5adae4e5501, dataset_name: DatasetName { pool_name: ZpoolName { id: 36614205-9374-49cf-8904-cb3f4aa78846, kind: External }, kind: InternalDns }, responder: ... }
7592024-04-03T10:09:08.241ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c60e57f5-2712-45fb-af0b-bc0ff46e083c, dataset_name: DatasetName { pool_name: ZpoolName { id: 6b96699f-97d9-48d8-b1c0-05be5951e087, kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
7602024-04-03T10:09:08.241ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: c60e57f5-2712-45fb-af0b-bc0ff46e083c, dataset_name: DatasetName { pool_name: ZpoolName { id: 6b96699f-97d9-48d8-b1c0-05be5951e087, kind: External }, kind: InternalDns }, responder: ... }
7612024-04-03T10:09:08.260ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 586c70fe-6c95-438f-be65-3daafd7be41b, dataset_name: DatasetName { pool_name: ZpoolName { id: 5735529a-b898-4275-88a6-00a9444d8997, kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
7622024-04-03T10:09:08.260ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 586c70fe-6c95-438f-be65-3daafd7be41b, dataset_name: DatasetName { pool_name: ZpoolName { id: 5735529a-b898-4275-88a6-00a9444d8997, kind: External }, kind: InternalDns }, responder: ... }
7632024-04-03T10:09:08.278ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 11685285-c0ca-4aa1-9b75-f46dccb6d656, dataset_name: DatasetName { pool_name: ZpoolName { id: 36614205-9374-49cf-8904-cb3f4aa78846, kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
7642024-04-03T10:09:08.278ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 11685285-c0ca-4aa1-9b75-f46dccb6d656, dataset_name: DatasetName { pool_name: ZpoolName { id: 36614205-9374-49cf-8904-cb3f4aa78846, kind: External }, kind: CockroachDb }, responder: ... }
7652024-04-03T10:09:08.295ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: ea8792b7-14fc-4019-98d6-831452c676ab, dataset_name: DatasetName { pool_name: ZpoolName { id: 6b96699f-97d9-48d8-b1c0-05be5951e087, kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
7662024-04-03T10:09:08.295ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: ea8792b7-14fc-4019-98d6-831452c676ab, dataset_name: DatasetName { pool_name: ZpoolName { id: 6b96699f-97d9-48d8-b1c0-05be5951e087, kind: External }, kind: CockroachDb }, responder: ... }
7672024-04-03T10:09:08.315ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d57be767-d5bf-4ae1-a63a-e2d6e438bf64, dataset_name: DatasetName { pool_name: ZpoolName { id: 5735529a-b898-4275-88a6-00a9444d8997, kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
7682024-04-03T10:09:08.315ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: d57be767-d5bf-4ae1-a63a-e2d6e438bf64, dataset_name: DatasetName { pool_name: ZpoolName { id: 5735529a-b898-4275-88a6-00a9444d8997, kind: External }, kind: CockroachDb }, responder: ... }
7692024-04-03T10:09:08.333ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: ebd15857-ca2c-4b36-b21c-496bb0330c21, dataset_name: DatasetName { pool_name: ZpoolName { id: 4533d42a-5c24-4d2c-8caa-2a74a63c16c3, kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
7702024-04-03T10:09:08.333ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: ebd15857-ca2c-4b36-b21c-496bb0330c21, dataset_name: DatasetName { pool_name: ZpoolName { id: 4533d42a-5c24-4d2c-8caa-2a74a63c16c3, kind: External }, kind: CockroachDb }, responder: ... }
7712024-04-03T10:09:08.352ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 0a4a83f7-d6ae-4102-9eac-7ae6b9522ff8, dataset_name: DatasetName { pool_name: ZpoolName { id: 474bd740-7e4d-443a-9485-0c3e8b3716ec, kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
7722024-04-03T10:09:08.352ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 0a4a83f7-d6ae-4102-9eac-7ae6b9522ff8, dataset_name: DatasetName { pool_name: ZpoolName { id: 474bd740-7e4d-443a-9485-0c3e8b3716ec, kind: External }, kind: CockroachDb }, responder: ... }
7732024-04-03T10:09:08.372ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 2fbdcbcd-ff1b-4375-856b-f7f3530b0e63, dataset_name: DatasetName { pool_name: ZpoolName { id: 36614205-9374-49cf-8904-cb3f4aa78846, kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
7742024-04-03T10:09:08.372ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 2fbdcbcd-ff1b-4375-856b-f7f3530b0e63, dataset_name: DatasetName { pool_name: ZpoolName { id: 36614205-9374-49cf-8904-cb3f4aa78846, kind: External }, kind: ExternalDns }, responder: ... }
7752024-04-03T10:09:08.467ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: ad48337a-add3-4214-9d0f-f8db41e43622, dataset_name: DatasetName { pool_name: ZpoolName { id: 6b96699f-97d9-48d8-b1c0-05be5951e087, kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
7762024-04-03T10:09:08.467ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: ad48337a-add3-4214-9d0f-f8db41e43622, dataset_name: DatasetName { pool_name: ZpoolName { id: 6b96699f-97d9-48d8-b1c0-05be5951e087, kind: External }, kind: ExternalDns }, responder: ... }
7772024-04-03T10:09:08.569ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 498d9e47-b1b3-4a91-a9ab-1b36877185b9, dataset_name: DatasetName { pool_name: ZpoolName { id: 36614205-9374-49cf-8904-cb3f4aa78846, kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:381
7782024-04-03T10:09:08.569ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 498d9e47-b1b3-4a91-a9ab-1b36877185b9, dataset_name: DatasetName { pool_name: ZpoolName { id: 36614205-9374-49cf-8904-cb3f4aa78846, kind: External }, kind: Clickhouse }, responder: ... }
7792024-04-03T10:09:08.680ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e53f8ac5-d09d-406d-9a03-3edf1a9aecce, dataset_name: DatasetName { pool_name: ZpoolName { id: 36614205-9374-49cf-8904-cb3f4aa78846, kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
7802024-04-03T10:09:08.680ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: e53f8ac5-d09d-406d-9a03-3edf1a9aecce, dataset_name: DatasetName { pool_name: ZpoolName { id: 36614205-9374-49cf-8904-cb3f4aa78846, kind: External }, kind: Crucible }, responder: ... }
7812024-04-03T10:09:08.764ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: f8615f1a-8ae7-4cc1-96a8-b7e86d5a6767, dataset_name: DatasetName { pool_name: ZpoolName { id: 6b96699f-97d9-48d8-b1c0-05be5951e087, kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
7822024-04-03T10:09:08.764ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: f8615f1a-8ae7-4cc1-96a8-b7e86d5a6767, dataset_name: DatasetName { pool_name: ZpoolName { id: 6b96699f-97d9-48d8-b1c0-05be5951e087, kind: External }, kind: Crucible }, responder: ... }
7832024-04-03T10:09:08.863ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c4d3bf20-ae50-40b6-af25-d9a472abc430, dataset_name: DatasetName { pool_name: ZpoolName { id: 5735529a-b898-4275-88a6-00a9444d8997, kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
7842024-04-03T10:09:08.864ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: c4d3bf20-ae50-40b6-af25-d9a472abc430, dataset_name: DatasetName { pool_name: ZpoolName { id: 5735529a-b898-4275-88a6-00a9444d8997, kind: External }, kind: Crucible }, responder: ... }
7852024-04-03T10:09:08.961ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 397924c0-2b87-42bd-adce-1a37f31bd063, dataset_name: DatasetName { pool_name: ZpoolName { id: 4533d42a-5c24-4d2c-8caa-2a74a63c16c3, kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
7862024-04-03T10:09:08.961ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 397924c0-2b87-42bd-adce-1a37f31bd063, dataset_name: DatasetName { pool_name: ZpoolName { id: 4533d42a-5c24-4d2c-8caa-2a74a63c16c3, kind: External }, kind: Crucible }, responder: ... }
7872024-04-03T10:09:09.065ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: df36c634-5f4d-4fe1-987c-2dbd6a1ad52a, dataset_name: DatasetName { pool_name: ZpoolName { id: 474bd740-7e4d-443a-9485-0c3e8b3716ec, kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
7882024-04-03T10:09:09.065ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: df36c634-5f4d-4fe1-987c-2dbd6a1ad52a, dataset_name: DatasetName { pool_name: ZpoolName { id: 474bd740-7e4d-443a-9485-0c3e8b3716ec, kind: External }, kind: Crucible }, responder: ... }
7892024-04-03T10:09:09.178ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: a530ec6b-c8ab-4990-a9b9-f6bb7be02742, dataset_name: DatasetName { pool_name: ZpoolName { id: f14b76c3-7994-4bb4-962a-4f772a3dd8b9, kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
7902024-04-03T10:09:09.178ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: a530ec6b-c8ab-4990-a9b9-f6bb7be02742, dataset_name: DatasetName { pool_name: ZpoolName { id: f14b76c3-7994-4bb4-962a-4f772a3dd8b9, kind: External }, kind: Crucible }, responder: ... }
7912024-04-03T10:09:09.259ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: da41d7a4-e925-4040-b523-178b3850bd7c, dataset_name: DatasetName { pool_name: ZpoolName { id: a0234d98-6d13-4518-a6ed-6616f80ec892, kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
7922024-04-03T10:09:09.259ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: da41d7a4-e925-4040-b523-178b3850bd7c, dataset_name: DatasetName { pool_name: ZpoolName { id: a0234d98-6d13-4518-a6ed-6616f80ec892, kind: External }, kind: Crucible }, responder: ... }
7932024-04-03T10:09:09.338ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: ddcb991a-c8a0-472d-a34d-1dcd46abb727, dataset_name: DatasetName { pool_name: ZpoolName { id: 5df238e3-5630-4184-a188-36117b1a7b7b, kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
7942024-04-03T10:09:09.338ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: ddcb991a-c8a0-472d-a34d-1dcd46abb727, dataset_name: DatasetName { pool_name: ZpoolName { id: 5df238e3-5630-4184-a188-36117b1a7b7b, kind: External }, kind: Crucible }, responder: ... }
7952024-04-03T10:09:09.417ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c0d8975f-0e34-474b-a84c-10dd693605b9, dataset_name: DatasetName { pool_name: ZpoolName { id: 2e47e008-76df-41d9-b268-da990559f786, kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
7962024-04-03T10:09:09.417ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: c0d8975f-0e34-474b-a84c-10dd693605b9, dataset_name: DatasetName { pool_name: ZpoolName { id: 2e47e008-76df-41d9-b268-da990559f786, kind: External }, kind: Crucible }, responder: ... }
7972024-04-03T10:09:09.494ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
7982024-04-03T10:09:09.494ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/01c49d73-3192-415f-8980-20cd04381a9e/config/omicron-zones.json file = common/src/ledger.rs:177
7992024-04-03T10:09:09.495ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/65806d03-995e-4ce6-8ef1-b0fb41706a5a/config/omicron-zones.json file = common/src/ledger.rs:177
8002024-04-03T10:09:09.495ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
8012024-04-03T10:09:09.652ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:258
8022024-04-03T10:09:09.653ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
8032024-04-03T10:09:09.653ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
8042024-04-03T10:09:09.653ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
8052024-04-03T10:09:09.653ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
8062024-04-03T10:09:09.653ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
8072024-04-03T10:09:09.687ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:258
8082024-04-03T10:09:09.687ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
8092024-04-03T10:09:09.687ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
8102024-04-03T10:09:09.688ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:258
8112024-04-03T10:09:09.873ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:258
8122024-04-03T10:09:09.873ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
8132024-04-03T10:09:09.873ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
8142024-04-03T10:09:09.873ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
8152024-04-03T10:09:09.873ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
8162024-04-03T10:09:09.873ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
8172024-04-03T10:09:09.873ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
8182024-04-03T10:09:09.886ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:258
8192024-04-03T10:09:09.886ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
8202024-04-03T10:09:09.887ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_df36c634-5f4d-4fe1-987c-2dbd6a1ad52a file = illumos-utils/src/zone.rs:315
8212024-04-03T10:09:09.892ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_80bb8934-38d8-48bc-aa7e-eea4a490a555 file = illumos-utils/src/zone.rs:315
8222024-04-03T10:09:09.897ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_c4d3bf20-ae50-40b6-af25-d9a472abc430 file = illumos-utils/src/zone.rs:315
8232024-04-03T10:09:09.902ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_da41d7a4-e925-4040-b523-178b3850bd7c file = illumos-utils/src/zone.rs:315
8242024-04-03T10:09:09.908ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_a530ec6b-c8ab-4990-a9b9-f6bb7be02742 file = illumos-utils/src/zone.rs:315
8252024-04-03T10:09:09.914ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_ddcb991a-c8a0-472d-a34d-1dcd46abb727 file = illumos-utils/src/zone.rs:315
8262024-04-03T10:09:09.918ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_c0d8975f-0e34-474b-a84c-10dd693605b9 file = illumos-utils/src/zone.rs:315
8272024-04-03T10:09:10.056ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_df36c634-5f4d-4fe1-987c-2dbd6a1ad52a file = illumos-utils/src/zone.rs:354
8282024-04-03T10:09:10.062ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_80bb8934-38d8-48bc-aa7e-eea4a490a555 file = illumos-utils/src/zone.rs:354
8292024-04-03T10:09:10.068ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_c4d3bf20-ae50-40b6-af25-d9a472abc430 file = illumos-utils/src/zone.rs:354
8302024-04-03T10:09:10.072ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_da41d7a4-e925-4040-b523-178b3850bd7c file = illumos-utils/src/zone.rs:354
8312024-04-03T10:09:10.077ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_a530ec6b-c8ab-4990-a9b9-f6bb7be02742 file = illumos-utils/src/zone.rs:354
8322024-04-03T10:09:10.082ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_ddcb991a-c8a0-472d-a34d-1dcd46abb727 file = illumos-utils/src/zone.rs:354
8332024-04-03T10:09:10.087ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_c0d8975f-0e34-474b-a84c-10dd693605b9 file = illumos-utils/src/zone.rs:354
8342024-04-03T10:09:10.093ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_eff9cae2-d3de-4f90-b501-6553b5ad9c11 file = illumos-utils/src/zone.rs:315
8352024-04-03T10:09:10.099ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_498d9e47-b1b3-4a91-a9ab-1b36877185b9 file = illumos-utils/src/zone.rs:315
8362024-04-03T10:09:10.106ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_61c01227-a384-41a8-bc59-455062631a0d file = illumos-utils/src/zone.rs:315
8372024-04-03T10:09:10.112ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_e26e39ef-02c9-4887-939e-4ec196eb3ce0 file = illumos-utils/src/zone.rs:315
8382024-04-03T10:09:10.117ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_e53f8ac5-d09d-406d-9a03-3edf1a9aecce file = illumos-utils/src/zone.rs:315
8392024-04-03T10:09:10.123ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_f8615f1a-8ae7-4cc1-96a8-b7e86d5a6767 file = illumos-utils/src/zone.rs:315
8402024-04-03T10:09:10.129ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_397924c0-2b87-42bd-adce-1a37f31bd063 file = illumos-utils/src/zone.rs:315
8412024-04-03T10:09:10.172ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:275
8422024-04-03T10:09:10.173ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_eff9cae2-d3de-4f90-b501-6553b5ad9c11 file = illumos-utils/src/zone.rs:354
8432024-04-03T10:09:10.179ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_498d9e47-b1b3-4a91-a9ab-1b36877185b9 file = illumos-utils/src/zone.rs:354
8442024-04-03T10:09:10.184ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_61c01227-a384-41a8-bc59-455062631a0d file = illumos-utils/src/zone.rs:354
8452024-04-03T10:09:10.189ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_e26e39ef-02c9-4887-939e-4ec196eb3ce0 file = illumos-utils/src/zone.rs:354
8462024-04-03T10:09:10.193ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_e53f8ac5-d09d-406d-9a03-3edf1a9aecce file = illumos-utils/src/zone.rs:354
8472024-04-03T10:09:10.198ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_f8615f1a-8ae7-4cc1-96a8-b7e86d5a6767 file = illumos-utils/src/zone.rs:354
8482024-04-03T10:09:10.204ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_397924c0-2b87-42bd-adce-1a37f31bd063 file = illumos-utils/src/zone.rs:354
8492024-04-03T10:09:10.252ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:275
8502024-04-03T10:09:10.288ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:275
8512024-04-03T10:09:10.327ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:275
8522024-04-03T10:09:10.366ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:275
8532024-04-03T10:09:10.369ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:300
8542024-04-03T10:09:10.369ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:192
8552024-04-03T10:09:10.433ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:394 port = Port { inner: PortInner { name: "opte1", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 233, 158]), slot: 0, vni: Vni { inner: 100 }, gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 }, vnic: "vopte1" } }
8562024-04-03T10:09:10.434ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1277 zone_type = nexus
8572024-04-03T10:09:10.437ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:300
8582024-04-03T10:09:10.437ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:192
8592024-04-03T10:09:10.498ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:394 port = Port { inner: PortInner { name: "opte2", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 252, 19]), slot: 0, vni: Vni { inner: 100 }, gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 }, vnic: "vopte2" } }
8602024-04-03T10:09:10.498ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1277 zone_type = nexus
8612024-04-03T10:09:10.501ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:300
8622024-04-03T10:09:10.501ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:192
8632024-04-03T10:09:10.564ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:394 port = Port { inner: PortInner { name: "opte3", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 171, 128]), slot: 0, vni: Vni { inner: 100 }, gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 }, vnic: "vopte3" } }
8642024-04-03T10:09:10.564ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1277 zone_type = external_dns
8652024-04-03T10:09:10.567ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:300
8662024-04-03T10:09:10.567ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:192
8672024-04-03T10:09:10.624ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:394 port = Port { inner: PortInner { name: "opte4", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 128, 191]), slot: 0, vni: Vni { inner: 100 }, gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 }, vnic: "vopte4" } }
8682024-04-03T10:09:10.624ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1277 zone_type = nexus
8692024-04-03T10:09:10.627ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:300
8702024-04-03T10:09:10.627ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:192
8712024-04-03T10:09:10.679ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:394 port = Port { inner: PortInner { name: "opte5", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 202, 146]), slot: 0, vni: Vni { inner: 100 }, gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 }, vnic: "vopte5" } }
8722024-04-03T10:09:10.679ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1277 zone_type = external_dns
8732024-04-03T10:09:10.680ZINFOSledAgent (ServiceManager): no nat entry found for: V4( Ipv4Network { addr: 10.151.1.167, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:102
8742024-04-03T10:09:10.680ZINFOSledAgent (ServiceManager): creating nat entry for: V4( Ipv4Network { addr: 10.151.1.167, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:109
8752024-04-03T10:09:10.681ZINFOSledAgent (ServiceManager): no nat entry found for: V4( Ipv4Network { addr: 10.151.1.168, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:102
8762024-04-03T10:09:10.681ZINFOSledAgent (ServiceManager): creating nat entry for: V4( Ipv4Network { addr: 10.151.1.168, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:109
8772024-04-03T10:09:10.681ZINFOSledAgent (ServiceManager): no nat entry found for: V4( Ipv4Network { addr: 10.151.1.164, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:102
8782024-04-03T10:09:10.681ZINFOSledAgent (ServiceManager): creating nat entry for: V4( Ipv4Network { addr: 10.151.1.164, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:109
8792024-04-03T10:09:10.681ZINFOSledAgent (ServiceManager): no nat entry found for: V4( Ipv4Network { addr: 10.151.1.165, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:102
8802024-04-03T10:09:10.681ZINFOSledAgent (ServiceManager): creating nat entry for: V4( Ipv4Network { addr: 10.151.1.165, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:109
8812024-04-03T10:09:10.681ZINFOSledAgent (ServiceManager): no nat entry found for: V4( Ipv4Network { addr: 10.151.1.166, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:102
8822024-04-03T10:09:10.681ZINFOSledAgent (ServiceManager): creating nat entry for: V4( Ipv4Network { addr: 10.151.1.166, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:109
8832024-04-03T10:09:10.685ZINFOSledAgent (ServiceManager): creation of nat entry successful for: V4( Ipv4Network { addr: 10.151.1.167, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:137
8842024-04-03T10:09:10.687ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
8852024-04-03T10:09:10.687ZINFOSledAgent (ServiceManager): creation of nat entry successful for: V4( Ipv4Network { addr: 10.151.1.168, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:137
8862024-04-03T10:09:10.690ZINFOSledAgent (ServiceManager): creation of nat entry successful for: V4( Ipv4Network { addr: 10.151.1.164, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:137
8872024-04-03T10:09:10.690ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
8882024-04-03T10:09:10.692ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
8892024-04-03T10:09:10.718ZINFOSledAgent (ServiceManager): creation of nat entry successful for: V4( Ipv4Network { addr: 10.151.1.165, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:137
8902024-04-03T10:09:10.722ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
8912024-04-03T10:09:10.722ZINFOSledAgent (ServiceManager): creation of nat entry successful for: V4( Ipv4Network { addr: 10.151.1.166, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:137
8922024-04-03T10:09:10.724ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
8932024-04-03T10:09:10.776ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_adc64792-b7f1-4498-a95d-8e860b5867bf file = illumos-utils/src/zone.rs:315
8942024-04-03T10:09:10.839ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_e35963e6-a05d-4aaa-a3e2-d78509c59004 file = illumos-utils/src/zone.rs:315
8952024-04-03T10:09:10.846ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_2fbdcbcd-ff1b-4375-856b-f7f3530b0e63 file = illumos-utils/src/zone.rs:315
8962024-04-03T10:09:10.852ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_adc64792-b7f1-4498-a95d-8e860b5867bf file = illumos-utils/src/zone.rs:354
8972024-04-03T10:09:10.858ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_ad48337a-add3-4214-9d0f-f8db41e43622 file = illumos-utils/src/zone.rs:315
8982024-04-03T10:09:10.866ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_c0f8db76-0c38-4867-b869-53c2384889d1 file = illumos-utils/src/zone.rs:315
8992024-04-03T10:09:10.873ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_e35963e6-a05d-4aaa-a3e2-d78509c59004 file = illumos-utils/src/zone.rs:354
9002024-04-03T10:09:10.880ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_2fbdcbcd-ff1b-4375-856b-f7f3530b0e63 file = illumos-utils/src/zone.rs:354
9012024-04-03T10:09:10.892ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_ad48337a-add3-4214-9d0f-f8db41e43622 file = illumos-utils/src/zone.rs:354
9022024-04-03T10:09:10.905ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_c0f8db76-0c38-4867-b869-53c2384889d1 file = illumos-utils/src/zone.rs:354
9032024-04-03T10:09:23.292ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_da41d7a4-e925-4040-b523-178b3850bd7c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService13"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::18"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_a0234d98-6d13-4518-a6ed-6616f80ec892/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::18"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="b5f23000-551f-470f-ba25-6a2f4cb785b8"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9042024-04-03T10:09:23.349ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_ddcb991a-c8a0-472d-a34d-1dcd46abb727: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService15"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::19"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_5df238e3-5630-4184-a188-36117b1a7b7b/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::19"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="710c30cd-e91c-4327-8886-cc04c030ac09"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9052024-04-03T10:09:23.350ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_e53f8ac5-d09d-406d-9a03-3edf1a9aecce: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService21"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::12"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_36614205-9374-49cf-8904-cb3f4aa78846/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::12"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="6953cbe9-4289-492d-b0d2-c5d6d0bd6c57"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9062024-04-03T10:09:23.354ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_397924c0-2b87-42bd-adce-1a37f31bd063: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService23"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::15"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_4533d42a-5c24-4d2c-8caa-2a74a63c16c3/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::15"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="152bc608-7d74-4969-9735-a716535bf331"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9072024-04-03T10:09:23.355ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_da41d7a4-e925-4040-b523-178b3850bd7c
9082024-04-03T10:09:23.400ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_ddcb991a-c8a0-472d-a34d-1dcd46abb727
9092024-04-03T10:09:23.432ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_c0d8975f-0e34-474b-a84c-10dd693605b9: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService16"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::1a"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_2e47e008-76df-41d9-b268-da990559f786/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::1a"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="c68a37ba-716f-4df8-8887-f31950822b53"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9102024-04-03T10:09:23.433ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_61c01227-a384-41a8-bc59-455062631a0d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService19"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::f"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::f"/> <propval type="astring" name="listen_port" value="17000"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9112024-04-03T10:09:23.468ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_e26e39ef-02c9-4887-939e-4ec196eb3ce0: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService20"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::10"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::10"/> <propval type="astring" name="listen_port" value="17000"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9122024-04-03T10:09:23.468ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_e53f8ac5-d09d-406d-9a03-3edf1a9aecce
9132024-04-03T10:09:23.476ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_f8615f1a-8ae7-4cc1-96a8-b7e86d5a6767: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService22"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::13"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_6b96699f-97d9-48d8-b1c0-05be5951e087/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::13"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="c51299a6-f376-4711-8719-5d0600cb74eb"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9142024-04-03T10:09:23.476ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_397924c0-2b87-42bd-adce-1a37f31bd063
9152024-04-03T10:09:23.523ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_df36c634-5f4d-4fe1-987c-2dbd6a1ad52a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService10"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::16"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_474bd740-7e4d-443a-9485-0c3e8b3716ec/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::16"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="d00cd38f-c170-446a-911c-224c02f9fd06"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9162024-04-03T10:09:23.523ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_80bb8934-38d8-48bc-aa7e-eea4a490a555: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService11"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::11"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::11"/> <propval type="astring" name="listen_port" value="17000"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9172024-04-03T10:09:23.528ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_c4d3bf20-ae50-40b6-af25-d9a472abc430: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService12"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::14"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_5735529a-b898-4275-88a6-00a9444d8997/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::14"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="43f8c906-3918-4859-ac66-886310115584"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9182024-04-03T10:09:23.528ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_a530ec6b-c8ab-4990-a9b9-f6bb7be02742: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService14"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::17"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_f14b76c3-7994-4bb4-962a-4f772a3dd8b9/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::17"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="acaf3d4a-79e4-449c-85fc-66822ce9d025"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9192024-04-03T10:09:23.528ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_c0d8975f-0e34-474b-a84c-10dd693605b9
9202024-04-03T10:09:23.566ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_2fbdcbcd-ff1b-4375-856b-f7f3530b0e63: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService26"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::8"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value="vopte3"/> <propval type="astring" name="gateway" value="172.30.1.1"/> <propval type="astring" name="ip" value="172.30.1.5"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value="[fd00:1122:3344:101::8]:5353"/> <propval type="astring" name="dns_address" value="172.30.1.5:53"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9212024-04-03T10:09:23.588ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_pantry_61c01227-a384-41a8-bc59-455062631a0d
9222024-04-03T10:09:23.591ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_pantry_e26e39ef-02c9-4887-939e-4ec196eb3ce0
9232024-04-03T10:09:23.624ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_f8615f1a-8ae7-4cc1-96a8-b7e86d5a6767
9242024-04-03T10:09:23.664ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_ad48337a-add3-4214-9d0f-f8db41e43622: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService27"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::9"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value="vopte5"/> <propval type="astring" name="gateway" value="172.30.1.1"/> <propval type="astring" name="ip" value="172.30.1.6"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value="[fd00:1122:3344:101::9]:5353"/> <propval type="astring" name="dns_address" value="172.30.1.6:53"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9252024-04-03T10:09:23.664ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_df36c634-5f4d-4fe1-987c-2dbd6a1ad52a
9262024-04-03T10:09:23.680ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_pantry_80bb8934-38d8-48bc-aa7e-eea4a490a555
9272024-04-03T10:09:23.701ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_c4d3bf20-ae50-40b6-af25-d9a472abc430
9282024-04-03T10:09:23.739ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_a530ec6b-c8ab-4990-a9b9-f6bb7be02742
9292024-04-03T10:09:23.767ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_external_dns_2fbdcbcd-ff1b-4375-856b-f7f3530b0e63
9302024-04-03T10:09:23.792ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_external_dns_ad48337a-add3-4214-9d0f-f8db41e43622
9312024-04-03T10:09:24.155ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_df36c634-5f4d-4fe1-987c-2dbd6a1ad52a") failed: Property not found. retry in 65.649206ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_df36c634-5f4d-4fe1-987c-2dbd6a1ad52a
9322024-04-03T10:09:24.166ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e53f8ac5-d09d-406d-9a03-3edf1a9aecce") failed: Property not found. retry in 25.888215ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e53f8ac5-d09d-406d-9a03-3edf1a9aecce
9332024-04-03T10:09:24.178ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_80bb8934-38d8-48bc-aa7e-eea4a490a555") failed: Property not found. retry in 38.671424ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_80bb8934-38d8-48bc-aa7e-eea4a490a555
9342024-04-03T10:09:24.189ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c4d3bf20-ae50-40b6-af25-d9a472abc430") failed: Property not found. retry in 70.590164ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c4d3bf20-ae50-40b6-af25-d9a472abc430
9352024-04-03T10:09:24.199ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_da41d7a4-e925-4040-b523-178b3850bd7c") failed: Property not found. retry in 48.693224ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_da41d7a4-e925-4040-b523-178b3850bd7c
9362024-04-03T10:09:24.209ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a530ec6b-c8ab-4990-a9b9-f6bb7be02742") failed: Property not found. retry in 25.003011ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a530ec6b-c8ab-4990-a9b9-f6bb7be02742
9372024-04-03T10:09:24.219ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ddcb991a-c8a0-472d-a34d-1dcd46abb727") failed: Property not found. retry in 32.280266ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ddcb991a-c8a0-472d-a34d-1dcd46abb727
9382024-04-03T10:09:24.230ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c0d8975f-0e34-474b-a84c-10dd693605b9") failed: Property not found. retry in 44.395758ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c0d8975f-0e34-474b-a84c-10dd693605b9
9392024-04-03T10:09:24.240ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_2fbdcbcd-ff1b-4375-856b-f7f3530b0e63") failed: Property not found. retry in 56.079889ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_2fbdcbcd-ff1b-4375-856b-f7f3530b0e63
9402024-04-03T10:09:24.241ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_eff9cae2-d3de-4f90-b501-6553b5ad9c11: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService17"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::d"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value="eff9cae2-d3de-4f90-b501-6553b5ad9c11"/> <propval type="astring" name="address" value="[fd00:1122:3344:101::d]:12223"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9412024-04-03T10:09:24.253ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_61c01227-a384-41a8-bc59-455062631a0d") failed: Property not found. retry in 58.726283ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_61c01227-a384-41a8-bc59-455062631a0d
9422024-04-03T10:09:24.265ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e26e39ef-02c9-4887-939e-4ec196eb3ce0") failed: Property not found. retry in 44.114669ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e26e39ef-02c9-4887-939e-4ec196eb3ce0
9432024-04-03T10:09:24.278ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e53f8ac5-d09d-406d-9a03-3edf1a9aecce") failed: Property not found. retry in 102.755437ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e53f8ac5-d09d-406d-9a03-3edf1a9aecce
9442024-04-03T10:09:24.289ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f8615f1a-8ae7-4cc1-96a8-b7e86d5a6767") failed: Property not found. retry in 45.186552ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f8615f1a-8ae7-4cc1-96a8-b7e86d5a6767
9452024-04-03T10:09:24.302ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ad48337a-add3-4214-9d0f-f8db41e43622") failed: Property not found. retry in 69.647488ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ad48337a-add3-4214-9d0f-f8db41e43622
9462024-04-03T10:09:24.315ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_397924c0-2b87-42bd-adce-1a37f31bd063") failed: Property not found. retry in 62.458981ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_397924c0-2b87-42bd-adce-1a37f31bd063
9472024-04-03T10:09:24.326ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_df36c634-5f4d-4fe1-987c-2dbd6a1ad52a") failed: Property not found. retry in 83.794266ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_df36c634-5f4d-4fe1-987c-2dbd6a1ad52a
9482024-04-03T10:09:24.337ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_80bb8934-38d8-48bc-aa7e-eea4a490a555") failed: Property not found. retry in 132.160107ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_80bb8934-38d8-48bc-aa7e-eea4a490a555
9492024-04-03T10:09:24.347ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c4d3bf20-ae50-40b6-af25-d9a472abc430") failed: Property not found. retry in 72.798428ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c4d3bf20-ae50-40b6-af25-d9a472abc430
9502024-04-03T10:09:24.360ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_da41d7a4-e925-4040-b523-178b3850bd7c") failed: Property not found. retry in 55.053925ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_da41d7a4-e925-4040-b523-178b3850bd7c
9512024-04-03T10:09:24.372ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a530ec6b-c8ab-4990-a9b9-f6bb7be02742") failed: Property not found. retry in 72.358435ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a530ec6b-c8ab-4990-a9b9-f6bb7be02742
9522024-04-03T10:09:24.388ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ddcb991a-c8a0-472d-a34d-1dcd46abb727") failed: Property not found. retry in 107.895025ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ddcb991a-c8a0-472d-a34d-1dcd46abb727
9532024-04-03T10:09:24.400ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c0d8975f-0e34-474b-a84c-10dd693605b9") failed: Property not found. retry in 121.151314ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c0d8975f-0e34-474b-a84c-10dd693605b9
9542024-04-03T10:09:24.417ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_2fbdcbcd-ff1b-4375-856b-f7f3530b0e63") failed: Property not found. retry in 103.729214ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_2fbdcbcd-ff1b-4375-856b-f7f3530b0e63
9552024-04-03T10:09:24.417ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_oximeter_eff9cae2-d3de-4f90-b501-6553b5ad9c11
9562024-04-03T10:09:24.445ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_61c01227-a384-41a8-bc59-455062631a0d") failed: Property not found. retry in 98.247528ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_61c01227-a384-41a8-bc59-455062631a0d
9572024-04-03T10:09:24.461ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e26e39ef-02c9-4887-939e-4ec196eb3ce0") failed: Property not found. retry in 82.794963ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e26e39ef-02c9-4887-939e-4ec196eb3ce0
9582024-04-03T10:09:24.477ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e53f8ac5-d09d-406d-9a03-3edf1a9aecce") failed: Property not found. retry in 279.797606ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e53f8ac5-d09d-406d-9a03-3edf1a9aecce
9592024-04-03T10:09:24.494ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f8615f1a-8ae7-4cc1-96a8-b7e86d5a6767") failed: Property not found. retry in 113.787508ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f8615f1a-8ae7-4cc1-96a8-b7e86d5a6767
9602024-04-03T10:09:24.511ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ad48337a-add3-4214-9d0f-f8db41e43622") failed: Property not found. retry in 60.741488ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ad48337a-add3-4214-9d0f-f8db41e43622
9612024-04-03T10:09:24.528ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_397924c0-2b87-42bd-adce-1a37f31bd063") failed: Property not found. retry in 58.010976ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_397924c0-2b87-42bd-adce-1a37f31bd063
9622024-04-03T10:09:24.545ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_df36c634-5f4d-4fe1-987c-2dbd6a1ad52a") failed: Property not found. retry in 159.49046ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_df36c634-5f4d-4fe1-987c-2dbd6a1ad52a
9632024-04-03T10:09:24.561ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_80bb8934-38d8-48bc-aa7e-eea4a490a555") failed: Property not found. retry in 218.947603ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_80bb8934-38d8-48bc-aa7e-eea4a490a555
9642024-04-03T10:09:24.578ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c4d3bf20-ae50-40b6-af25-d9a472abc430") failed: Property not found. retry in 103.590732ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c4d3bf20-ae50-40b6-af25-d9a472abc430
9652024-04-03T10:09:24.594ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_da41d7a4-e925-4040-b523-178b3850bd7c") failed: Property not found. retry in 170.364981ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_da41d7a4-e925-4040-b523-178b3850bd7c
9662024-04-03T10:09:24.610ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a530ec6b-c8ab-4990-a9b9-f6bb7be02742") failed: Property not found. retry in 121.288023ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a530ec6b-c8ab-4990-a9b9-f6bb7be02742
9672024-04-03T10:09:24.625ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ddcb991a-c8a0-472d-a34d-1dcd46abb727") failed: Property not found. retry in 172.495249ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ddcb991a-c8a0-472d-a34d-1dcd46abb727
9682024-04-03T10:09:24.641ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c0d8975f-0e34-474b-a84c-10dd693605b9") failed: Property not found. retry in 198.228558ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c0d8975f-0e34-474b-a84c-10dd693605b9
9692024-04-03T10:09:24.656ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_2fbdcbcd-ff1b-4375-856b-f7f3530b0e63") failed: Property not found. retry in 269.114241ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_2fbdcbcd-ff1b-4375-856b-f7f3530b0e63
9702024-04-03T10:09:24.671ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_61c01227-a384-41a8-bc59-455062631a0d") failed: Property not found. retry in 261.396513ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_61c01227-a384-41a8-bc59-455062631a0d
9712024-04-03T10:09:24.686ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e26e39ef-02c9-4887-939e-4ec196eb3ce0") failed: Property not found. retry in 133.67685ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e26e39ef-02c9-4887-939e-4ec196eb3ce0
9722024-04-03T10:09:24.702ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f8615f1a-8ae7-4cc1-96a8-b7e86d5a6767") failed: Property not found. retry in 251.008986ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f8615f1a-8ae7-4cc1-96a8-b7e86d5a6767
9732024-04-03T10:09:24.718ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ad48337a-add3-4214-9d0f-f8db41e43622") failed: Property not found. retry in 103.486792ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ad48337a-add3-4214-9d0f-f8db41e43622
9742024-04-03T10:09:24.737ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_397924c0-2b87-42bd-adce-1a37f31bd063") failed: Property not found. retry in 207.677777ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_397924c0-2b87-42bd-adce-1a37f31bd063
9752024-04-03T10:09:24.753ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_df36c634-5f4d-4fe1-987c-2dbd6a1ad52a") failed: Property not found. retry in 256.877566ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_df36c634-5f4d-4fe1-987c-2dbd6a1ad52a
9762024-04-03T10:09:24.818ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c4d3bf20-ae50-40b6-af25-d9a472abc430") failed: Property not found. retry in 203.803498ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c4d3bf20-ae50-40b6-af25-d9a472abc430
9772024-04-03T10:09:25.277ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_da41d7a4-e925-4040-b523-178b3850bd7c") failed: Property not found. retry in 215.016139ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_da41d7a4-e925-4040-b523-178b3850bd7c
9782024-04-03T10:09:25.414ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a530ec6b-c8ab-4990-a9b9-f6bb7be02742") failed: Property not found. retry in 561.208585ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a530ec6b-c8ab-4990-a9b9-f6bb7be02742
9792024-04-03T10:09:25.446ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ddcb991a-c8a0-472d-a34d-1dcd46abb727") failed: Property not found. retry in 573.229821ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ddcb991a-c8a0-472d-a34d-1dcd46abb727
9802024-04-03T10:09:25.471ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c0d8975f-0e34-474b-a84c-10dd693605b9") failed: Property not found. retry in 470.254989ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c0d8975f-0e34-474b-a84c-10dd693605b9
9812024-04-03T10:09:25.489ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_2fbdcbcd-ff1b-4375-856b-f7f3530b0e63") failed: Property not found. retry in 596.386275ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_2fbdcbcd-ff1b-4375-856b-f7f3530b0e63
9822024-04-03T10:09:25.510ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eff9cae2-d3de-4f90-b501-6553b5ad9c11") failed: Property not found. retry in 58.926438ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eff9cae2-d3de-4f90-b501-6553b5ad9c11
9832024-04-03T10:09:25.538ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_61c01227-a384-41a8-bc59-455062631a0d") failed: Property not found. retry in 584.608091ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_61c01227-a384-41a8-bc59-455062631a0d
9842024-04-03T10:09:25.561ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e26e39ef-02c9-4887-939e-4ec196eb3ce0") failed: Property not found. retry in 458.789424ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e26e39ef-02c9-4887-939e-4ec196eb3ce0
9852024-04-03T10:09:25.582ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e53f8ac5-d09d-406d-9a03-3edf1a9aecce") failed: Property not found. retry in 285.379738ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e53f8ac5-d09d-406d-9a03-3edf1a9aecce
9862024-04-03T10:09:25.598ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f8615f1a-8ae7-4cc1-96a8-b7e86d5a6767") failed: Property not found. retry in 326.646599ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f8615f1a-8ae7-4cc1-96a8-b7e86d5a6767
9872024-04-03T10:09:25.614ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ad48337a-add3-4214-9d0f-f8db41e43622") failed: Property not found. retry in 475.759368ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ad48337a-add3-4214-9d0f-f8db41e43622
9882024-04-03T10:09:25.632ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_397924c0-2b87-42bd-adce-1a37f31bd063") failed: Property not found. retry in 349.477194ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_397924c0-2b87-42bd-adce-1a37f31bd063
9892024-04-03T10:09:25.647ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_df36c634-5f4d-4fe1-987c-2dbd6a1ad52a") failed: Property not found. retry in 746.401079ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_df36c634-5f4d-4fe1-987c-2dbd6a1ad52a
9902024-04-03T10:09:25.660ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_80bb8934-38d8-48bc-aa7e-eea4a490a555") failed: Property not found. retry in 421.097208ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_80bb8934-38d8-48bc-aa7e-eea4a490a555
9912024-04-03T10:09:25.675ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c4d3bf20-ae50-40b6-af25-d9a472abc430") failed: Property not found. retry in 1.11536798s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c4d3bf20-ae50-40b6-af25-d9a472abc430
9922024-04-03T10:09:25.691ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_da41d7a4-e925-4040-b523-178b3850bd7c") failed: Property not found. retry in 411.044089ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_da41d7a4-e925-4040-b523-178b3850bd7c
9932024-04-03T10:09:25.715ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eff9cae2-d3de-4f90-b501-6553b5ad9c11") failed: Property not found. retry in 54.958752ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eff9cae2-d3de-4f90-b501-6553b5ad9c11
9942024-04-03T10:09:25.748ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_e35963e6-a05d-4aaa-a3e2-d78509c59004: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService25"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::c"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value="vopte2"/> <propval type="astring" name="gateway" value="172.30.2.1"/> <propval type="astring" name="ip" value="172.30.2.7"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9952024-04-03T10:09:25.749ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_adc64792-b7f1-4498-a95d-8e860b5867bf: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService24"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::b"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value="vopte1"/> <propval type="astring" name="gateway" value="172.30.2.1"/> <propval type="astring" name="ip" value="172.30.2.6"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9962024-04-03T10:09:25.749ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_c0f8db76-0c38-4867-b869-53c2384889d1: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService28"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::a"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value="vopte4"/> <propval type="astring" name="gateway" value="172.30.2.1"/> <propval type="astring" name="ip" value="172.30.2.5"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9972024-04-03T10:09:25.749ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_nexus_c0f8db76-0c38-4867-b869-53c2384889d1
9982024-04-03T10:09:25.758ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_nexus_e35963e6-a05d-4aaa-a3e2-d78509c59004
9992024-04-03T10:09:25.765ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_nexus_adc64792-b7f1-4498-a95d-8e860b5867bf
10002024-04-03T10:09:25.789ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eff9cae2-d3de-4f90-b501-6553b5ad9c11") failed: Property not found. retry in 218.504117ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eff9cae2-d3de-4f90-b501-6553b5ad9c11
10012024-04-03T10:09:25.886ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e53f8ac5-d09d-406d-9a03-3edf1a9aecce") failed: Property not found. retry in 453.151928ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e53f8ac5-d09d-406d-9a03-3edf1a9aecce
10022024-04-03T10:09:25.943ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f8615f1a-8ae7-4cc1-96a8-b7e86d5a6767") failed: Property not found. retry in 472.234303ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f8615f1a-8ae7-4cc1-96a8-b7e86d5a6767
10032024-04-03T10:09:25.959ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c0d8975f-0e34-474b-a84c-10dd693605b9") failed: Property not found. retry in 814.109267ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c0d8975f-0e34-474b-a84c-10dd693605b9
10042024-04-03T10:09:25.992ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a530ec6b-c8ab-4990-a9b9-f6bb7be02742") failed: Property not found. retry in 1.041335036s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a530ec6b-c8ab-4990-a9b9-f6bb7be02742
10052024-04-03T10:09:26.009ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_397924c0-2b87-42bd-adce-1a37f31bd063") failed: Property not found. retry in 807.675243ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_397924c0-2b87-42bd-adce-1a37f31bd063
10062024-04-03T10:09:26.023ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eff9cae2-d3de-4f90-b501-6553b5ad9c11") failed: Property not found. retry in 311.210567ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eff9cae2-d3de-4f90-b501-6553b5ad9c11
10072024-04-03T10:09:26.041ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ddcb991a-c8a0-472d-a34d-1dcd46abb727") failed: Property not found. retry in 1.125830084s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ddcb991a-c8a0-472d-a34d-1dcd46abb727
10082024-04-03T10:09:26.058ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e26e39ef-02c9-4887-939e-4ec196eb3ce0") failed: Property not found. retry in 1.158048282s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e26e39ef-02c9-4887-939e-4ec196eb3ce0
10092024-04-03T10:09:26.070ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c0f8db76-0c38-4867-b869-53c2384889d1") failed: Property not found. retry in 35.351752ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c0f8db76-0c38-4867-b869-53c2384889d1
10102024-04-03T10:09:26.082ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e35963e6-a05d-4aaa-a3e2-d78509c59004") failed: Property not found. retry in 34.132939ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e35963e6-a05d-4aaa-a3e2-d78509c59004
10112024-04-03T10:09:26.097ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_80bb8934-38d8-48bc-aa7e-eea4a490a555") failed: Property not found. retry in 1.002186478s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_80bb8934-38d8-48bc-aa7e-eea4a490a555
10122024-04-03T10:09:26.112ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_2fbdcbcd-ff1b-4375-856b-f7f3530b0e63") failed: Property not found. retry in 1.011210133s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_2fbdcbcd-ff1b-4375-856b-f7f3530b0e63
10132024-04-03T10:09:26.126ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_adc64792-b7f1-4498-a95d-8e860b5867bf") failed: Property not found. retry in 71.974556ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_adc64792-b7f1-4498-a95d-8e860b5867bf
10142024-04-03T10:09:26.143ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ad48337a-add3-4214-9d0f-f8db41e43622") failed: Property not found. retry in 524.741936ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ad48337a-add3-4214-9d0f-f8db41e43622
10152024-04-03T10:09:26.162ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_da41d7a4-e925-4040-b523-178b3850bd7c") failed: Property not found. retry in 969.268765ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_da41d7a4-e925-4040-b523-178b3850bd7c
10162024-04-03T10:09:26.175ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e35963e6-a05d-4aaa-a3e2-d78509c59004") failed: Property not found. retry in 142.599505ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e35963e6-a05d-4aaa-a3e2-d78509c59004
10172024-04-03T10:09:26.191ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_61c01227-a384-41a8-bc59-455062631a0d") failed: Property not found. retry in 570.040232ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_61c01227-a384-41a8-bc59-455062631a0d
10182024-04-03T10:09:26.204ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c0f8db76-0c38-4867-b869-53c2384889d1") failed: Property not found. retry in 59.011226ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c0f8db76-0c38-4867-b869-53c2384889d1
10192024-04-03T10:09:26.217ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_adc64792-b7f1-4498-a95d-8e860b5867bf") failed: Property not found. retry in 73.168651ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_adc64792-b7f1-4498-a95d-8e860b5867bf
10202024-04-03T10:09:26.278ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c0f8db76-0c38-4867-b869-53c2384889d1") failed: Property not found. retry in 133.743394ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c0f8db76-0c38-4867-b869-53c2384889d1
10212024-04-03T10:09:26.304ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_adc64792-b7f1-4498-a95d-8e860b5867bf") failed: Property not found. retry in 209.658383ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_adc64792-b7f1-4498-a95d-8e860b5867bf
10222024-04-03T10:09:26.330ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e35963e6-a05d-4aaa-a3e2-d78509c59004") failed: Property not found. retry in 166.031211ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e35963e6-a05d-4aaa-a3e2-d78509c59004
10232024-04-03T10:09:26.351ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eff9cae2-d3de-4f90-b501-6553b5ad9c11") failed: Property not found. retry in 762.211805ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eff9cae2-d3de-4f90-b501-6553b5ad9c11
10242024-04-03T10:09:26.371ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e53f8ac5-d09d-406d-9a03-3edf1a9aecce") failed: Property not found. retry in 1.448127064s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e53f8ac5-d09d-406d-9a03-3edf1a9aecce
10252024-04-03T10:09:26.411ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_df36c634-5f4d-4fe1-987c-2dbd6a1ad52a") failed: Property not found. retry in 1.241931708s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_df36c634-5f4d-4fe1-987c-2dbd6a1ad52a
10262024-04-03T10:09:26.429ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c0f8db76-0c38-4867-b869-53c2384889d1") failed: Property not found. retry in 571.171375ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c0f8db76-0c38-4867-b869-53c2384889d1
10272024-04-03T10:09:26.448ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f8615f1a-8ae7-4cc1-96a8-b7e86d5a6767") failed: Property not found. retry in 543.154298ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f8615f1a-8ae7-4cc1-96a8-b7e86d5a6767
10282024-04-03T10:09:26.519ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e35963e6-a05d-4aaa-a3e2-d78509c59004") failed: Property not found. retry in 581.700869ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e35963e6-a05d-4aaa-a3e2-d78509c59004
10292024-04-03T10:09:26.535ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_adc64792-b7f1-4498-a95d-8e860b5867bf") failed: Property not found. retry in 211.620631ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_adc64792-b7f1-4498-a95d-8e860b5867bf
10302024-04-03T10:09:26.686ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ad48337a-add3-4214-9d0f-f8db41e43622") failed: Property not found. retry in 701.15421ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ad48337a-add3-4214-9d0f-f8db41e43622
10312024-04-03T10:09:26.766ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_adc64792-b7f1-4498-a95d-8e860b5867bf") failed: Property not found. retry in 1.181159619s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_adc64792-b7f1-4498-a95d-8e860b5867bf
10322024-04-03T10:09:26.784ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_61c01227-a384-41a8-bc59-455062631a0d") failed: Property not found. retry in 1.02505655s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_61c01227-a384-41a8-bc59-455062631a0d
10332024-04-03T10:09:26.801ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c0d8975f-0e34-474b-a84c-10dd693605b9") failed: Property not found. retry in 856.812245ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c0d8975f-0e34-474b-a84c-10dd693605b9
10342024-04-03T10:09:26.821ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c4d3bf20-ae50-40b6-af25-d9a472abc430") failed: Property not found. retry in 1.138504676s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c4d3bf20-ae50-40b6-af25-d9a472abc430
10352024-04-03T10:09:26.836ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_397924c0-2b87-42bd-adce-1a37f31bd063") failed: Property not found. retry in 855.561751ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_397924c0-2b87-42bd-adce-1a37f31bd063
10362024-04-03T10:09:27.008ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f8615f1a-8ae7-4cc1-96a8-b7e86d5a6767") failed: Property not found. retry in 820.438969ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f8615f1a-8ae7-4cc1-96a8-b7e86d5a6767
10372024-04-03T10:09:27.023ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c0f8db76-0c38-4867-b869-53c2384889d1") failed: Property not found. retry in 932.332796ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c0f8db76-0c38-4867-b869-53c2384889d1
10382024-04-03T10:09:27.048ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a530ec6b-c8ab-4990-a9b9-f6bb7be02742") failed: Property not found. retry in 825.129174ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a530ec6b-c8ab-4990-a9b9-f6bb7be02742
10392024-04-03T10:09:27.117ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_80bb8934-38d8-48bc-aa7e-eea4a490a555") failed: Property not found. retry in 1.371728249s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_80bb8934-38d8-48bc-aa7e-eea4a490a555
10402024-04-03T10:09:27.132ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e35963e6-a05d-4aaa-a3e2-d78509c59004") failed: Property not found. retry in 469.504776ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e35963e6-a05d-4aaa-a3e2-d78509c59004
10412024-04-03T10:09:27.148ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eff9cae2-d3de-4f90-b501-6553b5ad9c11") failed: Property not found. retry in 991.512538ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eff9cae2-d3de-4f90-b501-6553b5ad9c11
10422024-04-03T10:09:27.166ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_da41d7a4-e925-4040-b523-178b3850bd7c") failed: Property not found. retry in 1.264263971s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_da41d7a4-e925-4040-b523-178b3850bd7c
10432024-04-03T10:09:27.182ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_2fbdcbcd-ff1b-4375-856b-f7f3530b0e63") failed: Property not found. retry in 1.33874007s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_2fbdcbcd-ff1b-4375-856b-f7f3530b0e63
10442024-04-03T10:09:27.197ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ddcb991a-c8a0-472d-a34d-1dcd46abb727") failed: Property not found. retry in 893.614387ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ddcb991a-c8a0-472d-a34d-1dcd46abb727
10452024-04-03T10:09:27.229ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e26e39ef-02c9-4887-939e-4ec196eb3ce0") failed: Property not found. retry in 918.13182ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e26e39ef-02c9-4887-939e-4ec196eb3ce0
10462024-04-03T10:09:27.400ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ad48337a-add3-4214-9d0f-f8db41e43622") failed: Property not found. retry in 667.312364ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ad48337a-add3-4214-9d0f-f8db41e43622
10472024-04-03T10:09:27.622ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e35963e6-a05d-4aaa-a3e2-d78509c59004") failed: Property not found. retry in 1.427804257s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e35963e6-a05d-4aaa-a3e2-d78509c59004
10482024-04-03T10:09:27.667ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_df36c634-5f4d-4fe1-987c-2dbd6a1ad52a") failed: Property not found. retry in 1.402510412s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_df36c634-5f4d-4fe1-987c-2dbd6a1ad52a
10492024-04-03T10:09:27.678ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c0d8975f-0e34-474b-a84c-10dd693605b9") failed: Property not found. retry in 683.948724ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c0d8975f-0e34-474b-a84c-10dd693605b9
10502024-04-03T10:09:27.703ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_397924c0-2b87-42bd-adce-1a37f31bd063") failed: Property not found. retry in 1.406719635s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_397924c0-2b87-42bd-adce-1a37f31bd063
10512024-04-03T10:09:27.823ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_61c01227-a384-41a8-bc59-455062631a0d") failed: Property not found. retry in 888.203242ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_61c01227-a384-41a8-bc59-455062631a0d
10522024-04-03T10:09:27.836ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e53f8ac5-d09d-406d-9a03-3edf1a9aecce") failed: Property not found. retry in 1.242030942s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e53f8ac5-d09d-406d-9a03-3edf1a9aecce
10532024-04-03T10:09:27.853ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f8615f1a-8ae7-4cc1-96a8-b7e86d5a6767") failed: Property not found. retry in 1.359666301s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f8615f1a-8ae7-4cc1-96a8-b7e86d5a6767
10542024-04-03T10:09:27.901ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a530ec6b-c8ab-4990-a9b9-f6bb7be02742") failed: Property not found. retry in 1.466549879s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a530ec6b-c8ab-4990-a9b9-f6bb7be02742
10552024-04-03T10:09:27.972ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_adc64792-b7f1-4498-a95d-8e860b5867bf") failed: Property not found. retry in 803.465898ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_adc64792-b7f1-4498-a95d-8e860b5867bf
10562024-04-03T10:09:27.992ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c4d3bf20-ae50-40b6-af25-d9a472abc430") failed: Property not found. retry in 993.006535ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c4d3bf20-ae50-40b6-af25-d9a472abc430
10572024-04-03T10:09:28.008ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c0f8db76-0c38-4867-b869-53c2384889d1") failed: Property not found. retry in 1.206395973s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c0f8db76-0c38-4867-b869-53c2384889d1
10582024-04-03T10:09:28.085ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ad48337a-add3-4214-9d0f-f8db41e43622") failed: Property not found. retry in 844.511056ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ad48337a-add3-4214-9d0f-f8db41e43622
10592024-04-03T10:09:28.104ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ddcb991a-c8a0-472d-a34d-1dcd46abb727") failed: Property not found. retry in 952.775436ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ddcb991a-c8a0-472d-a34d-1dcd46abb727
10602024-04-03T10:09:28.156ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eff9cae2-d3de-4f90-b501-6553b5ad9c11") failed: Property not found. retry in 1.206336406s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eff9cae2-d3de-4f90-b501-6553b5ad9c11
10612024-04-03T10:09:28.172ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e26e39ef-02c9-4887-939e-4ec196eb3ce0") failed: Property not found. retry in 1.252003249s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e26e39ef-02c9-4887-939e-4ec196eb3ce0
10622024-04-03T10:09:28.387ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c0d8975f-0e34-474b-a84c-10dd693605b9") failed: Property not found. retry in 794.452629ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c0d8975f-0e34-474b-a84c-10dd693605b9
10632024-04-03T10:09:28.453ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_da41d7a4-e925-4040-b523-178b3850bd7c") failed: Property not found. retry in 760.987345ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_da41d7a4-e925-4040-b523-178b3850bd7c
10642024-04-03T10:09:28.507ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_80bb8934-38d8-48bc-aa7e-eea4a490a555") failed: Property not found. retry in 945.595562ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_80bb8934-38d8-48bc-aa7e-eea4a490a555
10652024-04-03T10:09:28.543ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_2fbdcbcd-ff1b-4375-856b-f7f3530b0e63") failed: Property not found. retry in 1.133728951s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_2fbdcbcd-ff1b-4375-856b-f7f3530b0e63
10662024-04-03T10:09:28.733ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_61c01227-a384-41a8-bc59-455062631a0d") failed: Property not found. retry in 744.236172ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_61c01227-a384-41a8-bc59-455062631a0d
10672024-04-03T10:09:28.796ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_adc64792-b7f1-4498-a95d-8e860b5867bf") failed: Property not found. retry in 1.200393663s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_adc64792-b7f1-4498-a95d-8e860b5867bf
10682024-04-03T10:09:28.955ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ad48337a-add3-4214-9d0f-f8db41e43622") failed: Property not found. retry in 1.218561461s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ad48337a-add3-4214-9d0f-f8db41e43622
10692024-04-03T10:09:29.009ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c4d3bf20-ae50-40b6-af25-d9a472abc430") failed: Property not found. retry in 543.751967ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c4d3bf20-ae50-40b6-af25-d9a472abc430
10702024-04-03T10:09:29.079ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e35963e6-a05d-4aaa-a3e2-d78509c59004") failed: Property not found. retry in 822.687098ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e35963e6-a05d-4aaa-a3e2-d78509c59004
10712024-04-03T10:09:29.100ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ddcb991a-c8a0-472d-a34d-1dcd46abb727") failed: Property not found. retry in 1.283701732s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ddcb991a-c8a0-472d-a34d-1dcd46abb727
10722024-04-03T10:09:29.125ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e53f8ac5-d09d-406d-9a03-3edf1a9aecce") failed: Property not found. retry in 1.166153035s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e53f8ac5-d09d-406d-9a03-3edf1a9aecce
10732024-04-03T10:09:29.148ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_397924c0-2b87-42bd-adce-1a37f31bd063") failed: Property not found. retry in 1.458420317s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_397924c0-2b87-42bd-adce-1a37f31bd063
10742024-04-03T10:09:29.170ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_df36c634-5f4d-4fe1-987c-2dbd6a1ad52a") failed: Property not found. retry in 768.039318ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_df36c634-5f4d-4fe1-987c-2dbd6a1ad52a
10752024-04-03T10:09:29.242ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c0d8975f-0e34-474b-a84c-10dd693605b9") failed: Property not found. retry in 833.48168ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c0d8975f-0e34-474b-a84c-10dd693605b9
10762024-04-03T10:09:29.298ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f8615f1a-8ae7-4cc1-96a8-b7e86d5a6767") failed: Property not found. retry in 1.48949792s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f8615f1a-8ae7-4cc1-96a8-b7e86d5a6767
10772024-04-03T10:09:29.346ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c0f8db76-0c38-4867-b869-53c2384889d1") failed: Property not found. retry in 1.019230405s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c0f8db76-0c38-4867-b869-53c2384889d1
10782024-04-03T10:09:29.393ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_da41d7a4-e925-4040-b523-178b3850bd7c") failed: Property not found. retry in 1.292839517s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_da41d7a4-e925-4040-b523-178b3850bd7c
10792024-04-03T10:09:29.416ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a530ec6b-c8ab-4990-a9b9-f6bb7be02742") failed: Property not found. retry in 723.411698ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a530ec6b-c8ab-4990-a9b9-f6bb7be02742
10802024-04-03T10:09:29.441ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eff9cae2-d3de-4f90-b501-6553b5ad9c11") failed: Property not found. retry in 1.138346965s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eff9cae2-d3de-4f90-b501-6553b5ad9c11
10812024-04-03T10:09:29.508ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e26e39ef-02c9-4887-939e-4ec196eb3ce0") failed: Property not found. retry in 957.442664ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e26e39ef-02c9-4887-939e-4ec196eb3ce0
10822024-04-03T10:09:29.537ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_80bb8934-38d8-48bc-aa7e-eea4a490a555") failed: Property not found. retry in 770.580754ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_80bb8934-38d8-48bc-aa7e-eea4a490a555
10832024-04-03T10:09:29.559ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_61c01227-a384-41a8-bc59-455062631a0d") failed: Property not found. retry in 996.787374ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_61c01227-a384-41a8-bc59-455062631a0d
10842024-04-03T10:09:29.602ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c4d3bf20-ae50-40b6-af25-d9a472abc430") failed: Property not found. retry in 706.130344ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c4d3bf20-ae50-40b6-af25-d9a472abc430
10852024-04-03T10:09:29.608ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_498d9e47-b1b3-4a91-a9ab-1b36877185b9: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService18"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::e"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::e"/> <propval type="astring" name="listen_port" value="8123"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:3::1" /> <value_node value="fd00:1122:3344:2::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10862024-04-03T10:09:29.609ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_clickhouse_498d9e47-b1b3-4a91-a9ab-1b36877185b9
10872024-04-03T10:09:29.702ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_2fbdcbcd-ff1b-4375-856b-f7f3530b0e63") failed: Property not found. retry in 832.425068ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_2fbdcbcd-ff1b-4375-856b-f7f3530b0e63
10882024-04-03T10:09:29.919ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e35963e6-a05d-4aaa-a3e2-d78509c59004") failed: Property not found. retry in 1.190524774s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e35963e6-a05d-4aaa-a3e2-d78509c59004
10892024-04-03T10:09:29.931ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_498d9e47-b1b3-4a91-a9ab-1b36877185b9") failed: Property not found. retry in 46.260347ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_498d9e47-b1b3-4a91-a9ab-1b36877185b9
10902024-04-03T10:09:29.952ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_df36c634-5f4d-4fe1-987c-2dbd6a1ad52a") failed: Property not found. retry in 1.228674405s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_df36c634-5f4d-4fe1-987c-2dbd6a1ad52a
10912024-04-03T10:09:29.990ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_498d9e47-b1b3-4a91-a9ab-1b36877185b9") failed: Property not found. retry in 75.206402ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_498d9e47-b1b3-4a91-a9ab-1b36877185b9
10922024-04-03T10:09:30.021ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_adc64792-b7f1-4498-a95d-8e860b5867bf") failed: Property not found. retry in 1.089857408s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_adc64792-b7f1-4498-a95d-8e860b5867bf
10932024-04-03T10:09:30.168ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_498d9e47-b1b3-4a91-a9ab-1b36877185b9") failed: Property not found. retry in 288.975715ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_498d9e47-b1b3-4a91-a9ab-1b36877185b9
10942024-04-03T10:09:30.192ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a530ec6b-c8ab-4990-a9b9-f6bb7be02742") failed: Property not found. retry in 735.738596ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a530ec6b-c8ab-4990-a9b9-f6bb7be02742
10952024-04-03T10:09:30.208ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c0d8975f-0e34-474b-a84c-10dd693605b9") failed: Property not found. retry in 1.29880564s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c0d8975f-0e34-474b-a84c-10dd693605b9
10962024-04-03T10:09:30.222ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ad48337a-add3-4214-9d0f-f8db41e43622") failed: Property not found. retry in 848.549897ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ad48337a-add3-4214-9d0f-f8db41e43622
10972024-04-03T10:09:30.304ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e53f8ac5-d09d-406d-9a03-3edf1a9aecce") failed: Property not found. retry in 556.172621ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e53f8ac5-d09d-406d-9a03-3edf1a9aecce
10982024-04-03T10:09:30.320ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_80bb8934-38d8-48bc-aa7e-eea4a490a555") failed: Property not found. retry in 1.449254803s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_80bb8934-38d8-48bc-aa7e-eea4a490a555
10992024-04-03T10:09:30.331ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c4d3bf20-ae50-40b6-af25-d9a472abc430") failed: Property not found. retry in 993.825561ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c4d3bf20-ae50-40b6-af25-d9a472abc430
11002024-04-03T10:09:30.378ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c0f8db76-0c38-4867-b869-53c2384889d1") failed: Property not found. retry in 1.393771016s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c0f8db76-0c38-4867-b869-53c2384889d1
11012024-04-03T10:09:30.397ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ddcb991a-c8a0-472d-a34d-1dcd46abb727") failed: Property not found. retry in 917.026519ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ddcb991a-c8a0-472d-a34d-1dcd46abb727
11022024-04-03T10:09:30.468ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_498d9e47-b1b3-4a91-a9ab-1b36877185b9") failed: Property not found. retry in 273.830497ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_498d9e47-b1b3-4a91-a9ab-1b36877185b9
11032024-04-03T10:09:30.479ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e26e39ef-02c9-4887-939e-4ec196eb3ce0") failed: Property not found. retry in 999.756799ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e26e39ef-02c9-4887-939e-4ec196eb3ce0
11042024-04-03T10:09:30.546ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_2fbdcbcd-ff1b-4375-856b-f7f3530b0e63") failed: Property not found. retry in 509.800485ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_2fbdcbcd-ff1b-4375-856b-f7f3530b0e63
11052024-04-03T10:09:30.568ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_61c01227-a384-41a8-bc59-455062631a0d") failed: Property not found. retry in 1.23811499s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_61c01227-a384-41a8-bc59-455062631a0d
11062024-04-03T10:09:30.590ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eff9cae2-d3de-4f90-b501-6553b5ad9c11") failed: Property not found. retry in 756.338069ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eff9cae2-d3de-4f90-b501-6553b5ad9c11
11072024-04-03T10:09:30.617ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_397924c0-2b87-42bd-adce-1a37f31bd063") failed: Property not found. retry in 831.444194ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_397924c0-2b87-42bd-adce-1a37f31bd063
11082024-04-03T10:09:30.698ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_da41d7a4-e925-4040-b523-178b3850bd7c") failed: Property not found. retry in 1.007484343s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_da41d7a4-e925-4040-b523-178b3850bd7c
11092024-04-03T10:09:30.755ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_498d9e47-b1b3-4a91-a9ab-1b36877185b9") failed: Property not found. retry in 872.406684ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_498d9e47-b1b3-4a91-a9ab-1b36877185b9
11102024-04-03T10:09:30.799ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f8615f1a-8ae7-4cc1-96a8-b7e86d5a6767") failed: Property not found. retry in 1.201574899s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f8615f1a-8ae7-4cc1-96a8-b7e86d5a6767
11112024-04-03T10:09:30.872ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e53f8ac5-d09d-406d-9a03-3edf1a9aecce") failed: Property not found. retry in 894.919423ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e53f8ac5-d09d-406d-9a03-3edf1a9aecce
11122024-04-03T10:09:30.939ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a530ec6b-c8ab-4990-a9b9-f6bb7be02742") failed: Property not found. retry in 1.097133754s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a530ec6b-c8ab-4990-a9b9-f6bb7be02742
11132024-04-03T10:09:31.069ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_2fbdcbcd-ff1b-4375-856b-f7f3530b0e63") failed: Property not found. retry in 1.115924292s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_2fbdcbcd-ff1b-4375-856b-f7f3530b0e63
11142024-04-03T10:09:31.082ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ad48337a-add3-4214-9d0f-f8db41e43622") failed: Property not found. retry in 510.092013ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ad48337a-add3-4214-9d0f-f8db41e43622
11152024-04-03T10:09:31.122ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e35963e6-a05d-4aaa-a3e2-d78509c59004") failed: Property not found. retry in 799.406219ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e35963e6-a05d-4aaa-a3e2-d78509c59004
11162024-04-03T10:09:31.133ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_adc64792-b7f1-4498-a95d-8e860b5867bf") failed: Property not found. retry in 937.786215ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_adc64792-b7f1-4498-a95d-8e860b5867bf
11172024-04-03T10:09:31.192ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_df36c634-5f4d-4fe1-987c-2dbd6a1ad52a") failed: Property not found. retry in 924.223784ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_df36c634-5f4d-4fe1-987c-2dbd6a1ad52a
11182024-04-03T10:09:31.328ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ddcb991a-c8a0-472d-a34d-1dcd46abb727") failed: Property not found. retry in 1.398677626s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ddcb991a-c8a0-472d-a34d-1dcd46abb727
11192024-04-03T10:09:31.338ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c4d3bf20-ae50-40b6-af25-d9a472abc430") failed: Property not found. retry in 1.179995411s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c4d3bf20-ae50-40b6-af25-d9a472abc430
11202024-04-03T10:09:31.358ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eff9cae2-d3de-4f90-b501-6553b5ad9c11") failed: Property not found. retry in 1.006524742s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eff9cae2-d3de-4f90-b501-6553b5ad9c11
11212024-04-03T10:09:31.461ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_397924c0-2b87-42bd-adce-1a37f31bd063") failed: Property not found. retry in 577.926353ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_397924c0-2b87-42bd-adce-1a37f31bd063
11222024-04-03T10:09:31.491ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e26e39ef-02c9-4887-939e-4ec196eb3ce0") failed: Property not found. retry in 1.450132154s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e26e39ef-02c9-4887-939e-4ec196eb3ce0
11232024-04-03T10:09:31.519ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c0d8975f-0e34-474b-a84c-10dd693605b9") failed: Property not found. retry in 1.204509897s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c0d8975f-0e34-474b-a84c-10dd693605b9
11242024-04-03T10:09:31.604ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ad48337a-add3-4214-9d0f-f8db41e43622") failed: Property not found. retry in 613.224353ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ad48337a-add3-4214-9d0f-f8db41e43622
11252024-04-03T10:09:31.639ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_498d9e47-b1b3-4a91-a9ab-1b36877185b9") failed: Property not found. retry in 1.074507307s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_498d9e47-b1b3-4a91-a9ab-1b36877185b9
11262024-04-03T10:09:31.717ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_da41d7a4-e925-4040-b523-178b3850bd7c") failed: Property not found. retry in 1.170654381s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_da41d7a4-e925-4040-b523-178b3850bd7c
11272024-04-03T10:09:31.778ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e53f8ac5-d09d-406d-9a03-3edf1a9aecce") failed: Property not found. retry in 526.92021ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e53f8ac5-d09d-406d-9a03-3edf1a9aecce
11282024-04-03T10:09:31.789ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_80bb8934-38d8-48bc-aa7e-eea4a490a555") failed: Property not found. retry in 1.146162916s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_80bb8934-38d8-48bc-aa7e-eea4a490a555
11292024-04-03T10:09:31.800ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c0f8db76-0c38-4867-b869-53c2384889d1") failed: Property not found. retry in 699.538305ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c0f8db76-0c38-4867-b869-53c2384889d1
11302024-04-03T10:09:31.818ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_61c01227-a384-41a8-bc59-455062631a0d") failed: Property not found. retry in 718.794149ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_61c01227-a384-41a8-bc59-455062631a0d
11312024-04-03T10:09:31.935ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e35963e6-a05d-4aaa-a3e2-d78509c59004") failed: Property not found. retry in 1.213349628s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e35963e6-a05d-4aaa-a3e2-d78509c59004
11322024-04-03T10:09:32.013ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f8615f1a-8ae7-4cc1-96a8-b7e86d5a6767") failed: Property not found. retry in 1.00301459s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f8615f1a-8ae7-4cc1-96a8-b7e86d5a6767
11332024-04-03T10:09:32.046ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a530ec6b-c8ab-4990-a9b9-f6bb7be02742") failed: Property not found. retry in 1.182740116s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a530ec6b-c8ab-4990-a9b9-f6bb7be02742
11342024-04-03T10:09:32.055ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_397924c0-2b87-42bd-adce-1a37f31bd063") failed: Property not found. retry in 1.023991037s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_397924c0-2b87-42bd-adce-1a37f31bd063
11352024-04-03T10:09:32.082ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_adc64792-b7f1-4498-a95d-8e860b5867bf") failed: Property not found. retry in 1.359570902s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_adc64792-b7f1-4498-a95d-8e860b5867bf
11362024-04-03T10:09:32.126ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_df36c634-5f4d-4fe1-987c-2dbd6a1ad52a") failed: Property not found. retry in 1.212216095s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_df36c634-5f4d-4fe1-987c-2dbd6a1ad52a
11372024-04-03T10:09:32.195ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_2fbdcbcd-ff1b-4375-856b-f7f3530b0e63") failed: Property not found. retry in 661.91726ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_2fbdcbcd-ff1b-4375-856b-f7f3530b0e63
11382024-04-03T10:09:32.234ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ad48337a-add3-4214-9d0f-f8db41e43622") failed: Property not found. retry in 568.875395ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ad48337a-add3-4214-9d0f-f8db41e43622
11392024-04-03T10:09:32.319ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e53f8ac5-d09d-406d-9a03-3edf1a9aecce") failed: Property not found. retry in 1.019106181s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e53f8ac5-d09d-406d-9a03-3edf1a9aecce
11402024-04-03T10:09:32.375ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eff9cae2-d3de-4f90-b501-6553b5ad9c11") failed: Property not found. retry in 732.074017ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eff9cae2-d3de-4f90-b501-6553b5ad9c11
11412024-04-03T10:09:32.510ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c0f8db76-0c38-4867-b869-53c2384889d1") failed: Property not found. retry in 868.054456ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c0f8db76-0c38-4867-b869-53c2384889d1
11422024-04-03T10:09:32.529ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c4d3bf20-ae50-40b6-af25-d9a472abc430") failed: Property not found. retry in 1.428502406s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c4d3bf20-ae50-40b6-af25-d9a472abc430
11432024-04-03T10:09:32.546ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_61c01227-a384-41a8-bc59-455062631a0d") failed: Property not found. retry in 568.643466ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_61c01227-a384-41a8-bc59-455062631a0d
11442024-04-03T10:09:32.731ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_498d9e47-b1b3-4a91-a9ab-1b36877185b9") failed: Property not found. retry in 543.25132ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_498d9e47-b1b3-4a91-a9ab-1b36877185b9
11452024-04-03T10:09:32.744ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ddcb991a-c8a0-472d-a34d-1dcd46abb727") failed: Property not found. retry in 730.697243ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ddcb991a-c8a0-472d-a34d-1dcd46abb727
11462024-04-03T10:09:32.757ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c0d8975f-0e34-474b-a84c-10dd693605b9") failed: Property not found. retry in 1.205961422s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c0d8975f-0e34-474b-a84c-10dd693605b9
11472024-04-03T10:09:32.817ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ad48337a-add3-4214-9d0f-f8db41e43622") failed: Property not found. retry in 1.416465766s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ad48337a-add3-4214-9d0f-f8db41e43622
11482024-04-03T10:09:32.874ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_2fbdcbcd-ff1b-4375-856b-f7f3530b0e63") failed: Property not found. retry in 1.413620292s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_2fbdcbcd-ff1b-4375-856b-f7f3530b0e63
11492024-04-03T10:09:32.902ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_da41d7a4-e925-4040-b523-178b3850bd7c") failed: Property not found. retry in 660.578146ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_da41d7a4-e925-4040-b523-178b3850bd7c
11502024-04-03T10:09:32.947ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_80bb8934-38d8-48bc-aa7e-eea4a490a555") failed: Property not found. retry in 1.105213985s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_80bb8934-38d8-48bc-aa7e-eea4a490a555
11512024-04-03T10:09:32.965ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e26e39ef-02c9-4887-939e-4ec196eb3ce0") failed: Property not found. retry in 530.566448ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e26e39ef-02c9-4887-939e-4ec196eb3ce0
11522024-04-03T10:09:33.032ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f8615f1a-8ae7-4cc1-96a8-b7e86d5a6767") failed: Property not found. retry in 752.112764ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f8615f1a-8ae7-4cc1-96a8-b7e86d5a6767
11532024-04-03T10:09:33.093ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_397924c0-2b87-42bd-adce-1a37f31bd063") failed: Property not found. retry in 1.080634159s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_397924c0-2b87-42bd-adce-1a37f31bd063
11542024-04-03T10:09:33.121ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eff9cae2-d3de-4f90-b501-6553b5ad9c11") failed: Property not found. retry in 545.011819ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eff9cae2-d3de-4f90-b501-6553b5ad9c11
11552024-04-03T10:09:33.135ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_61c01227-a384-41a8-bc59-455062631a0d") failed: Property not found. retry in 582.236156ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_61c01227-a384-41a8-bc59-455062631a0d
11562024-04-03T10:09:33.163ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e35963e6-a05d-4aaa-a3e2-d78509c59004") failed: Property not found. retry in 1.124783941s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e35963e6-a05d-4aaa-a3e2-d78509c59004
11572024-04-03T10:09:33.246ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a530ec6b-c8ab-4990-a9b9-f6bb7be02742") failed: Property not found. retry in 1.479057889s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a530ec6b-c8ab-4990-a9b9-f6bb7be02742
11582024-04-03T10:09:33.288ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_498d9e47-b1b3-4a91-a9ab-1b36877185b9") failed: Property not found. retry in 746.804454ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_498d9e47-b1b3-4a91-a9ab-1b36877185b9
11592024-04-03T10:09:33.357ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e53f8ac5-d09d-406d-9a03-3edf1a9aecce") failed: Property not found. retry in 781.179142ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e53f8ac5-d09d-406d-9a03-3edf1a9aecce
11602024-04-03T10:09:33.373ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_df36c634-5f4d-4fe1-987c-2dbd6a1ad52a") failed: Property not found. retry in 1.448965414s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_df36c634-5f4d-4fe1-987c-2dbd6a1ad52a
11612024-04-03T10:09:33.395ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c0f8db76-0c38-4867-b869-53c2384889d1") failed: Property not found. retry in 532.355166ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c0f8db76-0c38-4867-b869-53c2384889d1
11622024-04-03T10:09:33.459ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_adc64792-b7f1-4498-a95d-8e860b5867bf") failed: Property not found. retry in 1.074286222s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_adc64792-b7f1-4498-a95d-8e860b5867bf
11632024-04-03T10:09:33.489ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ddcb991a-c8a0-472d-a34d-1dcd46abb727") failed: Property not found. retry in 866.172125ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ddcb991a-c8a0-472d-a34d-1dcd46abb727
11642024-04-03T10:09:33.513ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e26e39ef-02c9-4887-939e-4ec196eb3ce0") failed: Property not found. retry in 1.360787284s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e26e39ef-02c9-4887-939e-4ec196eb3ce0
11652024-04-03T10:09:33.579ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_da41d7a4-e925-4040-b523-178b3850bd7c") failed: Property not found. retry in 1.13093569s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_da41d7a4-e925-4040-b523-178b3850bd7c
11662024-04-03T10:09:33.682ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eff9cae2-d3de-4f90-b501-6553b5ad9c11") failed: Property not found. retry in 716.260137ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eff9cae2-d3de-4f90-b501-6553b5ad9c11
11672024-04-03T10:09:33.733ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_61c01227-a384-41a8-bc59-455062631a0d") failed: Property not found. retry in 1.233705993s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_61c01227-a384-41a8-bc59-455062631a0d
11682024-04-03T10:09:33.801ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f8615f1a-8ae7-4cc1-96a8-b7e86d5a6767") failed: Property not found. retry in 1.442103334s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f8615f1a-8ae7-4cc1-96a8-b7e86d5a6767
11692024-04-03T10:09:33.941ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c0f8db76-0c38-4867-b869-53c2384889d1") failed: Property not found. retry in 721.323347ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c0f8db76-0c38-4867-b869-53c2384889d1
11702024-04-03T10:09:33.969ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c4d3bf20-ae50-40b6-af25-d9a472abc430") failed: Property not found. retry in 1.410280562s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c4d3bf20-ae50-40b6-af25-d9a472abc430
11712024-04-03T10:09:33.982ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c0d8975f-0e34-474b-a84c-10dd693605b9") failed: Property not found. retry in 685.85158ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c0d8975f-0e34-474b-a84c-10dd693605b9
11722024-04-03T10:09:34.045ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_498d9e47-b1b3-4a91-a9ab-1b36877185b9") failed: Property not found. retry in 781.216497ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_498d9e47-b1b3-4a91-a9ab-1b36877185b9
11732024-04-03T10:09:34.064ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_80bb8934-38d8-48bc-aa7e-eea4a490a555") failed: Property not found. retry in 1.083058592s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_80bb8934-38d8-48bc-aa7e-eea4a490a555
11742024-04-03T10:09:34.151ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e53f8ac5-d09d-406d-9a03-3edf1a9aecce") failed: Property not found. retry in 1.428576586s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e53f8ac5-d09d-406d-9a03-3edf1a9aecce
11752024-04-03T10:09:34.201ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_397924c0-2b87-42bd-adce-1a37f31bd063") failed: Property not found. retry in 784.761251ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_397924c0-2b87-42bd-adce-1a37f31bd063
11762024-04-03T10:09:34.247ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ad48337a-add3-4214-9d0f-f8db41e43622") failed: Property not found. retry in 559.313055ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ad48337a-add3-4214-9d0f-f8db41e43622
11772024-04-03T10:09:34.299ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e35963e6-a05d-4aaa-a3e2-d78509c59004") failed: Property not found. retry in 855.988936ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e35963e6-a05d-4aaa-a3e2-d78509c59004
11782024-04-03T10:09:34.309ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_2fbdcbcd-ff1b-4375-856b-f7f3530b0e63") failed: Property not found. retry in 1.031245512s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_2fbdcbcd-ff1b-4375-856b-f7f3530b0e63
11792024-04-03T10:09:34.369ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ddcb991a-c8a0-472d-a34d-1dcd46abb727") failed: Property not found. retry in 597.697748ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ddcb991a-c8a0-472d-a34d-1dcd46abb727
11802024-04-03T10:09:34.408ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eff9cae2-d3de-4f90-b501-6553b5ad9c11") failed: Property not found. retry in 639.405392ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eff9cae2-d3de-4f90-b501-6553b5ad9c11
11812024-04-03T10:09:34.542ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_adc64792-b7f1-4498-a95d-8e860b5867bf") failed: Property not found. retry in 560.409369ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_adc64792-b7f1-4498-a95d-8e860b5867bf
11822024-04-03T10:09:34.673ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c0f8db76-0c38-4867-b869-53c2384889d1") failed: Property not found. retry in 1.284077375s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c0f8db76-0c38-4867-b869-53c2384889d1
11832024-04-03T10:09:34.680ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c0d8975f-0e34-474b-a84c-10dd693605b9") failed: Property not found. retry in 1.087810578s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c0d8975f-0e34-474b-a84c-10dd693605b9
11842024-04-03T10:09:34.718ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_da41d7a4-e925-4040-b523-178b3850bd7c") failed: Property not found. retry in 916.890614ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_da41d7a4-e925-4040-b523-178b3850bd7c
11852024-04-03T10:09:34.733ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a530ec6b-c8ab-4990-a9b9-f6bb7be02742") failed: Property not found. retry in 707.316794ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a530ec6b-c8ab-4990-a9b9-f6bb7be02742
11862024-04-03T10:09:34.816ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ad48337a-add3-4214-9d0f-f8db41e43622") failed: Property not found. retry in 1.141950083s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ad48337a-add3-4214-9d0f-f8db41e43622
11872024-04-03T10:09:34.831ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_df36c634-5f4d-4fe1-987c-2dbd6a1ad52a") failed: Property not found. retry in 526.763284ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_df36c634-5f4d-4fe1-987c-2dbd6a1ad52a
11882024-04-03T10:09:34.839ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_498d9e47-b1b3-4a91-a9ab-1b36877185b9") failed: Property not found. retry in 826.846771ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_498d9e47-b1b3-4a91-a9ab-1b36877185b9
11892024-04-03T10:09:34.883ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e26e39ef-02c9-4887-939e-4ec196eb3ce0") failed: Property not found. retry in 886.418423ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e26e39ef-02c9-4887-939e-4ec196eb3ce0
11902024-04-03T10:09:34.979ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ddcb991a-c8a0-472d-a34d-1dcd46abb727") failed: Property not found. retry in 773.376748ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ddcb991a-c8a0-472d-a34d-1dcd46abb727
11912024-04-03T10:09:34.989ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_61c01227-a384-41a8-bc59-455062631a0d") failed: Property not found. retry in 1.307028321s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_61c01227-a384-41a8-bc59-455062631a0d
11922024-04-03T10:09:34.998ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_397924c0-2b87-42bd-adce-1a37f31bd063") failed: Property not found. retry in 1.114441502s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_397924c0-2b87-42bd-adce-1a37f31bd063
11932024-04-03T10:09:35.057ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eff9cae2-d3de-4f90-b501-6553b5ad9c11") failed: Property not found. retry in 1.311094531s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eff9cae2-d3de-4f90-b501-6553b5ad9c11
11942024-04-03T10:09:35.112ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_adc64792-b7f1-4498-a95d-8e860b5867bf") failed: Property not found. retry in 561.747344ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_adc64792-b7f1-4498-a95d-8e860b5867bf
11952024-04-03T10:09:35.156ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_80bb8934-38d8-48bc-aa7e-eea4a490a555") failed: Property not found. retry in 582.976716ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_80bb8934-38d8-48bc-aa7e-eea4a490a555
11962024-04-03T10:09:35.164ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e35963e6-a05d-4aaa-a3e2-d78509c59004") failed: Property not found. retry in 1.442619671s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e35963e6-a05d-4aaa-a3e2-d78509c59004
11972024-04-03T10:09:35.253ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f8615f1a-8ae7-4cc1-96a8-b7e86d5a6767") failed: Property not found. retry in 1.129714397s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f8615f1a-8ae7-4cc1-96a8-b7e86d5a6767
11982024-04-03T10:09:35.350ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_2fbdcbcd-ff1b-4375-856b-f7f3530b0e63") failed: Property not found. retry in 666.264587ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_2fbdcbcd-ff1b-4375-856b-f7f3530b0e63
11992024-04-03T10:09:35.368ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_df36c634-5f4d-4fe1-987c-2dbd6a1ad52a") failed: Property not found. retry in 633.238827ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_df36c634-5f4d-4fe1-987c-2dbd6a1ad52a
12002024-04-03T10:09:35.388ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c4d3bf20-ae50-40b6-af25-d9a472abc430") failed: Property not found. retry in 892.225999ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c4d3bf20-ae50-40b6-af25-d9a472abc430
12012024-04-03T10:09:35.450ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a530ec6b-c8ab-4990-a9b9-f6bb7be02742") failed: Property not found. retry in 637.253327ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a530ec6b-c8ab-4990-a9b9-f6bb7be02742
12022024-04-03T10:09:35.589ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e53f8ac5-d09d-406d-9a03-3edf1a9aecce") failed: Property not found. retry in 1.437884386s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e53f8ac5-d09d-406d-9a03-3edf1a9aecce
12032024-04-03T10:09:35.643ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_da41d7a4-e925-4040-b523-178b3850bd7c") failed: Property not found. retry in 773.071277ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_da41d7a4-e925-4040-b523-178b3850bd7c
12042024-04-03T10:09:35.679ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_498d9e47-b1b3-4a91-a9ab-1b36877185b9") failed: Property not found. retry in 893.854306ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_498d9e47-b1b3-4a91-a9ab-1b36877185b9
12052024-04-03T10:09:35.687ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_adc64792-b7f1-4498-a95d-8e860b5867bf") failed: Property not found. retry in 1.427875619s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_adc64792-b7f1-4498-a95d-8e860b5867bf
12062024-04-03T10:09:35.747ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_80bb8934-38d8-48bc-aa7e-eea4a490a555") failed: Property not found. retry in 805.388846ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_80bb8934-38d8-48bc-aa7e-eea4a490a555
12072024-04-03T10:09:35.762ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ddcb991a-c8a0-472d-a34d-1dcd46abb727") failed: Property not found. retry in 1.379926039s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ddcb991a-c8a0-472d-a34d-1dcd46abb727
12082024-04-03T10:09:35.777ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c0d8975f-0e34-474b-a84c-10dd693605b9") failed: Property not found. retry in 1.329066225s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c0d8975f-0e34-474b-a84c-10dd693605b9
12092024-04-03T10:09:35.784ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e26e39ef-02c9-4887-939e-4ec196eb3ce0") failed: Property not found. retry in 1.052147111s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e26e39ef-02c9-4887-939e-4ec196eb3ce0
12102024-04-03T10:09:35.968ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c0f8db76-0c38-4867-b869-53c2384889d1") failed: Property not found. retry in 944.843937ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c0f8db76-0c38-4867-b869-53c2384889d1
12112024-04-03T10:09:35.978ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ad48337a-add3-4214-9d0f-f8db41e43622") failed: Property not found. retry in 1.166516013s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ad48337a-add3-4214-9d0f-f8db41e43622
12122024-04-03T10:09:36.010ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_df36c634-5f4d-4fe1-987c-2dbd6a1ad52a") failed: Property not found. retry in 657.879561ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_df36c634-5f4d-4fe1-987c-2dbd6a1ad52a
12132024-04-03T10:09:36.025ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_2fbdcbcd-ff1b-4375-856b-f7f3530b0e63") failed: Property not found. retry in 1.172493029s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_2fbdcbcd-ff1b-4375-856b-f7f3530b0e63
12142024-04-03T10:09:36.097ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a530ec6b-c8ab-4990-a9b9-f6bb7be02742") failed: Property not found. retry in 1.14848417s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a530ec6b-c8ab-4990-a9b9-f6bb7be02742
12152024-04-03T10:09:36.122ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_397924c0-2b87-42bd-adce-1a37f31bd063") failed: Property not found. retry in 1.134195402s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_397924c0-2b87-42bd-adce-1a37f31bd063
12162024-04-03T10:09:36.291ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c4d3bf20-ae50-40b6-af25-d9a472abc430") failed: Property not found. retry in 1.091133791s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c4d3bf20-ae50-40b6-af25-d9a472abc430
12172024-04-03T10:09:36.305ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_61c01227-a384-41a8-bc59-455062631a0d") failed: Property not found. retry in 577.494114ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_61c01227-a384-41a8-bc59-455062631a0d
12182024-04-03T10:09:36.377ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eff9cae2-d3de-4f90-b501-6553b5ad9c11") failed: Property not found. retry in 808.539831ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eff9cae2-d3de-4f90-b501-6553b5ad9c11
12192024-04-03T10:09:36.392ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f8615f1a-8ae7-4cc1-96a8-b7e86d5a6767") failed: Property not found. retry in 547.408618ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f8615f1a-8ae7-4cc1-96a8-b7e86d5a6767
12202024-04-03T10:09:36.426ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_da41d7a4-e925-4040-b523-178b3850bd7c") failed: Property not found. retry in 1.072119148s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_da41d7a4-e925-4040-b523-178b3850bd7c
12212024-04-03T10:09:36.563ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_80bb8934-38d8-48bc-aa7e-eea4a490a555") failed: Property not found. retry in 877.327092ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_80bb8934-38d8-48bc-aa7e-eea4a490a555
12222024-04-03T10:09:36.582ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_498d9e47-b1b3-4a91-a9ab-1b36877185b9") failed: Property not found. retry in 718.556942ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_498d9e47-b1b3-4a91-a9ab-1b36877185b9
12232024-04-03T10:09:36.616ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e35963e6-a05d-4aaa-a3e2-d78509c59004") failed: Property not found. retry in 985.499072ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e35963e6-a05d-4aaa-a3e2-d78509c59004
12242024-04-03T10:09:36.677ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_df36c634-5f4d-4fe1-987c-2dbd6a1ad52a") failed: Property not found. retry in 1.033629669s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_df36c634-5f4d-4fe1-987c-2dbd6a1ad52a
12252024-04-03T10:09:36.845ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e26e39ef-02c9-4887-939e-4ec196eb3ce0") failed: Property not found. retry in 817.2079ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e26e39ef-02c9-4887-939e-4ec196eb3ce0
12262024-04-03T10:09:36.892ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_61c01227-a384-41a8-bc59-455062631a0d") failed: Property not found. retry in 1.10967978s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_61c01227-a384-41a8-bc59-455062631a0d
12272024-04-03T10:09:36.921ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c0f8db76-0c38-4867-b869-53c2384889d1") failed: Property not found. retry in 1.248786261s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c0f8db76-0c38-4867-b869-53c2384889d1
12282024-04-03T10:09:36.948ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f8615f1a-8ae7-4cc1-96a8-b7e86d5a6767") failed: Property not found. retry in 1.486121994s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f8615f1a-8ae7-4cc1-96a8-b7e86d5a6767
12292024-04-03T10:09:37.036ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e53f8ac5-d09d-406d-9a03-3edf1a9aecce") failed: Property not found. retry in 635.868775ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e53f8ac5-d09d-406d-9a03-3edf1a9aecce
12302024-04-03T10:09:37.115ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c0d8975f-0e34-474b-a84c-10dd693605b9") failed: Property not found. retry in 765.875611ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c0d8975f-0e34-474b-a84c-10dd693605b9
12312024-04-03T10:09:37.124ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_adc64792-b7f1-4498-a95d-8e860b5867bf") failed: Property not found. retry in 1.392509581s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_adc64792-b7f1-4498-a95d-8e860b5867bf
12322024-04-03T10:09:37.151ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ddcb991a-c8a0-472d-a34d-1dcd46abb727") failed: Property not found. retry in 1.023322105s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ddcb991a-c8a0-472d-a34d-1dcd46abb727
12332024-04-03T10:09:37.159ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ad48337a-add3-4214-9d0f-f8db41e43622") failed: Property not found. retry in 1.1229868s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ad48337a-add3-4214-9d0f-f8db41e43622
12342024-04-03T10:09:37.195ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eff9cae2-d3de-4f90-b501-6553b5ad9c11") failed: Property not found. retry in 1.027097963s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eff9cae2-d3de-4f90-b501-6553b5ad9c11
12352024-04-03T10:09:37.208ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_2fbdcbcd-ff1b-4375-856b-f7f3530b0e63") failed: Property not found. retry in 1.248765393s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_2fbdcbcd-ff1b-4375-856b-f7f3530b0e63
12362024-04-03T10:09:37.255ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a530ec6b-c8ab-4990-a9b9-f6bb7be02742") failed: Property not found. retry in 918.806923ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a530ec6b-c8ab-4990-a9b9-f6bb7be02742
12372024-04-03T10:09:37.264ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_397924c0-2b87-42bd-adce-1a37f31bd063") failed: Property not found. retry in 747.028756ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_397924c0-2b87-42bd-adce-1a37f31bd063
12382024-04-03T10:09:37.309ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_498d9e47-b1b3-4a91-a9ab-1b36877185b9") failed: Property not found. retry in 825.288727ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_498d9e47-b1b3-4a91-a9ab-1b36877185b9
12392024-04-03T10:09:37.392ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c4d3bf20-ae50-40b6-af25-d9a472abc430") failed: Property not found. retry in 599.909645ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c4d3bf20-ae50-40b6-af25-d9a472abc430
12402024-04-03T10:09:37.510ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_da41d7a4-e925-4040-b523-178b3850bd7c") failed: Property not found. retry in 995.18953ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_da41d7a4-e925-4040-b523-178b3850bd7c
12412024-04-03T10:09:37.613ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e35963e6-a05d-4aaa-a3e2-d78509c59004") failed: Property not found. retry in 1.039160836s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e35963e6-a05d-4aaa-a3e2-d78509c59004
12422024-04-03T10:09:37.688ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e53f8ac5-d09d-406d-9a03-3edf1a9aecce") failed: Property not found. retry in 619.81317ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e53f8ac5-d09d-406d-9a03-3edf1a9aecce
12432024-04-03T10:09:37.721ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_df36c634-5f4d-4fe1-987c-2dbd6a1ad52a") failed: Property not found. retry in 1.207104367s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_df36c634-5f4d-4fe1-987c-2dbd6a1ad52a
12442024-04-03T10:09:37.891ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c0d8975f-0e34-474b-a84c-10dd693605b9") failed: Property not found. retry in 916.227224ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c0d8975f-0e34-474b-a84c-10dd693605b9
12452024-04-03T10:09:38.003ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c4d3bf20-ae50-40b6-af25-d9a472abc430") failed: Property not found. retry in 832.625217ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c4d3bf20-ae50-40b6-af25-d9a472abc430
12462024-04-03T10:09:38.014ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_61c01227-a384-41a8-bc59-455062631a0d") failed: Property not found. retry in 1.061100498s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_61c01227-a384-41a8-bc59-455062631a0d
12472024-04-03T10:09:38.023ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_397924c0-2b87-42bd-adce-1a37f31bd063") failed: Property not found. retry in 821.898125ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_397924c0-2b87-42bd-adce-1a37f31bd063
12482024-04-03T10:09:38.146ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_498d9e47-b1b3-4a91-a9ab-1b36877185b9") failed: Property not found. retry in 1.287665818s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_498d9e47-b1b3-4a91-a9ab-1b36877185b9
12492024-04-03T10:09:38.180ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c0f8db76-0c38-4867-b869-53c2384889d1") failed: Property not found. retry in 1.400246583s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c0f8db76-0c38-4867-b869-53c2384889d1
12502024-04-03T10:09:38.188ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a530ec6b-c8ab-4990-a9b9-f6bb7be02742") failed: Property not found. retry in 743.697111ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a530ec6b-c8ab-4990-a9b9-f6bb7be02742
12512024-04-03T10:09:38.230ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eff9cae2-d3de-4f90-b501-6553b5ad9c11") failed: Property not found. retry in 709.5102ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eff9cae2-d3de-4f90-b501-6553b5ad9c11
12522024-04-03T10:09:38.294ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ad48337a-add3-4214-9d0f-f8db41e43622") failed: Property not found. retry in 1.201853446s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ad48337a-add3-4214-9d0f-f8db41e43622
12532024-04-03T10:09:38.318ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e53f8ac5-d09d-406d-9a03-3edf1a9aecce") failed: Property not found. retry in 975.159085ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e53f8ac5-d09d-406d-9a03-3edf1a9aecce
12542024-04-03T10:09:39.444ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_498d9e47-b1b3-4a91-a9ab-1b36877185b9") failed: Property not found. retry in 583.125052ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_498d9e47-b1b3-4a91-a9ab-1b36877185b9
12552024-04-03T10:09:40.041ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_498d9e47-b1b3-4a91-a9ab-1b36877185b9") failed: Property not found. retry in 609.391626ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_498d9e47-b1b3-4a91-a9ab-1b36877185b9
12562024-04-03T10:09:40.687ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2997 zone = oxz_crucible_df36c634-5f4d-4fe1-987c-2dbd6a1ad52a
12572024-04-03T10:09:40.687ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2997 zone = oxz_crucible_pantry_80bb8934-38d8-48bc-aa7e-eea4a490a555
12582024-04-03T10:09:40.687ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2997 zone = oxz_crucible_c4d3bf20-ae50-40b6-af25-d9a472abc430
12592024-04-03T10:09:40.687ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2997 zone = oxz_crucible_da41d7a4-e925-4040-b523-178b3850bd7c
12602024-04-03T10:09:40.687ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2997 zone = oxz_crucible_a530ec6b-c8ab-4990-a9b9-f6bb7be02742
12612024-04-03T10:09:40.687ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2997 zone = oxz_nexus_e35963e6-a05d-4aaa-a3e2-d78509c59004
12622024-04-03T10:09:40.687ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2997 zone = oxz_crucible_ddcb991a-c8a0-472d-a34d-1dcd46abb727
12632024-04-03T10:09:40.687ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2997 zone = oxz_crucible_c0d8975f-0e34-474b-a84c-10dd693605b9
12642024-04-03T10:09:40.687ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2997 zone = oxz_external_dns_2fbdcbcd-ff1b-4375-856b-f7f3530b0e63
12652024-04-03T10:09:40.687ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2997 zone = oxz_nexus_adc64792-b7f1-4498-a95d-8e860b5867bf
12662024-04-03T10:09:40.687ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2997 zone = oxz_oximeter_eff9cae2-d3de-4f90-b501-6553b5ad9c11
12672024-04-03T10:09:40.687ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2997 zone = oxz_clickhouse_498d9e47-b1b3-4a91-a9ab-1b36877185b9
12682024-04-03T10:09:40.687ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2997 zone = oxz_crucible_pantry_61c01227-a384-41a8-bc59-455062631a0d
12692024-04-03T10:09:40.687ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2997 zone = oxz_crucible_pantry_e26e39ef-02c9-4887-939e-4ec196eb3ce0
12702024-04-03T10:09:40.687ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2997 zone = oxz_crucible_e53f8ac5-d09d-406d-9a03-3edf1a9aecce
12712024-04-03T10:09:40.687ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2997 zone = oxz_crucible_f8615f1a-8ae7-4cc1-96a8-b7e86d5a6767
12722024-04-03T10:09:40.687ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2997 zone = oxz_external_dns_ad48337a-add3-4214-9d0f-f8db41e43622
12732024-04-03T10:09:40.687ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2997 zone = oxz_crucible_397924c0-2b87-42bd-adce-1a37f31bd063
12742024-04-03T10:09:40.687ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2997 zone = oxz_nexus_c0f8db76-0c38-4867-b869-53c2384889d1
12752024-04-03T10:09:40.688ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/01c49d73-3192-415f-8980-20cd04381a9e/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
12762024-04-03T10:09:40.693ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/65806d03-995e-4ce6-8ef1-b0fb41706a5a/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
12772024-04-03T10:09:40.717ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 32500808 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:40271 req_id = b9724ac2-9c1f-4bdb-97f1-cc6be2c5dba7 response_code = 204 uri = /omicron-zones
12782024-04-03T10:09:40.732ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1230
12792024-04-03T10:09:40.733ZINFOSledAgent (RSS): Writing ledger to /pool/int/01c49d73-3192-415f-8980-20cd04381a9e/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
12802024-04-03T10:09:40.733ZINFOSledAgent (RSS): Writing ledger to /pool/int/65806d03-995e-4ce6-8ef1-b0fb41706a5a/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
12812024-04-03T10:09:40.752ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:677
12822024-04-03T10:09:40.753ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::b]:12221 file = sled-agent/src/rack_setup/service.rs:685
12832024-04-03T10:09:40.815ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV1 { bfd: [], bgp: [], infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV1 { addresses: [ V4( Ipv4Network { addr: 10.151.1.174, prefix: 24, }, ), ], autoneg: false, bgp_peers: [], port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Network { addr: 0.0.0.0, prefix: 0, }, ), nexthop: 10.151.1.100, }, ], switch: Switch0, uplink_port_fec: None, uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56, }, } file = sled-agent/src/rack_setup/service.rs:816
12842024-04-03T10:09:44.220ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/b85ae885-2925-429b-842f-b57ce9e9b6a0/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:873
12852024-04-03T10:09:44.312ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/b85ae885-2925-429b-842f-b57ce9e9b6a0/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:873
12862024-04-03T10:09:44.388ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/b85ae885-2925-429b-842f-b57ce9e9b6a0/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:873
12872024-04-03T10:09:44.514ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/b85ae885-2925-429b-842f-b57ce9e9b6a0/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:873
12882024-04-03T10:09:44.748ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/b85ae885-2925-429b-842f-b57ce9e9b6a0/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:873
12892024-04-03T10:09:44.888ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/b85ae885-2925-429b-842f-b57ce9e9b6a0/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:873
12902024-04-03T10:09:45.107ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/b85ae885-2925-429b-842f-b57ce9e9b6a0/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:873
12912024-04-03T10:09:45.339ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/b85ae885-2925-429b-842f-b57ce9e9b6a0/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:873
12922024-04-03T10:09:45.549ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/b85ae885-2925-429b-842f-b57ce9e9b6a0/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:873
12932024-04-03T10:09:46.140ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/b85ae885-2925-429b-842f-b57ce9e9b6a0/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:873
12942024-04-03T10:09:46.561ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/b85ae885-2925-429b-842f-b57ce9e9b6a0/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:873
12952024-04-03T10:09:47.446ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/b85ae885-2925-429b-842f-b57ce9e9b6a0/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:873
12962024-04-03T10:09:48.152ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/b85ae885-2925-429b-842f-b57ce9e9b6a0/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:873
12972024-04-03T10:09:49.410ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/b85ae885-2925-429b-842f-b57ce9e9b6a0/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:873
12982024-04-03T10:09:50.446ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/b85ae885-2925-429b-842f-b57ce9e9b6a0/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:873
12992024-04-03T10:09:51.908ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/b85ae885-2925-429b-842f-b57ce9e9b6a0/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:873
13002024-04-03T10:09:52.977ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36806
13012024-04-03T10:09:52.985ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 1217 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36806 req_id = 30653b67-6e20-45b8-8451-6b88785b6e30 response_code = 200 uri = /baseboard
13022024-04-03T10:09:53.549ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/b85ae885-2925-429b-842f-b57ce9e9b6a0/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:873
13032024-04-03T10:09:56.477ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "559d6627-672f-4809-b513-080a415ee422", "content-length": "124", "date": "Wed, 03 Apr 2024 10:09:56 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "559d6627-672f-4809-b513-080a415ee422" } file = sled-agent/src/rack_setup/service.rs:873
13042024-04-03T10:09:59.831ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "34981bbf-f77e-41dc-b74d-c9943bc5bdee", "content-length": "124", "date": "Wed, 03 Apr 2024 10:09:59 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "34981bbf-f77e-41dc-b74d-c9943bc5bdee" } file = sled-agent/src/rack_setup/service.rs:873
13052024-04-03T10:10:03.001ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "f3724a48-cf6a-441e-b7b1-c14a32ebfbb8", "content-length": "124", "date": "Wed, 03 Apr 2024 10:10:03 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "f3724a48-cf6a-441e-b7b1-c14a32ebfbb8" } file = sled-agent/src/rack_setup/service.rs:873
13062024-04-03T10:10:04.882ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "75b0f29c-0bdf-484d-abeb-087ed2af4e79", "content-length": "124", "date": "Wed, 03 Apr 2024 10:10:04 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "75b0f29c-0bdf-484d-abeb-087ed2af4e79" } file = sled-agent/src/rack_setup/service.rs:873
13072024-04-03T10:10:09.609ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "2b82ccf7-bc49-4cd0-9438-36c329075450", "content-length": "124", "date": "Wed, 03 Apr 2024 10:10:09 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "2b82ccf7-bc49-4cd0-9438-36c329075450" } file = sled-agent/src/rack_setup/service.rs:873
13082024-04-03T10:10:13.296ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "3aa0705e-44f1-4be5-b355-2bfaeacf189e", "content-length": "124", "date": "Wed, 03 Apr 2024 10:10:13 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "3aa0705e-44f1-4be5-b355-2bfaeacf189e" } file = sled-agent/src/rack_setup/service.rs:873
13092024-04-03T10:10:18.966ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "bc254d5b-726b-4907-b2d7-13d3c9381c92", "content-length": "124", "date": "Wed, 03 Apr 2024 10:10:18 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "bc254d5b-726b-4907-b2d7-13d3c9381c92" } file = sled-agent/src/rack_setup/service.rs:873
13102024-04-03T10:10:20.894ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:592 new_generation = 1 old_generation = 1 sled_id = aa5c4df3-cd22-4b16-be8c-4ae0b07c237e
13112024-04-03T10:10:23.021ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:51617
13122024-04-03T10:10:23.021ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 46 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:51617 req_id = f476477d-9196-4f1e-8561-7ca79d19db09 response_code = 200 uri = /baseboard
13132024-04-03T10:10:24.603ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54882
13142024-04-03T10:10:24.607ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 3964 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54882 req_id = 9e68ff5b-3d98-4a63-a6ef-6dc310251766 response_code = 200 uri = /network-bootstore-config
13152024-04-03T10:10:25.469ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44115
13162024-04-03T10:10:25.474ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:525 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 29c3cb1c-6a3c-4abd-8bb7-8bea59f6be3d, kind: Service { id: ad48337a-add3-4214-9d0f-f8db41e43622 }, name: Name("external-dns-ad48337a-add3-4214-9d0f-f8db41e43622"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 146])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.1.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: ca540654-e6f9-4b30-91a7-31a69dccc214, kind: Service { id: 2fbdcbcd-ff1b-4375-856b-f7f3530b0e63 }, name: Name("external-dns-2fbdcbcd-ff1b-4375-856b-f7f3530b0e63"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 171, 128])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.1.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a247066b-a5a9-4604-ac40-d39a30123e5d, kind: Service { id: adc64792-b7f1-4498-a95d-8e860b5867bf }, name: Name("nexus-adc64792-b7f1-4498-a95d-8e860b5867bf"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 158])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: e7200b46-4b53-4370-a961-3eb08273ac04, kind: Service { id: e35963e6-a05d-4aaa-a3e2-d78509c59004 }, name: Name("nexus-e35963e6-a05d-4aaa-a3e2-d78509c59004"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 252, 19])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: fd90c162-dbc9-42fc-9e1c-4bc8ada50b0d, kind: Service { id: c0f8db76-0c38-4867-b869-53c2384889d1 }, name: Name("nexus-c0f8db76-0c38-4867-b869-53c2384889d1"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 191])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
13172024-04-03T10:10:25.474ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
13182024-04-03T10:10:25.474ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
13192024-04-03T10:10:25.474ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte0" rules = []
13202024-04-03T10:10:25.474ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
13212024-04-03T10:10:25.474ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
13222024-04-03T10:10:25.474ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
13232024-04-03T10:10:25.475ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 5033 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44115 req_id = 52ba902b-3f2b-4436-8977-f3abd70953e7 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
13242024-04-03T10:10:25.476ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:883
13252024-04-03T10:10:25.776ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40190
13262024-04-03T10:10:25.777ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
13272024-04-03T10:10:25.863ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 87397 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40190 req_id = d0790279-e63d-4041-918b-32cfca894873 response_code = 200 uri = /inventory
13282024-04-03T10:10:25.863ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
13292024-04-03T10:10:25.864ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/01c49d73-3192-415f-8980-20cd04381a9e/config/omicron-zones.json file = common/src/ledger.rs:177
13302024-04-03T10:10:25.867ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/65806d03-995e-4ce6-8ef1-b0fb41706a5a/config/omicron-zones.json file = common/src/ledger.rs:177
13312024-04-03T10:10:25.869ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 5092 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40190 req_id = 87b4eb68-732d-4239-a387-f1bea234609d response_code = 200 uri = /omicron-zones
13322024-04-03T10:10:50.217ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::d]:42261
13332024-04-03T10:10:50.221ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 3782 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::d]:42261 req_id = 443f610a-d404-4fb9-9dcf-66c4f089ef22 response_code = 200 uri = /metrics/collect/aa5c4df3-cd22-4b16-be8c-4ae0b07c237e
13342024-04-03T10:10:53.055ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42237
13352024-04-03T10:10:53.055ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 60 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42237 req_id = 2dcda4af-79d0-4408-a83b-401382745050 response_code = 200 uri = /baseboard
13362024-04-03T10:10:54.642ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58117
13372024-04-03T10:10:54.750ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 108102 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:58117 req_id = ae68faa1-0f4f-41cd-bf75-8de978b196d0 response_code = 204 uri = /switch-ports
13382024-04-03T10:10:54.750ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50625
13392024-04-03T10:10:54.808ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 58207 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:50625 req_id = 4d5c4840-9b69-45ee-a41c-d9cadea0c554 response_code = 204 uri = /switch-ports
13402024-04-03T10:10:54.809ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 735 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58117 req_id = 71cc388a-bdcd-4f63-a17b-534970ab1af0 response_code = 200 uri = /network-bootstore-config
13412024-04-03T10:10:54.809ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50625 req_id = 16430fde-863c-462c-951f-c8882f51c75b response_code = 200 uri = /network-bootstore-config
13422024-04-03T10:10:54.827ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40954
13432024-04-03T10:10:54.876ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 49476 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:40954 req_id = 4568fdc8-2cd5-4d78-a37a-1c89297ffc41 response_code = 204 uri = /switch-ports
13442024-04-03T10:10:54.877ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 176 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40954 req_id = 36077dd8-0c5f-40e4-bd29-658611b2f102 response_code = 200 uri = /network-bootstore-config
13452024-04-03T10:10:54.877ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
13462024-04-03T10:10:54.881ZINFOSledAgent (bootstore): Writing ledger to /pool/int/01c49d73-3192-415f-8980-20cd04381a9e/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
13472024-04-03T10:10:54.884ZINFOSledAgent (bootstore): Writing ledger to /pool/int/65806d03-995e-4ce6-8ef1-b0fb41706a5a/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
13482024-04-03T10:10:54.885ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
13492024-04-03T10:10:54.885ZINFOSledAgent (bootstore): Attempting to update network config with generation: 3, current_generation: 2 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
13502024-04-03T10:10:54.885ZINFOSledAgent (bootstore): Writing ledger to /pool/int/01c49d73-3192-415f-8980-20cd04381a9e/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
13512024-04-03T10:10:54.885ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 8634 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50625 req_id = f8ae70eb-186a-4f78-9207-6b4becfcea6a response_code = 204 uri = /network-bootstore-config
13522024-04-03T10:10:54.885ZINFOSledAgent (bootstore): Writing ledger to /pool/int/65806d03-995e-4ce6-8ef1-b0fb41706a5a/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
13532024-04-03T10:10:54.885ZINFOSledAgent (bootstore): Broadcasting network config with generation 3 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
13542024-04-03T10:10:54.885ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 9004 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58117 req_id = 46732ec2-3933-4317-945c-38fc3eee86cc response_code = 204 uri = /network-bootstore-config
13552024-04-03T10:10:54.889ZINFOSledAgent (bootstore): Attempting to update network config with generation: 4, current_generation: 3 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
13562024-04-03T10:10:54.889ZINFOSledAgent (bootstore): Writing ledger to /pool/int/01c49d73-3192-415f-8980-20cd04381a9e/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
13572024-04-03T10:10:54.889ZINFOSledAgent (bootstore): Writing ledger to /pool/int/65806d03-995e-4ce6-8ef1-b0fb41706a5a/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
13582024-04-03T10:10:54.889ZINFOSledAgent (bootstore): Broadcasting network config with generation 4 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
13592024-04-03T10:10:54.889ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 470 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40954 req_id = a70236ff-b236-4968-bd90-950a56d9b32a response_code = 204 uri = /network-bootstore-config
13602024-04-03T10:11:20.218ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 1370 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::d]:42261 req_id = 2f2eca8d-a976-4187-b753-eb6c7a26ef9c response_code = 200 uri = /metrics/collect/aa5c4df3-cd22-4b16-be8c-4ae0b07c237e
13612024-04-03T10:11:23.089ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53700
13622024-04-03T10:11:23.089ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 71 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53700 req_id = 71231e98-b140-4d89-a2c5-8ba6d89b7259 response_code = 200 uri = /baseboard
13632024-04-03T10:11:24.335ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33198
13642024-04-03T10:11:24.381ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 46010 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:33198 req_id = 23850f51-38e0-4008-b634-9f49c4464450 response_code = 204 uri = /switch-ports
13652024-04-03T10:11:24.381ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33198 req_id = f8593762-97cb-4eae-a0e6-1b258dd3015d response_code = 200 uri = /network-bootstore-config
13662024-04-03T10:11:24.393ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53272
13672024-04-03T10:11:24.439ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 45435 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:53272 req_id = b70f5381-ca76-4f8b-b972-3e6246488ae3 response_code = 204 uri = /switch-ports
13682024-04-03T10:11:24.439ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37339
13692024-04-03T10:11:24.443ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 3866 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53272 req_id = 25be7adf-3920-47eb-9fa6-874f643a244d response_code = 200 uri = /network-bootstore-config
13702024-04-03T10:11:24.490ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 51086 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:37339 req_id = e99e3f57-25db-4517-ae7a-3efe2e9a8200 response_code = 204 uri = /switch-ports
13712024-04-03T10:11:24.491ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37339 req_id = 9db1fb0d-89f9-4680-b82d-618f284ecd82 response_code = 200 uri = /network-bootstore-config
13722024-04-03T10:11:50.218ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 743 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::d]:42261 req_id = 899d4f9d-a2b3-4c0e-80bf-4ca0e765b12a response_code = 200 uri = /metrics/collect/aa5c4df3-cd22-4b16-be8c-4ae0b07c237e
13732024-04-03T10:11:53.123ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58038
13742024-04-03T10:11:53.123ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 61 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58038 req_id = b9b07256-7b8e-4ab9-8498-51f3fb8dbf17 response_code = 200 uri = /baseboard
13752024-04-03T10:11:54.495ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44019
13762024-04-03T10:11:54.544ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 48956 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:44019 req_id = 4a4059cb-a504-4689-ad9c-2c942b79aba8 response_code = 204 uri = /switch-ports
13772024-04-03T10:11:54.545ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 770 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44019 req_id = 6968663a-f546-4ddb-981b-817d83dd2cc6 response_code = 200 uri = /network-bootstore-config
13782024-04-03T10:11:54.579ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45113
13792024-04-03T10:11:54.628ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 48413 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:45113 req_id = f3714175-3863-40f9-a67e-eed09676aca3 response_code = 204 uri = /switch-ports
13802024-04-03T10:11:54.628ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57724
13812024-04-03T10:11:54.673ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 45430 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:57724 req_id = 7082c7f7-ba4a-4fc9-b45e-cf7b6a8b900c response_code = 204 uri = /switch-ports
13822024-04-03T10:11:54.674ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45113 req_id = 0e2b3cbc-d3f0-4177-bb45-76709e75609b response_code = 200 uri = /network-bootstore-config
13832024-04-03T10:11:54.674ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57724 req_id = 9fc66554-4cba-43e3-9cb4-c494e20d7362 response_code = 200 uri = /network-bootstore-config
13842024-04-03T10:12:20.219ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 696 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::d]:42261 req_id = 5b74e947-488d-4f2f-9e64-b95b1cb59e09 response_code = 200 uri = /metrics/collect/aa5c4df3-cd22-4b16-be8c-4ae0b07c237e
13852024-04-03T10:12:23.157ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49822
13862024-04-03T10:12:23.157ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 90 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49822 req_id = 59242e80-99d2-4170-93f5-4d8557f1d865 response_code = 200 uri = /baseboard
13872024-04-03T10:12:24.315ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65166
13882024-04-03T10:12:24.361ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 46298 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:65166 req_id = a4e00a3a-e79e-4213-9cc1-3c32d8bcae80 response_code = 204 uri = /switch-ports
13892024-04-03T10:12:24.361ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60956
13902024-04-03T10:12:24.364ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 2748 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65166 req_id = cebee60b-fbfc-4b0e-ae34-09647ddfac10 response_code = 200 uri = /network-bootstore-config
13912024-04-03T10:12:24.407ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 45815 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:60956 req_id = 17ce28f5-2abe-4234-9ee5-fbb068c5e9ef response_code = 204 uri = /switch-ports
13922024-04-03T10:12:24.407ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60956 req_id = fbbe45fb-1c62-4848-96bc-92e1e02a7b4b response_code = 200 uri = /network-bootstore-config
13932024-04-03T10:12:24.415ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55584
13942024-04-03T10:12:24.460ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 44530 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:55584 req_id = 17a12817-71f5-4a35-a2f1-0fe5a0dac011 response_code = 204 uri = /switch-ports
13952024-04-03T10:12:24.460ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55584 req_id = 3cc30e5e-8d0e-4ec9-8cad-5392d39189e5 response_code = 200 uri = /network-bootstore-config
13962024-04-03T10:12:38.148ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:801
13972024-04-03T10:12:50.220ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 1499 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::d]:42261 req_id = 26853139-cd2e-42f1-9ce2-028b28bb5a56 response_code = 200 uri = /metrics/collect/aa5c4df3-cd22-4b16-be8c-4ae0b07c237e
13982024-04-03T10:12:53.190ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58137
13992024-04-03T10:12:53.190ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 60 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58137 req_id = 7eae636b-faac-4e96-bd20-9cccc28c14a2 response_code = 200 uri = /baseboard
14002024-04-03T10:12:54.512ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43978
14012024-04-03T10:12:54.561ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 48637 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:43978 req_id = 37ce3621-a10e-48a1-9f0d-344757a0cd35 response_code = 204 uri = /switch-ports
14022024-04-03T10:12:54.561ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37584
14032024-04-03T10:12:54.606ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 45563 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:37584 req_id = eb93948b-cfd1-4620-a978-7d8d5bd64af0 response_code = 204 uri = /switch-ports
14042024-04-03T10:12:54.607ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43978 req_id = f7254b7a-a358-4abf-b090-374b8e5fc247 response_code = 200 uri = /network-bootstore-config
14052024-04-03T10:12:54.607ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37584 req_id = 2e10c948-9212-40eb-8528-f69eca6b418d response_code = 200 uri = /network-bootstore-config
14062024-04-03T10:12:54.774ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48571
14072024-04-03T10:12:54.822ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 47719 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:48571 req_id = 79d8fd3d-f7e8-4a0e-a1d0-368d6ddeccf7 response_code = 204 uri = /switch-ports
14082024-04-03T10:12:54.823ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 725 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48571 req_id = 88c4c45c-f01c-4056-8314-5aa011e526fd response_code = 200 uri = /network-bootstore-config
14092024-04-03T10:13:20.220ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 489 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::d]:42261 req_id = cdbd1b53-6a77-4e17-8a01-45576a81cbfb response_code = 200 uri = /metrics/collect/aa5c4df3-cd22-4b16-be8c-4ae0b07c237e
14102024-04-03T10:13:23.223ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34422
14112024-04-03T10:13:23.223ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 84 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34422 req_id = a26c11a8-ae1e-44d6-a0c5-1a310a79d01e response_code = 200 uri = /baseboard
14122024-04-03T10:13:24.345ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59158
14132024-04-03T10:13:24.394ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 49902 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:59158 req_id = 4f7d44bb-6ba3-43a6-b5d2-6e3bf36a797b response_code = 204 uri = /switch-ports
14142024-04-03T10:13:24.395ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40407
14152024-04-03T10:13:24.398ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 3709 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59158 req_id = 3d648d56-a0bb-4ec0-bbde-a66f3c14bb6d response_code = 200 uri = /network-bootstore-config
14162024-04-03T10:13:24.441ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 46225 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:40407 req_id = c30c53eb-f858-4997-8ae2-fdd73e8c4261 response_code = 204 uri = /switch-ports
14172024-04-03T10:13:24.441ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40407 req_id = 50dddbb7-d366-400c-aa4c-2c8b292f4333 response_code = 200 uri = /network-bootstore-config
14182024-04-03T10:13:24.519ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61376
14192024-04-03T10:13:24.563ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 43268 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:61376 req_id = 08d21235-ecfc-4c55-96c2-00f585a9a6a5 response_code = 204 uri = /switch-ports
14202024-04-03T10:13:24.563ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61376 req_id = 7ddc7b4b-f643-4920-ab7c-96c59ca96816 response_code = 200 uri = /network-bootstore-config
14212024-04-03T10:13:50.220ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 778 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::d]:42261 req_id = 584a0b91-48cb-49d3-8ec2-d34ef87396b4 response_code = 200 uri = /metrics/collect/aa5c4df3-cd22-4b16-be8c-4ae0b07c237e
14222024-04-03T10:13:53.256ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:59131
14232024-04-03T10:13:53.256ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 65 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:59131 req_id = 06a7b6de-4c8c-4a73-837a-6216c9f17c90 response_code = 200 uri = /baseboard
14242024-04-03T10:13:54.472ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47952
14252024-04-03T10:13:54.519ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 46732 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:47952 req_id = a6079fcf-c20f-4b98-a78b-f226ac675db1 response_code = 204 uri = /switch-ports
14262024-04-03T10:13:54.519ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47952 req_id = b815b746-662b-4023-8c8b-f394647caf7e response_code = 200 uri = /network-bootstore-config
14272024-04-03T10:13:54.526ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58572
14282024-04-03T10:13:54.571ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 44803 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:58572 req_id = 5c2c194d-86bc-45af-a54d-fb391f24a722 response_code = 204 uri = /switch-ports
14292024-04-03T10:13:54.572ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 666 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58572 req_id = dd5cded6-857b-4a96-82c7-685c70739f5f response_code = 200 uri = /network-bootstore-config
14302024-04-03T10:13:54.647ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48101
14312024-04-03T10:13:54.692ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 45100 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:48101 req_id = d0216424-5e5f-4cd6-9795-e7d5f2aabc97 response_code = 204 uri = /switch-ports
14322024-04-03T10:13:54.693ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48101 req_id = 520c1069-25f9-45f4-9d41-cb1daa128f7d response_code = 200 uri = /network-bootstore-config
14332024-04-03T10:14:20.220ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 579 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::d]:42261 req_id = cf48fe1f-00ac-4b48-9adc-2a2e86ee85d7 response_code = 200 uri = /metrics/collect/aa5c4df3-cd22-4b16-be8c-4ae0b07c237e
14342024-04-03T10:14:23.289ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42612
14352024-04-03T10:14:23.289ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 92 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42612 req_id = 803d8b25-e7a2-4cd4-8d14-f926c288ca52 response_code = 200 uri = /baseboard
14362024-04-03T10:14:24.348ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62766
14372024-04-03T10:14:24.397ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 49414 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:62766 req_id = 139c9d72-0082-4f7d-a76e-3fabb7afd6b4 response_code = 204 uri = /switch-ports
14382024-04-03T10:14:24.398ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62766 req_id = d1389c4e-37b6-4b0e-aaf6-b61edd811523 response_code = 200 uri = /network-bootstore-config
14392024-04-03T10:14:24.403ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56717
14402024-04-03T10:14:24.452ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 48603 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:56717 req_id = ae843fc6-f00a-469c-a24b-5758bf2fc76d response_code = 204 uri = /switch-ports
14412024-04-03T10:14:24.452ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51871
14422024-04-03T10:14:24.455ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 3206 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56717 req_id = 76ffe1f2-ace5-4977-8b5c-d7bcc0b72259 response_code = 200 uri = /network-bootstore-config
14432024-04-03T10:14:24.499ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 47272 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:51871 req_id = ad8a3171-cca8-488c-b471-5d2a30721912 response_code = 204 uri = /switch-ports
14442024-04-03T10:14:24.500ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51871 req_id = 68b09c4d-312d-45af-af9d-2a934ac24718 response_code = 200 uri = /network-bootstore-config
14452024-04-03T10:14:50.221ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 513 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::d]:42261 req_id = de7ee0b7-d036-4d24-a237-b65ea187714d response_code = 200 uri = /metrics/collect/aa5c4df3-cd22-4b16-be8c-4ae0b07c237e
14462024-04-03T10:14:53.322ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45348
14472024-04-03T10:14:53.322ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 73 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45348 req_id = 61c8b347-dedd-4ffd-abca-4fc4ade0bcbd response_code = 200 uri = /baseboard
14482024-04-03T10:14:54.656ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39933
14492024-04-03T10:14:54.703ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 47826 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:39933 req_id = b5dd9a46-ab0f-4b80-90fe-a2c504eb31ec response_code = 204 uri = /switch-ports
14502024-04-03T10:14:54.704ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56303
14512024-04-03T10:14:54.708ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 4506 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39933 req_id = 55dd58e5-671f-43e4-88a7-7abbe6cf43ac response_code = 200 uri = /network-bootstore-config
14522024-04-03T10:14:54.749ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 44867 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:56303 req_id = 0b679bc4-41f7-4c0c-801c-d0ba76f4241f response_code = 204 uri = /switch-ports
14532024-04-03T10:14:54.749ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56303 req_id = baba7e64-fa49-465b-8c5a-4effaf35ba19 response_code = 200 uri = /network-bootstore-config
14542024-04-03T10:14:55.095ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35435
14552024-04-03T10:14:55.142ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 46681 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:35435 req_id = d9e3b0ae-4563-43e6-a8aa-77d27c71367c response_code = 204 uri = /switch-ports
14562024-04-03T10:14:55.142ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35435 req_id = 3473eaeb-a7eb-4c9e-987d-cdfcd36d0384 response_code = 200 uri = /network-bootstore-config
14572024-04-03T10:15:20.224ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 562 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::d]:42261 req_id = b75a85d5-027a-413d-83f3-962a1237402c response_code = 200 uri = /metrics/collect/aa5c4df3-cd22-4b16-be8c-4ae0b07c237e
14582024-04-03T10:15:23.355ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42434
14592024-04-03T10:15:23.356ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 810 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42434 req_id = 62990ab9-780d-4362-b298-4324f533db55 response_code = 200 uri = /baseboard
14602024-04-03T10:15:24.338ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37310
14612024-04-03T10:15:24.385ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 47585 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:37310 req_id = f08ce1ff-5b9d-4323-aed2-d4cdeac0eb52 response_code = 204 uri = /switch-ports
14622024-04-03T10:15:24.386ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61466
14632024-04-03T10:15:24.389ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 3146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37310 req_id = 5fb50b33-6e46-4bbf-9695-749af59625a0 response_code = 200 uri = /network-bootstore-config
14642024-04-03T10:15:24.429ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 43508 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:61466 req_id = d2d7963e-4445-4366-9e0b-2c2768c1429b response_code = 204 uri = /switch-ports
14652024-04-03T10:15:24.429ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61466 req_id = 840e33aa-b440-49d3-8ea4-b409f15bd369 response_code = 200 uri = /network-bootstore-config
14662024-04-03T10:15:24.434ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40361
14672024-04-03T10:15:24.479ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 44885 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:40361 req_id = 7a39170d-8fe7-48c2-a71a-ee5830d07dec response_code = 204 uri = /switch-ports
14682024-04-03T10:15:24.480ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40361 req_id = a8d2186e-473c-40ea-bd0b-f660b0a98cb9 response_code = 200 uri = /network-bootstore-config
14692024-04-03T10:15:50.221ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 961 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::d]:42261 req_id = f6d3e4ad-3eea-4d70-a257-92b3dd2b73fd response_code = 200 uri = /metrics/collect/aa5c4df3-cd22-4b16-be8c-4ae0b07c237e
14702024-04-03T10:15:53.389ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52224
14712024-04-03T10:15:53.389ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 115 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52224 req_id = 2871dc4c-1680-4a64-8afe-b1e81de4d08d response_code = 200 uri = /baseboard
14722024-04-03T10:15:54.551ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55131
14732024-04-03T10:15:54.600ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 48391 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:55131 req_id = bcbc586f-778f-4ee8-a961-8358684ef2a5 response_code = 204 uri = /switch-ports
14742024-04-03T10:15:54.600ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57810
14752024-04-03T10:15:54.643ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 43486 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:57810 req_id = 8b4a6113-589b-422f-8592-b63f23ea1dd0 response_code = 204 uri = /switch-ports
14762024-04-03T10:15:54.644ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55131 req_id = 33b4d20d-66cd-438f-9b64-d8e1bcf52675 response_code = 200 uri = /network-bootstore-config
14772024-04-03T10:15:54.644ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57810 req_id = b779e39d-9eaa-47a2-9830-f9632add039f response_code = 200 uri = /network-bootstore-config
14782024-04-03T10:15:54.872ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54714
14792024-04-03T10:15:54.918ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 45837 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:54714 req_id = 7eb9ba8a-3785-41b7-8c3a-2555bbad92ff response_code = 204 uri = /switch-ports
14802024-04-03T10:15:54.919ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 639 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54714 req_id = a4172a5f-7d34-465a-aa1c-b4ba79fda5a4 response_code = 200 uri = /network-bootstore-config
14812024-04-03T10:16:13.302ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55802
14822024-04-03T10:16:13.314ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:521 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: de9c8de0-21a8-453a-8aa0-9f8aa1735ae6, kind: Instance { id: dcfb65b0-3e90-4921-8143-9084736c941c }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 248, 181, 143])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.0.0, prefix: 22 })), vni: Vni(7209326), primary: true, slot: 0 }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: de9c8de0-21a8-453a-8aa0-9f8aa1735ae6, kind: Instance { id: dcfb65b0-3e90-4921-8143-9084736c941c }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 248, 181, 143])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.0.0, prefix: 22 })), vni: Vni(7209326), primary: true, slot: 0 }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: de9c8de0-21a8-453a-8aa0-9f8aa1735ae6, kind: Instance { id: dcfb65b0-3e90-4921-8143-9084736c941c }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 248, 181, 143])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.0.0, prefix: 22 })), vni: Vni(7209326), primary: true, slot: 0 }], filter_hosts: Some([Vpc(Vni(7209326))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: de9c8de0-21a8-453a-8aa0-9f8aa1735ae6, kind: Instance { id: dcfb65b0-3e90-4921-8143-9084736c941c }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 248, 181, 143])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.0.0, prefix: 22 })), vni: Vni(7209326), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-c87cb51873d", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: ce54fa62-667a-4353-b346-f9b3e43e9d6f, read_only_parent: Some(Volume { block_size: 512, id: 85248d48-d204-488f-b1cc-eceefd5ef4b0, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 094387f2-7a97-4c88-8630-e4ceb50c6ebb, key: Some("djIPnRwycEChqffwo1TtliBM64kiF07gTDFSi+qrpO8="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::19]:19001", "[fd00:1122:3344:101::14]:19002", "[fd00:1122:3344:101::1a]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: ce54fa62-667a-4353-b346-f9b3e43e9d6f, key: Some("88dfWj4RemkiiVV/HK35H1wSiwt73dBndRUqRS223a8="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::1a]:19002", "[fd00:1122:3344:101::12]:19001", "[fd00:1122:3344:101::15]:19000"] } }] } }], cloud_init_bytes: Some("6zyQTVNXSU40LjEAAgEBAAIAAioA+AEAKgBAAAAAAAAAAAAAAAApeFY0EmNpZGF0YSAgICAgRkFUMTIgICAOH75bfKwiwHQLVrQOuwcAzRBe6/Ay5M0WzRnr/lRoaXMgaXMgbm90IGEgYm9vdGFibGUgZGlzay4gIFBsZWFzZSBpbnNlcnQgYSBib290YWJsZSBmbG9wcHkgYW5kDQpwcmVzcyBhbnkga2V5IHRvIHRyeSBhZ2FpbiAuLi4gDQoAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAVar4////DwAAAAAAAAAA8P//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////D/j///8PAAAAAAAAAADw//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////8PY2lkYXRhICAgICAIAAAAAAAAAAAAAAAAAAAAAAAAAABBbQBlAHQAYQAtAA8A1GQAYQB0AGEAAAD//wAA/////01FVEEtRH4xICAgAAB9BlKDWINYAAAGUoNYAgC3AAAAQXUAcwBlAHIALQAPALBkAGEAdABhAAAA//8AAP////9VU0VSLUR+MSAgIAAAfgZSg1iDWAAABlKDWAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAHsiaW5zdGFuY2UtaWQiOiJkY2ZiNjViMC0zZTkwLTQ5MjEtODE0My05MDg0NzM2Yzk0MWMiLCJsb2NhbC1ob3N0bmFtZSI6ImxvY2Fsc2hhcmsiLCJwdWJsaWMta2V5cyI6WyJzc2gtZWQyNTUxOSBBQUFBQzNOemFDMWxaREkxTlRFNUFBQUFJTTNucTBmZkovWG10TmVLRXJWeGJzaDNsWlpib1A1WDJSbXEwbFFXeDltQSJdfQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA") } instance_id = dcfb65b0-3e90-4921-8143-9084736c941c instance_runtime = InstanceRuntimeState { propolis_id: Some(e21cb395-1e64-4f05-a466-14d49bee1d8d), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-04-03T10:16:12.919029915Z } metadata = InstanceMetadata { silo_id: e7be7de3-b664-4c93-bbb6-1cdb9ebff339, project_id: 6c390333-2f78-457d-9634-18884829e631 } propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = e21cb395-1e64-4f05-a466-14d49bee1d8d vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(1), time_updated: 2024-04-03T10:16:12.891549Z }
14832024-04-03T10:16:13.314ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:555 instance_id = dcfb65b0-3e90-4921-8143-9084736c941c
14842024-04-03T10:16:13.315ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:938 instance_id = dcfb65b0-3e90-4921-8143-9084736c941c propolis_id = e21cb395-1e64-4f05-a466-14d49bee1d8d state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: de9c8de0-21a8-453a-8aa0-9f8aa1735ae6, kind: Instance { id: dcfb65b0-3e90-4921-8143-9084736c941c }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 248, 181, 143])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.0.0, prefix: 22 })), vni: Vni(7209326), primary: true, slot: 0 }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: de9c8de0-21a8-453a-8aa0-9f8aa1735ae6, kind: Instance { id: dcfb65b0-3e90-4921-8143-9084736c941c }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 248, 181, 143])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.0.0, prefix: 22 })), vni: Vni(7209326), primary: true, slot: 0 }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: de9c8de0-21a8-453a-8aa0-9f8aa1735ae6, kind: Instance { id: dcfb65b0-3e90-4921-8143-9084736c941c }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 248, 181, 143])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.0.0, prefix: 22 })), vni: Vni(7209326), primary: true, slot: 0 }], filter_hosts: Some([Vpc(Vni(7209326))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: de9c8de0-21a8-453a-8aa0-9f8aa1735ae6, kind: Instance { id: dcfb65b0-3e90-4921-8143-9084736c941c }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 248, 181, 143])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.0.0, prefix: 22 })), vni: Vni(7209326), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-c87cb51873d", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: ce54fa62-667a-4353-b346-f9b3e43e9d6f, read_only_parent: Some(Volume { block_size: 512, id: 85248d48-d204-488f-b1cc-eceefd5ef4b0, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 094387f2-7a97-4c88-8630-e4ceb50c6ebb, key: Some("djIPnRwycEChqffwo1TtliBM64kiF07gTDFSi+qrpO8="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::19]:19001", "[fd00:1122:3344:101::14]:19002", "[fd00:1122:3344:101::1a]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: ce54fa62-667a-4353-b346-f9b3e43e9d6f, key: Some("88dfWj4RemkiiVV/HK35H1wSiwt73dBndRUqRS223a8="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::1a]:19002", "[fd00:1122:3344:101::12]:19001", "[fd00:1122:3344:101::15]:19000"] } }] } }], cloud_init_bytes: Some("6zyQTVNXSU40LjEAAgEBAAIAAioA+AEAKgBAAAAAAAAAAAAAAAApeFY0EmNpZGF0YSAgICAgRkFUMTIgICAOH75bfKwiwHQLVrQOuwcAzRBe6/Ay5M0WzRnr/lRoaXMgaXMgbm90IGEgYm9vdGFibGUgZGlzay4gIFBsZWFzZSBpbnNlcnQgYSBib290YWJsZSBmbG9wcHkgYW5kDQpwcmVzcyBhbnkga2V5IHRvIHRyeSBhZ2FpbiAuLi4gDQoAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAVar4////DwAAAAAAAAAA8P//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////D/j///8PAAAAAAAAAADw//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////8PY2lkYXRhICAgICAIAAAAAAAAAAAAAAAAAAAAAAAAAABBbQBlAHQAYQAtAA8A1GQAYQB0AGEAAAD//wAA/////01FVEEtRH4xICAgAAB9BlKDWINYAAAGUoNYAgC3AAAAQXUAcwBlAHIALQAPALBkAGEAdABhAAAA//8AAP////9VU0VSLUR+MSAgIAAAfgZSg1iDWAAABlKDWAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAHsiaW5zdGFuY2UtaWQiOiJkY2ZiNjViMC0zZTkwLTQ5MjEtODE0My05MDg0NzM2Yzk0MWMiLCJsb2NhbC1ob3N0bmFtZSI6ImxvY2Fsc2hhcmsiLCJwdWJsaWMta2V5cyI6WyJzc2gtZWQyNTUxOSBBQUFBQzNOemFDMWxaREkxTlRFNUFBQUFJTTNucTBmZkovWG10TmVLRXJWeGJzaDNsWlpib1A1WDJSbXEwbFFXeDltQSJdfQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA") }, instance_runtime: InstanceRuntimeState { propolis_id: Some(e21cb395-1e64-4f05-a466-14d49bee1d8d), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-04-03T10:16:12.919029915Z }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(1), time_updated: 2024-04-03T10:16:12.891549Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400 }
14852024-04-03T10:16:13.316ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 13877 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55802 req_id = 2e28d554-082c-41fb-b341-19cf062ee7c1 response_code = 200 uri = /instances/dcfb65b0-3e90-4921-8143-9084736c941c
14862024-04-03T10:16:13.405ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33027
14872024-04-03T10:16:13.406ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 688 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33027 req_id = 49b3acd7-a887-4a73-82db-43a6821e2c52 response_code = 200 uri = /instances/dcfb65b0-3e90-4921-8143-9084736c941c/state
14882024-04-03T10:16:13.427ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:394 port = Port { inner: PortInner { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 248, 181, 143]), slot: 0, vni: Vni { inner: 7209326 }, gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 }, vnic: "vopte6" } }
14892024-04-03T10:16:13.428ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
14902024-04-03T10:16:13.459ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_e21cb395-1e64-4f05-a466-14d49bee1d8d file = illumos-utils/src/zone.rs:315 instance_id = dcfb65b0-3e90-4921-8143-9084736c941c
14912024-04-03T10:16:13.482ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_e21cb395-1e64-4f05-a466-14d49bee1d8d file = illumos-utils/src/zone.rs:354 instance_id = dcfb65b0-3e90-4921-8143-9084736c941c
14922024-04-03T10:16:15.429ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_e21cb395-1e64-4f05-a466-14d49bee1d8d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlInstance0"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::1:0"/> <propval type="astring" name="listen_port" value="12400"/> <propval type="astring" name="metric_addr" value="[fd00:1122:3344:101::c]:12221"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = dcfb65b0-3e90-4921-8143-9084736c941c
14932024-04-03T10:16:15.429ZINFOSledAgent (InstanceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 instance_id = dcfb65b0-3e90-4921-8143-9084736c941c zone = oxz_propolis-server_e21cb395-1e64-4f05-a466-14d49bee1d8d
14942024-04-03T10:16:15.611ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_e21cb395-1e64-4f05-a466-14d49bee1d8d") failed: Property not found. retry in 40.265429ms file = illumos-utils/src/svc.rs:36 instance_id = dcfb65b0-3e90-4921-8143-9084736c941c zone = oxz_propolis-server_e21cb395-1e64-4f05-a466-14d49bee1d8d
14952024-04-03T10:16:15.660ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_e21cb395-1e64-4f05-a466-14d49bee1d8d") failed: Property not found. retry in 143.341602ms file = illumos-utils/src/svc.rs:36 instance_id = dcfb65b0-3e90-4921-8143-9084736c941c zone = oxz_propolis-server_e21cb395-1e64-4f05-a466-14d49bee1d8d
14962024-04-03T10:16:15.828ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_e21cb395-1e64-4f05-a466-14d49bee1d8d") failed: Property not found. retry in 140.001403ms file = illumos-utils/src/svc.rs:36 instance_id = dcfb65b0-3e90-4921-8143-9084736c941c zone = oxz_propolis-server_e21cb395-1e64-4f05-a466-14d49bee1d8d
14972024-04-03T10:16:15.980ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_e21cb395-1e64-4f05-a466-14d49bee1d8d") failed: Property not found. retry in 334.955105ms file = illumos-utils/src/svc.rs:36 instance_id = dcfb65b0-3e90-4921-8143-9084736c941c zone = oxz_propolis-server_e21cb395-1e64-4f05-a466-14d49bee1d8d
14982024-04-03T10:16:16.325ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_e21cb395-1e64-4f05-a466-14d49bee1d8d") failed: Property not found. retry in 409.216924ms file = illumos-utils/src/svc.rs:36 instance_id = dcfb65b0-3e90-4921-8143-9084736c941c zone = oxz_propolis-server_e21cb395-1e64-4f05-a466-14d49bee1d8d
14992024-04-03T10:16:16.745ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_e21cb395-1e64-4f05-a466-14d49bee1d8d") failed: Property not found. retry in 837.075472ms file = illumos-utils/src/svc.rs:36 instance_id = dcfb65b0-3e90-4921-8143-9084736c941c zone = oxz_propolis-server_e21cb395-1e64-4f05-a466-14d49bee1d8d
15002024-04-03T10:16:17.590ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_e21cb395-1e64-4f05-a466-14d49bee1d8d") failed: Property not found. retry in 1.339496042s file = illumos-utils/src/svc.rs:36 instance_id = dcfb65b0-3e90-4921-8143-9084736c941c zone = oxz_propolis-server_e21cb395-1e64-4f05-a466-14d49bee1d8d
15012024-04-03T10:16:18.940ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_e21cb395-1e64-4f05-a466-14d49bee1d8d") failed: Property not found. retry in 1.469660996s file = illumos-utils/src/svc.rs:36 instance_id = dcfb65b0-3e90-4921-8143-9084736c941c zone = oxz_propolis-server_e21cb395-1e64-4f05-a466-14d49bee1d8d
15022024-04-03T10:16:20.223ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 1008 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::d]:42261 req_id = 6794234a-c014-494b-b6ad-6daa3207150b response_code = 200 uri = /metrics/collect/aa5c4df3-cd22-4b16-be8c-4ae0b07c237e
15032024-04-03T10:16:20.436ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_e21cb395-1e64-4f05-a466-14d49bee1d8d file = sled-agent/src/instance.rs:1423 instance_id = dcfb65b0-3e90-4921-8143-9084736c941c
15042024-04-03T10:16:20.445ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_e21cb395-1e64-4f05-a466-14d49bee1d8d") failed: Property not found. retry in 57.08207ms file = illumos-utils/src/svc.rs:36 instance_id = dcfb65b0-3e90-4921-8143-9084736c941c
15052024-04-03T10:16:20.511ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_e21cb395-1e64-4f05-a466-14d49bee1d8d") failed: Property not found. retry in 100.23987ms file = illumos-utils/src/svc.rs:36 instance_id = dcfb65b0-3e90-4921-8143-9084736c941c
15062024-04-03T10:16:20.622ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_e21cb395-1e64-4f05-a466-14d49bee1d8d") failed: Property not found. retry in 245.933197ms file = illumos-utils/src/svc.rs:36 instance_id = dcfb65b0-3e90-4921-8143-9084736c941c
15072024-04-03T10:16:20.878ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:1432 instance_id = dcfb65b0-3e90-4921-8143-9084736c941c
15082024-04-03T10:16:20.914ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:1446 instance_id = dcfb65b0-3e90-4921-8143-9084736c941c
15092024-04-03T10:16:20.915ZINFOSledAgent (InstanceManager): Sending ensure request to propolis: InstanceEnsureRequest { cloud_init_bytes: Some("6zyQTVNXSU40LjEAAgEBAAIAAioA+AEAKgBAAAAAAAAAAAAAAAApeFY0EmNpZGF0YSAgICAgRkFUMTIgICAOH75bfKwiwHQLVrQOuwcAzRBe6/Ay5M0WzRnr/lRoaXMgaXMgbm90IGEgYm9vdGFibGUgZGlzay4gIFBsZWFzZSBpbnNlcnQgYSBib290YWJsZSBmbG9wcHkgYW5kDQpwcmVzcyBhbnkga2V5IHRvIHRyeSBhZ2FpbiAuLi4gDQoAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAVar4////DwAAAAAAAAAA8P//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////D/j///8PAAAAAAAAAADw//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////8PY2lkYXRhICAgICAIAAAAAAAAAAAAAAAAAAAAAAAAAABBbQBlAHQAYQAtAA8A1GQAYQB0AGEAAAD//wAA/////01FVEEtRH4xICAgAAB9BlKDWINYAAAGUoNYAgC3AAAAQXUAcwBlAHIALQAPALBkAGEAdABhAAAA//8AAP////9VU0VSLUR+MSAgIAAAfgZSg1iDWAAABlKDWAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAHsiaW5zdGFuY2UtaWQiOiJkY2ZiNjViMC0zZTkwLTQ5MjEtODE0My05MDg0NzM2Yzk0MWMiLCJsb2NhbC1ob3N0bmFtZSI6ImxvY2Fsc2hhcmsiLCJwdWJsaWMta2V5cyI6WyJzc2gtZWQyNTUxOSBBQUFBQzNOemFDMWxaREkxTlRFNUFBQUFJTTNucTBmZkovWG10TmVLRXJWeGJzaDNsWlpib1A1WDJSbXEwbFFXeDltQSJdfQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA"), disks: [DiskRequest { device: "nvme", name: "disk-c87cb51873d", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: ce54fa62-667a-4353-b346-f9b3e43e9d6f, read_only_parent: Some(Volume { block_size: 512, id: 85248d48-d204-488f-b1cc-eceefd5ef4b0, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 094387f2-7a97-4c88-8630-e4ceb50c6ebb, key: Some("djIPnRwycEChqffwo1TtliBM64kiF07gTDFSi+qrpO8="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::19]:19001", "[fd00:1122:3344:101::14]:19002", "[fd00:1122:3344:101::1a]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: ce54fa62-667a-4353-b346-f9b3e43e9d6f, key: Some("88dfWj4RemkiiVV/HK35H1wSiwt73dBndRUqRS223a8="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::1a]:19002", "[fd00:1122:3344:101::12]:19001", "[fd00:1122:3344:101::15]:19000"] } }] } }], migrate: None, nics: [NetworkInterfaceRequest { name: "vopte6", slot: Slot(0) }], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Test description", id: dcfb65b0-3e90-4921-8143-9084736c941c, image_id: 00000000-0000-0000-0000-000000000000, memory: 1024, metadata: InstanceMetadata { project_id: 6c390333-2f78-457d-9634-18884829e631, silo_id: e7be7de3-b664-4c93-bbb6-1cdb9ebff339 }, name: "localshark", vcpus: 2 } } file = sled-agent/src/instance.rs:685 instance_id = dcfb65b0-3e90-4921-8143-9084736c941c
15102024-04-03T10:16:21.089ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:687 instance_id = dcfb65b0-3e90-4921-8143-9084736c941c
15112024-04-03T10:16:21.090ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Starting), migration_status: NoMigration, time: 2024-04-03T10:16:21.090119709Z } file = sled-agent/src/instance.rs:569 instance_id = dcfb65b0-3e90-4921-8143-9084736c941c
15122024-04-03T10:16:21.090ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:591 instance_id = dcfb65b0-3e90-4921-8143-9084736c941c new_instance_state = InstanceRuntimeState { propolis_id: Some(e21cb395-1e64-4f05-a466-14d49bee1d8d), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-04-03T10:16:12.919029915Z } new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-04-03T10:16:21.090119709Z } propolis_id = e21cb395-1e64-4f05-a466-14d49bee1d8d
15132024-04-03T10:16:21.090ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:491 instance_id = dcfb65b0-3e90-4921-8143-9084736c941c state = SledInstanceState { instance_state: InstanceRuntimeState { propolis_id: Some(e21cb395-1e64-4f05-a466-14d49bee1d8d), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-04-03T10:16:12.919029915Z }, propolis_id: e21cb395-1e64-4f05-a466-14d49bee1d8d, vmm_state: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-04-03T10:16:21.090119709Z } }
15142024-04-03T10:16:21.130ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_status: NoMigration, time: 2024-04-03T10:16:21.130030608Z } file = sled-agent/src/instance.rs:569 instance_id = dcfb65b0-3e90-4921-8143-9084736c941c
15152024-04-03T10:16:21.130ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:591 instance_id = dcfb65b0-3e90-4921-8143-9084736c941c new_instance_state = InstanceRuntimeState { propolis_id: Some(e21cb395-1e64-4f05-a466-14d49bee1d8d), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-04-03T10:16:12.919029915Z } new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(3), time_updated: 2024-04-03T10:16:21.130030608Z } propolis_id = e21cb395-1e64-4f05-a466-14d49bee1d8d
15162024-04-03T10:16:21.130ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:491 instance_id = dcfb65b0-3e90-4921-8143-9084736c941c state = SledInstanceState { instance_state: InstanceRuntimeState { propolis_id: Some(e21cb395-1e64-4f05-a466-14d49bee1d8d), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-04-03T10:16:12.919029915Z }, propolis_id: e21cb395-1e64-4f05-a466-14d49bee1d8d, vmm_state: VmmRuntimeState { state: Running, gen: Generation(3), time_updated: 2024-04-03T10:16:21.130030608Z } }
15172024-04-03T10:16:23.423ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:39844
15182024-04-03T10:16:23.423ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 49 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:39844 req_id = bc357087-d405-4bc5-9105-2b99aa1da83e response_code = 200 uri = /baseboard
15192024-04-03T10:16:24.339ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41934
15202024-04-03T10:16:24.387ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 48167 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:41934 req_id = 9eda07c6-bbf5-48b0-a7fa-6cc5d436af05 response_code = 204 uri = /switch-ports
15212024-04-03T10:16:24.387ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48374
15222024-04-03T10:16:24.439ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 51682 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48374 req_id = 31b350eb-dae7-4537-b6a7-7476248d7df1 response_code = 204 uri = /switch-ports
15232024-04-03T10:16:24.439ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41934 req_id = d2b29d18-4d89-4b58-8a97-8d82c1704c3e response_code = 200 uri = /network-bootstore-config
15242024-04-03T10:16:24.439ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48374 req_id = 13181fed-8feb-45eb-b98e-4b1a41466ad6 response_code = 200 uri = /network-bootstore-config
15252024-04-03T10:16:24.488ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45887
15262024-04-03T10:16:24.539ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 51115 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:45887 req_id = a490871c-2225-4ae6-8bb2-a25440bb600b response_code = 204 uri = /switch-ports
15272024-04-03T10:16:24.540ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45887 req_id = ad9b59df-c870-41e0-a3fa-9981f21984ac response_code = 200 uri = /network-bootstore-config
15282024-04-03T10:16:30.811ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41719
15292024-04-03T10:16:30.812ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 650 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41719 req_id = 34addc34-5dd2-45a6-b3ab-a6f427fb8d27 response_code = 200 uri = /instances/dcfb65b0-3e90-4921-8143-9084736c941c/state
15302024-04-03T10:16:30.812ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_status: NoMigration, time: 2024-04-03T10:16:30.812279643Z } file = sled-agent/src/instance.rs:569 instance_id = dcfb65b0-3e90-4921-8143-9084736c941c
15312024-04-03T10:16:30.812ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:591 instance_id = dcfb65b0-3e90-4921-8143-9084736c941c new_instance_state = InstanceRuntimeState { propolis_id: Some(e21cb395-1e64-4f05-a466-14d49bee1d8d), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-04-03T10:16:12.919029915Z } new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(5), time_updated: 2024-04-03T10:16:30.812279643Z } propolis_id = e21cb395-1e64-4f05-a466-14d49bee1d8d
15322024-04-03T10:16:30.812ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:491 instance_id = dcfb65b0-3e90-4921-8143-9084736c941c state = SledInstanceState { instance_state: InstanceRuntimeState { propolis_id: Some(e21cb395-1e64-4f05-a466-14d49bee1d8d), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-04-03T10:16:12.919029915Z }, propolis_id: e21cb395-1e64-4f05-a466-14d49bee1d8d, vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(5), time_updated: 2024-04-03T10:16:30.812279643Z } }
15332024-04-03T10:16:30.833ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_status: NoMigration, time: 2024-04-03T10:16:30.833797226Z } file = sled-agent/src/instance.rs:569 instance_id = dcfb65b0-3e90-4921-8143-9084736c941c
15342024-04-03T10:16:30.833ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:591 instance_id = dcfb65b0-3e90-4921-8143-9084736c941c new_instance_state = InstanceRuntimeState { propolis_id: None, dst_propolis_id: None, migration_id: None, gen: Generation(5), time_updated: 2024-04-03T10:16:30.833797226Z } new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(6), time_updated: 2024-04-03T10:16:30.833797226Z } propolis_id = e21cb395-1e64-4f05-a466-14d49bee1d8d
15352024-04-03T10:16:30.833ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:606 instance_id = dcfb65b0-3e90-4921-8143-9084736c941c
15362024-04-03T10:16:30.833ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
15372024-04-03T10:16:30.835ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
15382024-04-03T10:16:30.835ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/01c49d73-3192-415f-8980-20cd04381a9e/debug/bundle/zone", "/pool/int/65806d03-995e-4ce6-8ef1-b0fb41706a5a/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/36614205-9374-49cf-8904-cb3f4aa78846/crypt/debug", "/pool/ext/6b96699f-97d9-48d8-b1c0-05be5951e087/crypt/debug", "/pool/ext/5735529a-b898-4275-88a6-00a9444d8997/crypt/debug", "/pool/ext/4533d42a-5c24-4d2c-8caa-2a74a63c16c3/crypt/debug", "/pool/ext/474bd740-7e4d-443a-9485-0c3e8b3716ec/crypt/debug", "/pool/ext/f14b76c3-7994-4bb4-962a-4f772a3dd8b9/crypt/debug", "/pool/ext/a0234d98-6d13-4518-a6ed-6616f80ec892/crypt/debug", "/pool/ext/5df238e3-5630-4184-a188-36117b1a7b7b/crypt/debug", "/pool/ext/2e47e008-76df-41d9-b268-da990559f786/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:437 zone_name = oxz_propolis-server_e21cb395-1e64-4f05-a466-14d49bee1d8d
15392024-04-03T10:16:31.421ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1236 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_e21cb395-1e64-4f05-a466-14d49bee1d8d", bundle_id: dc43df87-27b3-49ef-941e-3d8e4859842f }, time_created: 2024-04-03T10:16:30.835996866Z, version: 0, cause: TerminatedInstance }
15402024-04-03T10:16:31.421ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_e21cb395-1e64-4f05-a466-14d49bee1d8d file = sled-agent/src/instance.rs:780 instance_id = dcfb65b0-3e90-4921-8143-9084736c941c
15412024-04-03T10:16:33.163ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:269 instance_id = dcfb65b0-3e90-4921-8143-9084736c941c
15422024-04-03T10:16:33.189ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:491 instance_id = dcfb65b0-3e90-4921-8143-9084736c941c state = SledInstanceState { instance_state: InstanceRuntimeState { propolis_id: None, dst_propolis_id: None, migration_id: None, gen: Generation(5), time_updated: 2024-04-03T10:16:30.833797226Z }, propolis_id: e21cb395-1e64-4f05-a466-14d49bee1d8d, vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-04-03T10:16:33.189211960Z } }
15432024-04-03T10:16:33.263ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60644
15442024-04-03T10:16:33.265ZWARNSledAgent (PortManager): unset_virtual_nic_host unimplmented file = illumos-utils/src/opte/port_manager.rs:620
15452024-04-03T10:16:33.265ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 1185 local_addr = [fd00:1122:3344:101::1]:12345 method = DELETE remote_addr = [fd00:1122:3344:101::b]:60644 req_id = 0ea44151-0a9b-4caf-a80b-d033487b6392 response_code = 204 uri = /v2p/de9c8de0-21a8-453a-8aa0-9f8aa1735ae6
15462024-04-03T10:16:33.485ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:491 instance_id = dcfb65b0-3e90-4921-8143-9084736c941c state = SledInstanceState { instance_state: InstanceRuntimeState { propolis_id: None, dst_propolis_id: None, migration_id: None, gen: Generation(5), time_updated: 2024-04-03T10:16:30.833797226Z }, propolis_id: e21cb395-1e64-4f05-a466-14d49bee1d8d, vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-04-03T10:16:33.189211960Z } }
15472024-04-03T10:16:33.488ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:723 instance_id = dcfb65b0-3e90-4921-8143-9084736c941c