Max level shown:
1 [ Jun 25 22:04:28 Enabled. ]
2 [ Jun 25 22:04:28 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Jun 25 22:04:28 Method "start" exited with status 0. ]
4 [ Jun 25 22:04:28 Rereading configuration. ]
5 [ Jun 25 22:04:28 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72024-06-25T22:04:28.126ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:163
82024-06-25T22:04:28.126ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92024-06-25T22:04:28.179ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102024-06-25T22:04:28.179ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112024-06-25T22:04:28.294ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122024-06-25T22:04:28.304ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132024-06-25T22:04:28.312ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142024-06-25T22:04:28.913ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:87 prefix = Ipv6Prefix { addr: fdb0:18c0:4d0d:9fb2::, len: 64 }
152024-06-25T22:04:29.060ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:119
162024-06-25T22:04:29.060ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:131
172024-06-25T22:04:29.060ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:141
182024-06-25T22:04:29.060ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:162 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192024-06-25T22:04:29.060ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:506
202024-06-25T22:04:29.060ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:625
212024-06-25T22:04:29.063ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "buskin", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:535
222024-06-25T22:04:29.063ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:674
232024-06-25T22:04:29.063ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:176
242024-06-25T22:04:29.063ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:733
252024-06-25T22:04:29.064ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/m2_0.vdev
262024-06-25T22:04:29.064ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:262 underlay_network_info = None
272024-06-25T22:04:29.064ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024 }), tx: ... } file = sled-storage/src/manager.rs:381
282024-06-25T22:04:29.064ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292024-06-25T22:04:29.064ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:121 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302024-06-25T22:04:29.077ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:304
312024-06-25T22:04:29.077ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:315 id = c1b4be1d-f4e3-4e74-a94a-e989f58db5ee (zpool)
322024-06-25T22:04:29.176ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: c1b4be1d-f4e3-4e74-a94a-e989f58db5ee (zpool), kind: Internal }
332024-06-25T22:04:29.383ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:381
342024-06-25T22:04:29.383ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/m2_1.vdev
352024-06-25T22:04:29.383ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362024-06-25T22:04:29.383ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372024-06-25T22:04:29.383ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025 }), tx: ... } file = sled-storage/src/manager.rs:381
382024-06-25T22:04:29.383ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392024-06-25T22:04:29.383ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:121 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402024-06-25T22:04:29.392ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:304
412024-06-25T22:04:29.392ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:315 id = d56b00ad-a3b5-4f85-a7d9-5f806111674c (zpool)
422024-06-25T22:04:29.479ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: d56b00ad-a3b5-4f85-a7d9-5f806111674c (zpool), kind: Internal }
432024-06-25T22:04:29.679ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_0.vdev
442024-06-25T22:04:29.679ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: c1b4be1d-f4e3-4e74-a94a-e989f58db5ee (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: d56b00ad-a3b5-4f85-a7d9-5f806111674c (zpool), kind: Internal } }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
452024-06-25T22:04:29.679ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
462024-06-25T22:04:29.679ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
472024-06-25T22:04:29.679ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026 }), tx: ... } file = sled-storage/src/manager.rs:381
482024-06-25T22:04:29.679ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
492024-06-25T22:04:29.679ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_1.vdev
502024-06-25T22:04:29.679ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: c1b4be1d-f4e3-4e74-a94a-e989f58db5ee (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: d56b00ad-a3b5-4f85-a7d9-5f806111674c (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
512024-06-25T22:04:29.679ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
522024-06-25T22:04:29.679ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
532024-06-25T22:04:29.679ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027 }), tx: ... } file = sled-storage/src/manager.rs:381
542024-06-25T22:04:29.679ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
552024-06-25T22:04:29.679ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_2.vdev
562024-06-25T22:04:29.679ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: c1b4be1d-f4e3-4e74-a94a-e989f58db5ee (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: d56b00ad-a3b5-4f85-a7d9-5f806111674c (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
572024-06-25T22:04:29.679ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028 }), tx: ... } file = sled-storage/src/manager.rs:381
582024-06-25T22:04:29.679ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
592024-06-25T22:04:29.679ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
602024-06-25T22:04:29.679ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
612024-06-25T22:04:29.679ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_3.vdev
622024-06-25T22:04:29.679ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: c1b4be1d-f4e3-4e74-a94a-e989f58db5ee (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: d56b00ad-a3b5-4f85-a7d9-5f806111674c (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
632024-06-25T22:04:29.679ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
642024-06-25T22:04:29.679ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029 }), tx: ... } file = sled-storage/src/manager.rs:381
652024-06-25T22:04:29.679ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
662024-06-25T22:04:29.679ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
672024-06-25T22:04:29.679ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_4.vdev
682024-06-25T22:04:29.679ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030 }), tx: ... } file = sled-storage/src/manager.rs:381
692024-06-25T22:04:29.679ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
702024-06-25T22:04:29.679ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: c1b4be1d-f4e3-4e74-a94a-e989f58db5ee (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: d56b00ad-a3b5-4f85-a7d9-5f806111674c (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
712024-06-25T22:04:29.679ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
722024-06-25T22:04:29.679ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
732024-06-25T22:04:29.679ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_5.vdev
742024-06-25T22:04:29.679ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031 }), tx: ... } file = sled-storage/src/manager.rs:381
752024-06-25T22:04:29.679ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: c1b4be1d-f4e3-4e74-a94a-e989f58db5ee (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: d56b00ad-a3b5-4f85-a7d9-5f806111674c (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
762024-06-25T22:04:29.679ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
772024-06-25T22:04:29.679ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
782024-06-25T22:04:29.679ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
792024-06-25T22:04:29.679ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_6.vdev
802024-06-25T22:04:29.679ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032 }), tx: ... } file = sled-storage/src/manager.rs:381
812024-06-25T22:04:29.679ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: c1b4be1d-f4e3-4e74-a94a-e989f58db5ee (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: d56b00ad-a3b5-4f85-a7d9-5f806111674c (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
822024-06-25T22:04:29.679ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
832024-06-25T22:04:29.679ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
842024-06-25T22:04:29.679ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
852024-06-25T22:04:29.679ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_7.vdev
862024-06-25T22:04:29.679ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: c1b4be1d-f4e3-4e74-a94a-e989f58db5ee (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: d56b00ad-a3b5-4f85-a7d9-5f806111674c (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
872024-06-25T22:04:29.680ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
882024-06-25T22:04:29.680ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033 }), tx: ... } file = sled-storage/src/manager.rs:381
892024-06-25T22:04:29.680ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
902024-06-25T22:04:29.680ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
912024-06-25T22:04:29.680ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_8.vdev
922024-06-25T22:04:29.680ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034 }), tx: ... } file = sled-storage/src/manager.rs:381
932024-06-25T22:04:29.680ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
942024-06-25T22:04:29.680ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: c1b4be1d-f4e3-4e74-a94a-e989f58db5ee (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: d56b00ad-a3b5-4f85-a7d9-5f806111674c (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
952024-06-25T22:04:29.680ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
962024-06-25T22:04:29.680ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
972024-06-25T22:04:29.680ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:91
982024-06-25T22:04:29.680ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:93
992024-06-25T22:04:29.680ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: c1b4be1d-f4e3-4e74-a94a-e989f58db5ee (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: d56b00ad-a3b5-4f85-a7d9-5f806111674c (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
1002024-06-25T22:04:29.680ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
1012024-06-25T22:04:29.680ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
1022024-06-25T22:04:29.680ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
1032024-06-25T22:04:29.680ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:200
1042024-06-25T22:04:29.680ZINFOSledAgent (bootstore): No ledger in /pool/int/c1b4be1d-f4e3-4e74-a94a-e989f58db5ee/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1052024-06-25T22:04:29.680ZINFOSledAgent (bootstore): No ledger in /pool/int/d56b00ad-a3b5-4f85-a7d9-5f806111674c/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1062024-06-25T22:04:29.680ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-buskin-i86pc
1072024-06-25T22:04:29.680ZINFOSledAgent (bootstore): No ledger in /pool/int/c1b4be1d-f4e3-4e74-a94a-e989f58db5ee/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1082024-06-25T22:04:29.680ZINFOSledAgent (bootstore): No ledger in /pool/int/d56b00ad-a3b5-4f85-a7d9-5f806111674c/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1092024-06-25T22:04:29.680ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-buskin-i86pc
1102024-06-25T22:04:29.680ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:205
1112024-06-25T22:04:29.680ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:220
1122024-06-25T22:04:29.690ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:710
1132024-06-25T22:04:29.690ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:289 next_cleanup = Instant { tv_sec: 1205, tv_nsec: 986684713 } time_to_next_cleanup = 599.999921139s
1142024-06-25T22:04:29.690ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3547
1152024-06-25T22:04:29.690ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
1162024-06-25T22:04:29.690ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/c1b4be1d-f4e3-4e74-a94a-e989f58db5ee/config/sled-agent-request.json file = common/src/ledger.rs:188
1172024-06-25T22:04:29.690ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/d56b00ad-a3b5-4f85-a7d9-5f806111674c/config/sled-agent-request.json file = common/src/ledger.rs:188
1182024-06-25T22:04:29.693ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:196 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80
1192024-06-25T22:04:29.694ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:44 local_addr = [fdb0:18c0:4d0d:9fb2::1]:12346
1202024-06-25T22:04:29.694ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.1.164, last: 10.151.1.173, }, ), ], external_dns_ips: [ 10.151.1.164, 10.151.1.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, vlan_id: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: None, bgp_peers: [], autoneg: false, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1011
1212024-06-25T22:04:29.694ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:60
1222024-06-25T22:04:29.694ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
1232024-06-25T22:04:29.694ZINFOSledAgent (RSS): No ledger in /pool/int/c1b4be1d-f4e3-4e74-a94a-e989f58db5ee/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1242024-06-25T22:04:29.694ZINFOSledAgent (RSS): No ledger in /pool/int/d56b00ad-a3b5-4f85-a7d9-5f806111674c/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1252024-06-25T22:04:29.694ZINFOSledAgent (RSS): RSS configuration has not been fully applied yet file = sled-agent/src/rack_setup/service.rs:1071
1262024-06-25T22:04:29.694ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
1272024-06-25T22:04:29.694ZINFOSledAgent (RSS): No ledger in /pool/int/c1b4be1d-f4e3-4e74-a94a-e989f58db5ee/config/rss-sled-plan.json file = common/src/ledger.rs:188
1282024-06-25T22:04:29.694ZINFOSledAgent (RSS): No ledger in /pool/int/d56b00ad-a3b5-4f85-a7d9-5f806111674c/config/rss-sled-plan.json file = common/src/ledger.rs:188
1292024-06-25T22:04:29.694ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1112
1302024-06-25T22:04:29.694ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:156
1312024-06-25T22:04:29.694ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:9fb2::1 file = sled-agent/src/rack_setup/plan/sled.rs:129
1322024-06-25T22:04:29.694ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
1332024-06-25T22:04:29.694ZINFOSledAgent (RSS): Writing ledger to /pool/int/c1b4be1d-f4e3-4e74-a94a-e989f58db5ee/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:199
1342024-06-25T22:04:29.694ZINFOSledAgent (RSS): Writing ledger to /pool/int/d56b00ad-a3b5-4f85-a7d9-5f806111674c/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:199
1352024-06-25T22:04:29.695ZINFOSledAgent (RSS): Sled plan written to storage file = sled-agent/src/rack_setup/plan/sled.rs:176
1362024-06-25T22:04:29.695ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1145
1372024-06-25T22:04:29.695ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
1382024-06-25T22:04:29.695ZINFOSledAgent (bootstore): Writing ledger to /pool/int/c1b4be1d-f4e3-4e74-a94a-e989f58db5ee/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
1392024-06-25T22:04:29.695ZINFOSledAgent (bootstore): Writing ledger to /pool/int/d56b00ad-a3b5-4f85-a7d9-5f806111674c/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
1402024-06-25T22:04:29.695ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
1412024-06-25T22:04:29.695ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:217 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 98068951-ddeb-40ca-9677-d05b350bbf94, rack_id: 12e1b358-d02a-47e8-a15a-e969cbfdb178, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
1422024-06-25T22:04:29.695ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:66 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:63631
1432024-06-25T22:04:29.695ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 98068951-ddeb-40ca-9677-d05b350bbf94, rack_id: 12e1b358-d02a-47e8-a15a-e969cbfdb178, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:360
1442024-06-25T22:04:29.695ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:375
1452024-06-25T22:04:29.695ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:381
1462024-06-25T22:04:29.695ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1472024-06-25T22:04:29.695ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:530
1482024-06-25T22:04:29.695ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:60
1492024-06-25T22:04:29.695ZINFOSledAgent (StorageManager): No ledger in /pool/int/c1b4be1d-f4e3-4e74-a94a-e989f58db5ee/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_ledger
1502024-06-25T22:04:29.695ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:87 prefix = Ipv6Prefix { addr: fd00:1122:3344:101::, len: 64 }
1512024-06-25T22:04:29.695ZINFOSledAgent (StorageManager): No ledger in /pool/int/d56b00ad-a3b5-4f85-a7d9-5f806111674c/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_ledger
1522024-06-25T22:04:29.695ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:519
1532024-06-25T22:04:29.695ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:547
1542024-06-25T22:04:29.698ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:3779
1552024-06-25T22:04:29.708ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
1562024-06-25T22:04:29.718ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
1572024-06-25T22:04:29.728ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
1582024-06-25T22:04:29.738ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
1592024-06-25T22:04:29.747ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
1602024-06-25T22:04:29.756ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
1612024-06-25T22:04:29.762ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:354 sled_id = 98068951-ddeb-40ca-9677-d05b350bbf94
1622024-06-25T22:04:29.762ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:164
1632024-06-25T22:04:29.762ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 137.263178ms DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "28825b39-d5f9-4378-b6e4-bf7168f1449f", "content-length": "124", "date": "Tue, 25 Jun 2024 22:04:28 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "28825b39-d5f9-4378-b6e4-bf7168f1449f" } file = clients/ddm-admin-client/src/lib.rs:178
1642024-06-25T22:04:29.765ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
1652024-06-25T22:04:29.774ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
1662024-06-25T22:04:29.783ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
1672024-06-25T22:04:29.783ZINFOSledAgent (StorageManager): No disks to be automatically managed file = sled-storage/src/manager.rs:558
1682024-06-25T22:04:29.783ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
1692024-06-25T22:04:29.783ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:370
1702024-06-25T22:04:29.783ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:339
1712024-06-25T22:04:29.783ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:449 result = DisksManagementResult { status: [] }
1722024-06-25T22:04:29.783ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
1732024-06-25T22:04:29.783ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:366 sled_id = 98068951-ddeb-40ca-9677-d05b350bbf94
1742024-06-25T22:04:29.795ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_c1b4be1d-f4e3-4e74-a94a-e989f58db5ee/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1752024-06-25T22:04:29.807ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:315
1762024-06-25T22:04:29.817ZINFOSledAgent: successfully created encrypted zvol: name="oxi_c1b4be1d-f4e3-4e74-a94a-e989f58db5ee/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1772024-06-25T22:04:29.817ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_c1b4be1d-f4e3-4e74-a94a-e989f58db5ee/swap" file = sled-agent/src/swap_device.rs:96
1782024-06-25T22:04:29.822ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:381 sled_id = 98068951-ddeb-40ca-9677-d05b350bbf94
1792024-06-25T22:04:29.822ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:126
1802024-06-25T22:04:29.822ZINFOSledAgent (BackingFs): Ensuring dataset oxi_c1b4be1d-f4e3-4e74-a94a-e989f58db5ee/backing/fmd file = sled-agent/src/backing_fs.rs:136
1812024-06-25T22:04:29.825ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:354
1822024-06-25T22:04:29.892ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:170
1832024-06-25T22:04:29.901ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:164
1842024-06-25T22:04:29.902ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 173.622845ms DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "3faa3cc4-8e5e-4842-abdf-2639951de711", "content-length": "124", "date": "Tue, 25 Jun 2024 22:04:28 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "3faa3cc4-8e5e-4842-abdf-2639951de711" } file = clients/ddm-admin-client/src/lib.rs:178
1852024-06-25T22:04:30.077ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:164
1862024-06-25T22:04:30.077ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 87.57992ms DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "87b4a34d-2d28-4c3f-b6b0-cfe872c38542", "content-length": "124", "date": "Tue, 25 Jun 2024 22:04:30 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "87b4a34d-2d28-4c3f-b6b0-cfe872c38542" } file = clients/ddm-admin-client/src/lib.rs:178
1872024-06-25T22:04:30.111ZINFOSledAgent (BackingFs): Mounting oxi_c1b4be1d-f4e3-4e74-a94a-e989f58db5ee/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:178
1882024-06-25T22:04:30.124ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:186
1892024-06-25T22:04:30.124ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:186
1902024-06-25T22:04:30.124ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:186
1912024-06-25T22:04:30.124ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:192
1922024-06-25T22:04:30.166ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:164
1932024-06-25T22:04:30.167ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 159.144339ms DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "165989be-bcc0-4a7d-a3c6-814853ee9198", "content-length": "124", "date": "Tue, 25 Jun 2024 22:04:30 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "165989be-bcc0-4a7d-a3c6-814853ee9198" } file = clients/ddm-admin-client/src/lib.rs:178
1942024-06-25T22:04:30.327ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:164
1952024-06-25T22:04:30.328ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 212.94928ms DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "5f7174ee-874d-4c62-b023-58ab51f6146c", "content-length": "124", "date": "Tue, 25 Jun 2024 22:04:30 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "5f7174ee-874d-4c62-b023-58ab51f6146c" } file = clients/ddm-admin-client/src/lib.rs:178
1962024-06-25T22:04:30.543ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:164
1972024-06-25T22:04:30.543ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 326.533846ms DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "b76bf1ec-0b20-4c3a-94f9-d8d109ec7678", "content-length": "124", "date": "Tue, 25 Jun 2024 22:04:30 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "b76bf1ec-0b20-4c3a-94f9-d8d109ec7678" } file = clients/ddm-admin-client/src/lib.rs:178
1982024-06-25T22:04:30.830ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:90 sled_id = 98068951-ddeb-40ca-9677-d05b350bbf94
1992024-06-25T22:04:30.830ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:196 local_addr = [fd00:1122:3344:101::1]:35461 sled_id = 98068951-ddeb-40ca-9677-d05b350bbf94
2002024-06-25T22:04:30.830ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:60 sled_id = 98068951-ddeb-40ca-9677-d05b350bbf94
2012024-06-25T22:04:30.830ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:35461 file = oximeter/producer/src/lib.rs:282 interval = 30s producer_id = 98068951-ddeb-40ca-9677-d05b350bbf94 sled_id = 98068951-ddeb-40ca-9677-d05b350bbf94
2022024-06-25T22:04:30.836ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 293.463657ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:390 sled_id = 98068951-ddeb-40ca-9677-d05b350bbf94
2032024-06-25T22:04:30.871ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:164
2042024-06-25T22:04:30.877ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = 98068951-ddeb-40ca-9677-d05b350bbf94
2052024-06-25T22:04:30.877ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = 98068951-ddeb-40ca-9677-d05b350bbf94
2062024-06-25T22:04:30.877ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:893 underlay_address = fd00:1122:3344:101::1
2072024-06-25T22:04:30.877ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:60
2082024-06-25T22:04:30.878ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:196 local_addr = [fd00:1122:3344:101::1]:12345
2092024-06-25T22:04:30.878ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:430
2102024-06-25T22:04:30.878ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
2112024-06-25T22:04:30.878ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/c1b4be1d-f4e3-4e74-a94a-e989f58db5ee/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2122024-06-25T22:04:30.878ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/d56b00ad-a3b5-4f85-a7d9-5f806111674c/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2132024-06-25T22:04:30.878ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2142024-06-25T22:04:30.878ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:73 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:63631
2152024-06-25T22:04:30.878ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:262 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.1.100, vlan_id: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: None, bgp_peers: [], autoneg: false }], bgp: [], bfd: [] })))
2162024-06-25T22:04:30.879ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3547
2172024-06-25T22:04:31.046ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:108 peer = [fdb0:18c0:4d0d:9fb2::1]:12346
2182024-06-25T22:04:31.046ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:232 target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
2192024-06-25T22:04:31.046ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
2202024-06-25T22:04:31.046ZINFOSledAgent (RSS): No ledger in /pool/int/c1b4be1d-f4e3-4e74-a94a-e989f58db5ee/config/rss-service-plan-v3.json file = common/src/ledger.rs:188
2212024-06-25T22:04:31.046ZINFOSledAgent (RSS): No ledger in /pool/int/d56b00ad-a3b5-4f85-a7d9-5f806111674c/config/rss-service-plan-v3.json file = common/src/ledger.rs:188
2222024-06-25T22:04:31.046ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
2232024-06-25T22:04:31.046ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
2242024-06-25T22:04:31.058ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/98068951-ddeb-40ca-9677-d05b350bbf94): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:619 sled_id = 98068951-ddeb-40ca-9677-d05b350bbf94
2252024-06-25T22:04:31.078ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42544
2262024-06-25T22:04:31.078ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
2272024-06-25T22:04:31.078ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42544 req_id = b28706d5-b60e-4298-95fc-a6d6d2536d8c response_code = 200 uri = /inventory
2282024-06-25T22:04:31.108ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35867
2292024-06-25T22:04:31.108ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:35867 req_id = 20b1f569-8277-4ca4-a4e6-ea6a0f65a7aa response_code = 200 uri = /sled-role
2302024-06-25T22:04:31.110ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
2312024-06-25T22:04:31.110ZINFOSledAgent (RSS): Writing ledger to /pool/int/c1b4be1d-f4e3-4e74-a94a-e989f58db5ee/config/.rss-service-plan-v3.json.tmp file = common/src/ledger.rs:199
2322024-06-25T22:04:31.110ZINFOSledAgent (RSS): Writing ledger to /pool/int/d56b00ad-a3b5-4f85-a7d9-5f806111674c/config/.rss-service-plan-v3.json.tmp file = common/src/ledger.rs:199
2332024-06-25T22:04:31.110ZINFOSledAgent (RSS): Service plan written to storage file = sled-agent/src/rack_setup/plan/service.rs:812
2342024-06-25T22:04:31.131ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 591.357286ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:390 sled_id = 98068951-ddeb-40ca-9677-d05b350bbf94
2352024-06-25T22:04:31.141ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { disks: [OmicronPhysicalDiskConfig { id: c0eaa2e6-5dc4-4f5b-ae25-a6211ce8641f, identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, pool_id: b24fcace-6491-450a-a369-72a4fa2f698d (zpool) }, OmicronPhysicalDiskConfig { id: e9c5787a-9cda-4ebe-8a27-bca247e3f9f6, identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, pool_id: bbe28fca-3fd1-4387-a7f4-68f98c1de91a (zpool) }, OmicronPhysicalDiskConfig { id: e04a2452-9c14-4f87-a6b1-0394df57c411, identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, pool_id: 2d7d2d68-0dff-4e99-8278-b931af9c51f9 (zpool) }, OmicronPhysicalDiskConfig { id: b43d2caf-9893-4781-86db-e6adce6e37a1, identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, pool_id: a53379c5-166a-4c1c-987d-bc15e7c6ea9a (zpool) }, OmicronPhysicalDiskConfig { id: c0a991a9-b3ff-47dc-b5b6-1b633d416c1a, identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, pool_id: d48dc185-6776-4e11-be12-99d059cde9ba (zpool) }, OmicronPhysicalDiskConfig { id: cc740a22-fe83-41f2-baa6-693c26f5ec49, identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, pool_id: e5688a20-d1b3-481e-838c-caf5db3530b8 (zpool) }, OmicronPhysicalDiskConfig { id: 1f6bd510-6333-4fc4-a309-65f8f3371093, identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, pool_id: 312c3038-d536-4c5a-9806-84746920ad0d (zpool) }, OmicronPhysicalDiskConfig { id: 36841bca-dcb8-4a38-99a8-c14ad603747e, identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, pool_id: 97cef6c3-7be9-4f86-b962-06f70386b56f (zpool) }, OmicronPhysicalDiskConfig { id: 3ee4d7d6-b235-4233-9b45-49401b308af5, identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, pool_id: facb4ef1-3898-4a96-a381-88ad4e3fa4e0 (zpool) }], generation: Generation(1) } file = sled-agent/src/rack_setup/service.rs:348 sled_address = [fd00:1122:3344:101::1]:12345
2362024-06-25T22:04:31.141ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40478
2372024-06-25T22:04:31.142ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(1), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: c0eaa2e6-5dc4-4f5b-ae25-a6211ce8641f, pool_id: b24fcace-6491-450a-a369-72a4fa2f698d (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: e9c5787a-9cda-4ebe-8a27-bca247e3f9f6, pool_id: bbe28fca-3fd1-4387-a7f4-68f98c1de91a (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: e04a2452-9c14-4f87-a6b1-0394df57c411, pool_id: 2d7d2d68-0dff-4e99-8278-b931af9c51f9 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: b43d2caf-9893-4781-86db-e6adce6e37a1, pool_id: a53379c5-166a-4c1c-987d-bc15e7c6ea9a (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: c0a991a9-b3ff-47dc-b5b6-1b633d416c1a, pool_id: d48dc185-6776-4e11-be12-99d059cde9ba (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: cc740a22-fe83-41f2-baa6-693c26f5ec49, pool_id: e5688a20-d1b3-481e-838c-caf5db3530b8 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 1f6bd510-6333-4fc4-a309-65f8f3371093, pool_id: 312c3038-d536-4c5a-9806-84746920ad0d (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 36841bca-dcb8-4a38-99a8-c14ad603747e, pool_id: 97cef6c3-7be9-4f86-b962-06f70386b56f (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 3ee4d7d6-b235-4233-9b45-49401b308af5, pool_id: facb4ef1-3898-4a96-a381-88ad4e3fa4e0 (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:381
2382024-06-25T22:04:31.142ZINFOSledAgent (StorageManager): No ledger in /pool/int/c1b4be1d-f4e3-4e74-a94a-e989f58db5ee/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2392024-06-25T22:04:31.142ZINFOSledAgent (StorageManager): No ledger in /pool/int/d56b00ad-a3b5-4f85-a7d9-5f806111674c/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2402024-06-25T22:04:31.142ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:681 request = omicron_physical_disks_ensure
2412024-06-25T22:04:31.142ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:339
2422024-06-25T22:04:31.142ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:379
2432024-06-25T22:04:31.142ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
2442024-06-25T22:04:31.142ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:121 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2452024-06-25T22:04:31.247ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:304
2462024-06-25T22:04:31.247ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:310 id = b24fcace-6491-450a-a369-72a4fa2f698d (zpool)
2472024-06-25T22:04:31.798ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.019003058s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:390 sled_id = 98068951-ddeb-40ca-9677-d05b350bbf94
2482024-06-25T22:04:32.057ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/98068951-ddeb-40ca-9677-d05b350bbf94): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = 98068951-ddeb-40ca-9677-d05b350bbf94
2492024-06-25T22:04:32.245ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: b24fcace-6491-450a-a369-72a4fa2f698d (zpool), kind: External }
2502024-06-25T22:04:32.425ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:332
2512024-06-25T22:04:32.425ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:334
2522024-06-25T22:04:32.425ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:338
2532024-06-25T22:04:32.425ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:340
2542024-06-25T22:04:32.425ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2552024-06-25T22:04:32.425ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2562024-06-25T22:04:32.425ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
2572024-06-25T22:04:32.819ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 2.341917109s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:390 sled_id = 98068951-ddeb-40ca-9677-d05b350bbf94
2582024-06-25T22:04:33.001ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_switch
2592024-06-25T22:04:33.203ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2602024-06-25T22:04:33.398ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/98068951-ddeb-40ca-9677-d05b350bbf94): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:619 sled_id = 98068951-ddeb-40ca-9677-d05b350bbf94
2612024-06-25T22:04:33.398ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/98068951-ddeb-40ca-9677-d05b350bbf94): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = 98068951-ddeb-40ca-9677-d05b350bbf94
2622024-06-25T22:04:33.619ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_b24fcace-6491-450a-a369-72a4fa2f698d/crypt/zone file = sled-storage/src/dataset.rs:395
2632024-06-25T22:04:33.805ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 73.950006ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2642024-06-25T22:04:34.342ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 70.722405ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2652024-06-25T22:04:34.958ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/98068951-ddeb-40ca-9677-d05b350bbf94): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = 98068951-ddeb-40ca-9677-d05b350bbf94
2662024-06-25T22:04:34.958ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 247.140132ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2672024-06-25T22:04:35.142ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/98068951-ddeb-40ca-9677-d05b350bbf94): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:619 sled_id = 98068951-ddeb-40ca-9677-d05b350bbf94
2682024-06-25T22:04:35.712ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 2.040052457s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:390 sled_id = 98068951-ddeb-40ca-9677-d05b350bbf94
2692024-06-25T22:04:35.713ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 402.336048ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2702024-06-25T22:04:36.457ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_b24fcace-6491-450a-a369-72a4fa2f698d file = sled-storage/src/dataset.rs:480
2712024-06-25T22:04:36.691ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/98068951-ddeb-40ca-9677-d05b350bbf94): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = 98068951-ddeb-40ca-9677-d05b350bbf94
2722024-06-25T22:04:36.691ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 639.827714ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2732024-06-25T22:04:36.697ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:477
2742024-06-25T22:04:36.697ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:394
2752024-06-25T22:04:36.697ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:379
2762024-06-25T22:04:36.697ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
2772024-06-25T22:04:36.697ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:121 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2782024-06-25T22:04:36.942ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:304
2792024-06-25T22:04:36.942ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:310 id = bbe28fca-3fd1-4387-a7f4-68f98c1de91a (zpool)
2802024-06-25T22:04:38.082ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: bbe28fca-3fd1-4387-a7f4-68f98c1de91a (zpool), kind: External }
2812024-06-25T22:04:38.314ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:332
2822024-06-25T22:04:38.314ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:334
2832024-06-25T22:04:38.314ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:338
2842024-06-25T22:04:38.314ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:340
2852024-06-25T22:04:38.314ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2862024-06-25T22:04:38.314ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2872024-06-25T22:04:38.314ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
2882024-06-25T22:04:38.840ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/98068951-ddeb-40ca-9677-d05b350bbf94): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = 98068951-ddeb-40ca-9677-d05b350bbf94
2892024-06-25T22:04:38.840ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 8.946142527s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:390 sled_id = 98068951-ddeb-40ca-9677-d05b350bbf94
2902024-06-25T22:04:38.840ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/98068951-ddeb-40ca-9677-d05b350bbf94): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:619 sled_id = 98068951-ddeb-40ca-9677-d05b350bbf94
2912024-06-25T22:04:39.807ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2922024-06-25T22:04:40.317ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/98068951-ddeb-40ca-9677-d05b350bbf94): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = 98068951-ddeb-40ca-9677-d05b350bbf94
2932024-06-25T22:04:40.318ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/98068951-ddeb-40ca-9677-d05b350bbf94): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:619 sled_id = 98068951-ddeb-40ca-9677-d05b350bbf94
2942024-06-25T22:04:40.318ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_bbe28fca-3fd1-4387-a7f4-68f98c1de91a/crypt/zone file = sled-storage/src/dataset.rs:395
2952024-06-25T22:04:41.265ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = 98068951-ddeb-40ca-9677-d05b350bbf94
2962024-06-25T22:04:41.322ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/98068951-ddeb-40ca-9677-d05b350bbf94): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = 98068951-ddeb-40ca-9677-d05b350bbf94
2972024-06-25T22:04:41.378ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_bbe28fca-3fd1-4387-a7f4-68f98c1de91a file = sled-storage/src/dataset.rs:480
2982024-06-25T22:04:41.387ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:477
2992024-06-25T22:04:41.387ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:394
3002024-06-25T22:04:41.387ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:379
3012024-06-25T22:04:41.387ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
3022024-06-25T22:04:41.387ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:121 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3032024-06-25T22:04:41.397ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:304
3042024-06-25T22:04:41.397ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:310 id = 2d7d2d68-0dff-4e99-8278-b931af9c51f9 (zpool)
3052024-06-25T22:04:41.490ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: 2d7d2d68-0dff-4e99-8278-b931af9c51f9 (zpool), kind: External }
3062024-06-25T22:04:41.498ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:332
3072024-06-25T22:04:41.498ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:334
3082024-06-25T22:04:41.498ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:338
3092024-06-25T22:04:41.498ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:340
3102024-06-25T22:04:41.498ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3112024-06-25T22:04:41.498ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3122024-06-25T22:04:41.498ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
3132024-06-25T22:04:41.533ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3142024-06-25T22:04:41.542ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_2d7d2d68-0dff-4e99-8278-b931af9c51f9/crypt/zone file = sled-storage/src/dataset.rs:395
3152024-06-25T22:04:41.665ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_2d7d2d68-0dff-4e99-8278-b931af9c51f9 file = sled-storage/src/dataset.rs:480
3162024-06-25T22:04:41.673ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:477
3172024-06-25T22:04:41.673ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:394
3182024-06-25T22:04:41.673ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:379
3192024-06-25T22:04:41.673ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
3202024-06-25T22:04:41.673ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:121 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3212024-06-25T22:04:41.683ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:304
3222024-06-25T22:04:41.683ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:310 id = a53379c5-166a-4c1c-987d-bc15e7c6ea9a (zpool)
3232024-06-25T22:04:41.779ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: a53379c5-166a-4c1c-987d-bc15e7c6ea9a (zpool), kind: External }
3242024-06-25T22:04:41.787ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:332
3252024-06-25T22:04:41.787ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:334
3262024-06-25T22:04:41.787ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:338
3272024-06-25T22:04:41.787ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:340
3282024-06-25T22:04:41.787ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3292024-06-25T22:04:41.787ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3302024-06-25T22:04:41.787ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
3312024-06-25T22:04:41.825ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3322024-06-25T22:04:41.833ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_a53379c5-166a-4c1c-987d-bc15e7c6ea9a/crypt/zone file = sled-storage/src/dataset.rs:395
3332024-06-25T22:04:41.962ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_a53379c5-166a-4c1c-987d-bc15e7c6ea9a file = sled-storage/src/dataset.rs:480
3342024-06-25T22:04:41.970ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:477
3352024-06-25T22:04:41.970ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:394
3362024-06-25T22:04:41.970ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:379
3372024-06-25T22:04:41.970ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
3382024-06-25T22:04:41.970ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:121 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3392024-06-25T22:04:41.980ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:304
3402024-06-25T22:04:41.980ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:310 id = d48dc185-6776-4e11-be12-99d059cde9ba (zpool)
3412024-06-25T22:04:42.078ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: d48dc185-6776-4e11-be12-99d059cde9ba (zpool), kind: External }
3422024-06-25T22:04:42.086ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:332
3432024-06-25T22:04:42.087ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:334
3442024-06-25T22:04:42.087ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:338
3452024-06-25T22:04:42.087ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:340
3462024-06-25T22:04:42.087ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3472024-06-25T22:04:42.087ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3482024-06-25T22:04:42.087ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
3492024-06-25T22:04:42.122ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3502024-06-25T22:04:42.130ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_d48dc185-6776-4e11-be12-99d059cde9ba/crypt/zone file = sled-storage/src/dataset.rs:395
3512024-06-25T22:04:42.255ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_d48dc185-6776-4e11-be12-99d059cde9ba file = sled-storage/src/dataset.rs:480
3522024-06-25T22:04:42.263ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:477
3532024-06-25T22:04:42.263ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:394
3542024-06-25T22:04:42.263ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:379
3552024-06-25T22:04:42.263ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
3562024-06-25T22:04:42.263ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:121 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3572024-06-25T22:04:42.272ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:304
3582024-06-25T22:04:42.272ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:310 id = e5688a20-d1b3-481e-838c-caf5db3530b8 (zpool)
3592024-06-25T22:04:42.366ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: e5688a20-d1b3-481e-838c-caf5db3530b8 (zpool), kind: External }
3602024-06-25T22:04:42.374ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:332
3612024-06-25T22:04:42.374ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:334
3622024-06-25T22:04:42.374ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:338
3632024-06-25T22:04:42.374ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:340
3642024-06-25T22:04:42.374ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3652024-06-25T22:04:42.375ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3662024-06-25T22:04:42.375ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
3672024-06-25T22:04:42.379ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/98068951-ddeb-40ca-9677-d05b350bbf94): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:619 sled_id = 98068951-ddeb-40ca-9677-d05b350bbf94
3682024-06-25T22:04:42.379ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/98068951-ddeb-40ca-9677-d05b350bbf94): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = 98068951-ddeb-40ca-9677-d05b350bbf94
3692024-06-25T22:04:42.411ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3702024-06-25T22:04:42.419ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_e5688a20-d1b3-481e-838c-caf5db3530b8/crypt/zone file = sled-storage/src/dataset.rs:395
3712024-06-25T22:04:42.547ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_e5688a20-d1b3-481e-838c-caf5db3530b8 file = sled-storage/src/dataset.rs:480
3722024-06-25T22:04:42.555ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:477
3732024-06-25T22:04:42.555ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:394
3742024-06-25T22:04:42.555ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:379
3752024-06-25T22:04:42.555ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
3762024-06-25T22:04:42.555ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:121 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3772024-06-25T22:04:42.566ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:304
3782024-06-25T22:04:42.566ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:310 id = 312c3038-d536-4c5a-9806-84746920ad0d (zpool)
3792024-06-25T22:04:42.659ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: 312c3038-d536-4c5a-9806-84746920ad0d (zpool), kind: External }
3802024-06-25T22:04:42.668ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:332
3812024-06-25T22:04:42.668ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:334
3822024-06-25T22:04:42.668ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:338
3832024-06-25T22:04:42.668ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:340
3842024-06-25T22:04:42.668ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3852024-06-25T22:04:42.668ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3862024-06-25T22:04:42.668ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
3872024-06-25T22:04:42.688ZINFOSledAgent (ServiceManager): Ensuring tfportrear0_0/ll exists in zone file = sled-agent/src/services.rs:2233
3882024-06-25T22:04:42.704ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3892024-06-25T22:04:42.711ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_312c3038-d536-4c5a-9806-84746920ad0d/crypt/zone file = sled-storage/src/dataset.rs:395
3902024-06-25T22:04:42.838ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_312c3038-d536-4c5a-9806-84746920ad0d file = sled-storage/src/dataset.rs:480
3912024-06-25T22:04:42.846ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:477
3922024-06-25T22:04:42.846ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:394
3932024-06-25T22:04:42.846ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:379
3942024-06-25T22:04:42.846ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
3952024-06-25T22:04:42.846ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:121 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
3962024-06-25T22:04:42.856ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:304
3972024-06-25T22:04:42.856ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:310 id = 97cef6c3-7be9-4f86-b962-06f70386b56f (zpool)
3982024-06-25T22:04:42.946ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: 97cef6c3-7be9-4f86-b962-06f70386b56f (zpool), kind: External }
3992024-06-25T22:04:42.954ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:332
4002024-06-25T22:04:42.954ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:334
4012024-06-25T22:04:42.954ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:338
4022024-06-25T22:04:42.954ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:340
4032024-06-25T22:04:42.954ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4042024-06-25T22:04:42.954ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4052024-06-25T22:04:42.954ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
4062024-06-25T22:04:42.989ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4072024-06-25T22:04:42.997ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_97cef6c3-7be9-4f86-b962-06f70386b56f/crypt/zone file = sled-storage/src/dataset.rs:395
4082024-06-25T22:04:43.111ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_97cef6c3-7be9-4f86-b962-06f70386b56f file = sled-storage/src/dataset.rs:480
4092024-06-25T22:04:43.117ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:477
4102024-06-25T22:04:43.117ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:394
4112024-06-25T22:04:43.117ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:379
4122024-06-25T22:04:43.117ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
4132024-06-25T22:04:43.117ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:121 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4142024-06-25T22:04:43.126ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:304
4152024-06-25T22:04:43.126ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:310 id = facb4ef1-3898-4a96-a381-88ad4e3fa4e0 (zpool)
4162024-06-25T22:04:43.216ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: facb4ef1-3898-4a96-a381-88ad4e3fa4e0 (zpool), kind: External }
4172024-06-25T22:04:43.223ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:332
4182024-06-25T22:04:43.223ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:334
4192024-06-25T22:04:43.223ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:338
4202024-06-25T22:04:43.223ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:340
4212024-06-25T22:04:43.223ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4222024-06-25T22:04:43.224ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4232024-06-25T22:04:43.224ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
4242024-06-25T22:04:43.260ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4252024-06-25T22:04:43.267ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_facb4ef1-3898-4a96-a381-88ad4e3fa4e0/crypt/zone file = sled-storage/src/dataset.rs:395
4262024-06-25T22:04:43.381ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/98068951-ddeb-40ca-9677-d05b350bbf94): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = 98068951-ddeb-40ca-9677-d05b350bbf94
4272024-06-25T22:04:43.389ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_facb4ef1-3898-4a96-a381-88ad4e3fa4e0 file = sled-storage/src/dataset.rs:480
4282024-06-25T22:04:43.397ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:477
4292024-06-25T22:04:43.397ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:394
4302024-06-25T22:04:43.397ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/c1b4be1d-f4e3-4e74-a94a-e989f58db5ee/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4312024-06-25T22:04:43.397ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: c1b4be1d-f4e3-4e74-a94a-e989f58db5ee (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: d56b00ad-a3b5-4f85-a7d9-5f806111674c (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026 }, zpool_name: ZpoolName { id: b24fcace-6491-450a-a369-72a4fa2f698d (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027 }, zpool_name: ZpoolName { id: bbe28fca-3fd1-4387-a7f4-68f98c1de91a (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028 }, zpool_name: ZpoolName { id: 2d7d2d68-0dff-4e99-8278-b931af9c51f9 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029 }, zpool_name: ZpoolName { id: a53379c5-166a-4c1c-987d-bc15e7c6ea9a (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030 }, zpool_name: ZpoolName { id: d48dc185-6776-4e11-be12-99d059cde9ba (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031 }, zpool_name: ZpoolName { id: e5688a20-d1b3-481e-838c-caf5db3530b8 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032 }, zpool_name: ZpoolName { id: 312c3038-d536-4c5a-9806-84746920ad0d (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033 }, zpool_name: ZpoolName { id: 97cef6c3-7be9-4f86-b962-06f70386b56f (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034 }, zpool_name: ZpoolName { id: facb4ef1-3898-4a96-a381-88ad4e3fa4e0 (zpool), kind: External } }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
4322024-06-25T22:04:43.397ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
4332024-06-25T22:04:43.397ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
4342024-06-25T22:04:43.397ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/d56b00ad-a3b5-4f85-a7d9-5f806111674c/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4352024-06-25T22:04:43.398ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 12256187 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:40478 req_id = f142e3c7-6fcc-402c-9d02-35b372fb6a49 response_code = 200 uri = /omicron-physical-disks
4362024-06-25T22:04:43.428ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: 2402ccbd-c33c-4a93-99e0-a27dc8725e46, underlay_address: fd00:1122:3344:1::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b24fcace-6491-450a-a369-72a4fa2f698d (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 79398434-906b-4472-847f-0189e9312ea1, underlay_address: fd00:1122:3344:2::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: bbe28fca-3fd1-4387-a7f4-68f98c1de91a (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: d58098f0-4531-4b55-bc79-e8c8efa00887, underlay_address: fd00:1122:3344:3::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2d7d2d68-0dff-4e99-8278-b931af9c51f9 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:431 sled_address = [fd00:1122:3344:101::1]:12345
4372024-06-25T22:04:43.428ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37801
4382024-06-25T22:04:43.428ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 2402ccbd-c33c-4a93-99e0-a27dc8725e46, dataset_name: DatasetName { pool_name: ZpoolName { id: b24fcace-6491-450a-a369-72a4fa2f698d (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
4392024-06-25T22:04:43.428ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 2402ccbd-c33c-4a93-99e0-a27dc8725e46, dataset_name: DatasetName { pool_name: ZpoolName { id: b24fcace-6491-450a-a369-72a4fa2f698d (zpool), kind: External }, kind: InternalDns }, responder: ... }
4402024-06-25T22:04:43.481ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 79398434-906b-4472-847f-0189e9312ea1, dataset_name: DatasetName { pool_name: ZpoolName { id: bbe28fca-3fd1-4387-a7f4-68f98c1de91a (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
4412024-06-25T22:04:43.481ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 79398434-906b-4472-847f-0189e9312ea1, dataset_name: DatasetName { pool_name: ZpoolName { id: bbe28fca-3fd1-4387-a7f4-68f98c1de91a (zpool), kind: External }, kind: InternalDns }, responder: ... }
4422024-06-25T22:04:43.532ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d58098f0-4531-4b55-bc79-e8c8efa00887, dataset_name: DatasetName { pool_name: ZpoolName { id: 2d7d2d68-0dff-4e99-8278-b931af9c51f9 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
4432024-06-25T22:04:43.532ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: d58098f0-4531-4b55-bc79-e8c8efa00887, dataset_name: DatasetName { pool_name: ZpoolName { id: 2d7d2d68-0dff-4e99-8278-b931af9c51f9 (zpool), kind: External }, kind: InternalDns }, responder: ... }
4442024-06-25T22:04:43.583ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
4452024-06-25T22:04:43.583ZINFOSledAgent (ServiceManager): No ledger in /pool/int/c1b4be1d-f4e3-4e74-a94a-e989f58db5ee/config/omicron-zones.json file = common/src/ledger.rs:188
4462024-06-25T22:04:43.583ZINFOSledAgent (ServiceManager): No ledger in /pool/int/d56b00ad-a3b5-4f85-a7d9-5f806111674c/config/omicron-zones.json file = common/src/ledger.rs:188
4472024-06-25T22:04:43.583ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
4482024-06-25T22:04:43.629ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
4492024-06-25T22:04:43.629ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
4502024-06-25T22:04:43.629ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
4512024-06-25T22:04:43.682ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_d58098f0-4531-4b55-bc79-e8c8efa00887 file = illumos-utils/src/zone.rs:315
4522024-06-25T22:04:43.686ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_2402ccbd-c33c-4a93-99e0-a27dc8725e46 file = illumos-utils/src/zone.rs:315
4532024-06-25T22:04:43.690ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_79398434-906b-4472-847f-0189e9312ea1 file = illumos-utils/src/zone.rs:315
4542024-06-25T22:04:43.702ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_d58098f0-4531-4b55-bc79-e8c8efa00887 file = illumos-utils/src/zone.rs:354
4552024-06-25T22:04:43.706ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_2402ccbd-c33c-4a93-99e0-a27dc8725e46 file = illumos-utils/src/zone.rs:354
4562024-06-25T22:04:43.710ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_79398434-906b-4472-847f-0189e9312ea1 file = illumos-utils/src/zone.rs:354
4572024-06-25T22:04:44.377ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/98068951-ddeb-40ca-9677-d05b350bbf94): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:619 sled_id = 98068951-ddeb-40ca-9677-d05b350bbf94
4582024-06-25T22:04:44.383ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/98068951-ddeb-40ca-9677-d05b350bbf94): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = 98068951-ddeb-40ca-9677-d05b350bbf94
4592024-06-25T22:04:45.229ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_d58098f0-4531-4b55-bc79-e8c8efa00887: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService1"/> <propval type="astring" name="gateway" value="fd00:1122:3344:3::2"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:3::1"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value="[fd00:1122:3344:3::1]:5353"/> <propval type="astring" name="dns_address" value="[fd00:1122:3344:3::1]:53"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
4602024-06-25T22:04:45.229ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:87 prefix = Ipv6Prefix { addr: fd00:1122:3344:3::, len: 64 }
4612024-06-25T22:04:45.229ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_internal_dns_d58098f0-4531-4b55-bc79-e8c8efa00887
4622024-06-25T22:04:45.716ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_2402ccbd-c33c-4a93-99e0-a27dc8725e46: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService2"/> <propval type="astring" name="gateway" value="fd00:1122:3344:1::2"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:1::1"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value="[fd00:1122:3344:1::1]:5353"/> <propval type="astring" name="dns_address" value="[fd00:1122:3344:1::1]:53"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
4632024-06-25T22:04:46.196ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:87 prefix = Ipv6Prefix { addr: fd00:1122:3344:1::, len: 64 }
4642024-06-25T22:04:46.196ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_79398434-906b-4472-847f-0189e9312ea1: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService3"/> <propval type="astring" name="gateway" value="fd00:1122:3344:2::2"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:2::1"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value="[fd00:1122:3344:2::1]:5353"/> <propval type="astring" name="dns_address" value="[fd00:1122:3344:2::1]:53"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
4652024-06-25T22:04:46.196ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:87 prefix = Ipv6Prefix { addr: fd00:1122:3344:2::, len: 64 }
4662024-06-25T22:04:46.205ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d58098f0-4531-4b55-bc79-e8c8efa00887") failed: Property not found. retry in 30.79016ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d58098f0-4531-4b55-bc79-e8c8efa00887
4672024-06-25T22:04:46.205ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_internal_dns_2402ccbd-c33c-4a93-99e0-a27dc8725e46
4682024-06-25T22:04:46.209ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_internal_dns_79398434-906b-4472-847f-0189e9312ea1
4692024-06-25T22:04:46.246ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d58098f0-4531-4b55-bc79-e8c8efa00887") failed: Property not found. retry in 61.706406ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d58098f0-4531-4b55-bc79-e8c8efa00887
4702024-06-25T22:04:46.317ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d58098f0-4531-4b55-bc79-e8c8efa00887") failed: Property not found. retry in 225.276257ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d58098f0-4531-4b55-bc79-e8c8efa00887
4712024-06-25T22:04:46.335ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_2402ccbd-c33c-4a93-99e0-a27dc8725e46") failed: Property not found. retry in 32.495094ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_2402ccbd-c33c-4a93-99e0-a27dc8725e46
4722024-06-25T22:04:46.341ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_79398434-906b-4472-847f-0189e9312ea1") failed: Property not found. retry in 65.73792ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_79398434-906b-4472-847f-0189e9312ea1
4732024-06-25T22:04:46.374ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_2402ccbd-c33c-4a93-99e0-a27dc8725e46") failed: Property not found. retry in 83.450467ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_2402ccbd-c33c-4a93-99e0-a27dc8725e46
4742024-06-25T22:04:46.507ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_79398434-906b-4472-847f-0189e9312ea1") failed: Property not found. retry in 141.200386ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_79398434-906b-4472-847f-0189e9312ea1
4752024-06-25T22:04:46.661ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_2402ccbd-c33c-4a93-99e0-a27dc8725e46") failed: Property not found. retry in 269.323098ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_2402ccbd-c33c-4a93-99e0-a27dc8725e46
4762024-06-25T22:04:46.672ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_79398434-906b-4472-847f-0189e9312ea1") failed: Property not found. retry in 103.262357ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_79398434-906b-4472-847f-0189e9312ea1
4772024-06-25T22:04:46.687ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d58098f0-4531-4b55-bc79-e8c8efa00887") failed: Property not found. retry in 222.985027ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d58098f0-4531-4b55-bc79-e8c8efa00887
4782024-06-25T22:04:46.795ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_79398434-906b-4472-847f-0189e9312ea1") failed: Property not found. retry in 454.530938ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_79398434-906b-4472-847f-0189e9312ea1
4792024-06-25T22:04:46.920ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d58098f0-4531-4b55-bc79-e8c8efa00887") failed: Property not found. retry in 892.642462ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d58098f0-4531-4b55-bc79-e8c8efa00887
4802024-06-25T22:04:46.941ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_2402ccbd-c33c-4a93-99e0-a27dc8725e46") failed: Property not found. retry in 426.670655ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_2402ccbd-c33c-4a93-99e0-a27dc8725e46
4812024-06-25T22:04:47.259ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_79398434-906b-4472-847f-0189e9312ea1") failed: Property not found. retry in 731.349672ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_79398434-906b-4472-847f-0189e9312ea1
4822024-06-25T22:04:47.377ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_2402ccbd-c33c-4a93-99e0-a27dc8725e46") failed: Property not found. retry in 1.040763411s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_2402ccbd-c33c-4a93-99e0-a27dc8725e46
4832024-06-25T22:04:47.822ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d58098f0-4531-4b55-bc79-e8c8efa00887") failed: Property not found. retry in 990.924345ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d58098f0-4531-4b55-bc79-e8c8efa00887
4842024-06-25T22:04:47.999ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_79398434-906b-4472-847f-0189e9312ea1") failed: Property not found. retry in 731.969097ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_79398434-906b-4472-847f-0189e9312ea1
4852024-06-25T22:04:48.426ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_2402ccbd-c33c-4a93-99e0-a27dc8725e46") failed: Property not found. retry in 656.744628ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_2402ccbd-c33c-4a93-99e0-a27dc8725e46
4862024-06-25T22:04:48.740ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_79398434-906b-4472-847f-0189e9312ea1") failed: Property not found. retry in 784.68292ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_79398434-906b-4472-847f-0189e9312ea1
4872024-06-25T22:04:48.751ZINFOSledAgent (ServiceManager): Ensuring bootstrap address fdb0:18c0:4d0d:9fb2::2 exists in switch zone file = sled-agent/src/services.rs:2250
4882024-06-25T22:04:48.751ZINFOSledAgent (ServiceManager): Adding bootstrap address file = illumos-utils/src/running_zone.rs:626 zone = oxz_switch
4892024-06-25T22:04:48.821ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d58098f0-4531-4b55-bc79-e8c8efa00887") failed: Property not found. retry in 1.450522243s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d58098f0-4531-4b55-bc79-e8c8efa00887
4902024-06-25T22:04:49.092ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_2402ccbd-c33c-4a93-99e0-a27dc8725e46") failed: Property not found. retry in 922.830961ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_2402ccbd-c33c-4a93-99e0-a27dc8725e46
4912024-06-25T22:04:49.300ZINFOSledAgent (ServiceManager): Forwarding bootstrap traffic via oxBootstrap0 to fe80::8:20ff:feaf:3120 file = sled-agent/src/services.rs:2257
4922024-06-25T22:04:49.306ZINFOSledAgent (ServiceManager): Zone not using gateway (even though underlay is up) file = sled-agent/src/services.rs:2318
4932024-06-25T22:04:49.424ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2503
4942024-06-25T22:04:49.535ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_79398434-906b-4472-847f-0189e9312ea1") failed: Property not found. retry in 547.741871ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_79398434-906b-4472-847f-0189e9312ea1
4952024-06-25T22:04:49.657ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2667
4962024-06-25T22:04:49.839ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2382
4972024-06-25T22:04:50.024ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_2402ccbd-c33c-4a93-99e0-a27dc8725e46") failed: Property not found. retry in 1.179091973s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_2402ccbd-c33c-4a93-99e0-a27dc8725e46
4982024-06-25T22:04:50.090ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_79398434-906b-4472-847f-0189e9312ea1") failed: Property not found. retry in 1.111719837s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_79398434-906b-4472-847f-0189e9312ea1
4992024-06-25T22:04:50.129ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2417
5002024-06-25T22:04:50.280ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d58098f0-4531-4b55-bc79-e8c8efa00887") failed: Property not found. retry in 983.825352ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d58098f0-4531-4b55-bc79-e8c8efa00887
5012024-06-25T22:04:50.325ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:2717
5022024-06-25T22:04:50.489ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:2744
5032024-06-25T22:04:50.690ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2611
5042024-06-25T22:04:50.859ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2411
5052024-06-25T22:04:50.869ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:3803 new = [fd00:1122:3344:101::2, ::1] old = [::1]
5062024-06-25T22:04:50.869ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:3819
5072024-06-25T22:04:50.869ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:609 zone = oxz_switch
5082024-06-25T22:04:51.210ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_79398434-906b-4472-847f-0189e9312ea1") failed: Property not found. retry in 1.240924387s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_79398434-906b-4472-847f-0189e9312ea1
5092024-06-25T22:04:51.218ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_2402ccbd-c33c-4a93-99e0-a27dc8725e46") failed: Property not found. retry in 1.213607329s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_2402ccbd-c33c-4a93-99e0-a27dc8725e46
5102024-06-25T22:04:51.272ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d58098f0-4531-4b55-bc79-e8c8efa00887") failed: Property not found. retry in 989.119818ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d58098f0-4531-4b55-bc79-e8c8efa00887
5112024-06-25T22:04:51.423ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:3827
5122024-06-25T22:04:51.429ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:3883
5132024-06-25T22:04:51.557ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:3945
5142024-06-25T22:04:51.657ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:3926 rack_subnet = fd00:1122:3344::
5152024-06-25T22:04:51.679ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:3973
5162024-06-25T22:04:51.784ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4000
5172024-06-25T22:04:51.910ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:369
5182024-06-25T22:04:51.942ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:417
5192024-06-25T22:04:51.973ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:656
5202024-06-25T22:04:51.973ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:694
5212024-06-25T22:04:51.974ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:697 uptime = 2
5222024-06-25T22:04:51.974ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.1.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: None,\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:439
5232024-06-25T22:04:52.049ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:381
5242024-06-25T22:04:52.049ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
5252024-06-25T22:04:52.049ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
5262024-06-25T22:04:52.049ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
5272024-06-25T22:04:52.049ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
5282024-06-25T22:04:52.050ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
5292024-06-25T22:04:52.050ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
5302024-06-25T22:04:52.050ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
5312024-06-25T22:04:52.050ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
5322024-06-25T22:04:52.050ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
5332024-06-25T22:04:52.050ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
5342024-06-25T22:04:52.050ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
5352024-06-25T22:04:52.050ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
5362024-06-25T22:04:52.050ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
5372024-06-25T22:04:52.050ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
5382024-06-25T22:04:52.050ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
5392024-06-25T22:04:52.050ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
5402024-06-25T22:04:52.050ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
5412024-06-25T22:04:52.050ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
5422024-06-25T22:04:52.050ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
5432024-06-25T22:04:52.050ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
5442024-06-25T22:04:52.050ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
5452024-06-25T22:04:52.050ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
5462024-06-25T22:04:52.270ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d58098f0-4531-4b55-bc79-e8c8efa00887") failed: Property not found. retry in 1.319579074s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d58098f0-4531-4b55-bc79-e8c8efa00887
5472024-06-25T22:04:52.440ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_2402ccbd-c33c-4a93-99e0-a27dc8725e46") failed: Property not found. retry in 923.921072ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_2402ccbd-c33c-4a93-99e0-a27dc8725e46
5482024-06-25T22:04:52.460ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_79398434-906b-4472-847f-0189e9312ea1") failed: Property not found. retry in 1.119984155s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_79398434-906b-4472-847f-0189e9312ea1
5492024-06-25T22:04:53.374ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_2402ccbd-c33c-4a93-99e0-a27dc8725e46") failed: Property not found. retry in 1.477961082s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_2402ccbd-c33c-4a93-99e0-a27dc8725e46
5502024-06-25T22:04:53.589ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_79398434-906b-4472-847f-0189e9312ea1") failed: Property not found. retry in 1.0073251s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_79398434-906b-4472-847f-0189e9312ea1
5512024-06-25T22:04:53.598ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d58098f0-4531-4b55-bc79-e8c8efa00887") failed: Property not found. retry in 670.273991ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d58098f0-4531-4b55-bc79-e8c8efa00887
5522024-06-25T22:04:54.277ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d58098f0-4531-4b55-bc79-e8c8efa00887") failed: Property not found. retry in 1.427633639s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d58098f0-4531-4b55-bc79-e8c8efa00887
5532024-06-25T22:04:54.605ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_79398434-906b-4472-847f-0189e9312ea1") failed: Property not found. retry in 1.012597562s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_79398434-906b-4472-847f-0189e9312ea1
5542024-06-25T22:04:54.860ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_2402ccbd-c33c-4a93-99e0-a27dc8725e46") failed: Property not found. retry in 1.362816425s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_2402ccbd-c33c-4a93-99e0-a27dc8725e46
5552024-06-25T22:04:55.381ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54681
5562024-06-25T22:04:55.381ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 72 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54681 req_id = ee8075d7-6cf0-4fe1-8119-ebc24b6087b2 response_code = 200 uri = /baseboard
5572024-06-25T22:04:56.243ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2956 zone = oxz_internal_dns_d58098f0-4531-4b55-bc79-e8c8efa00887
5582024-06-25T22:04:56.243ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2956 zone = oxz_internal_dns_2402ccbd-c33c-4a93-99e0-a27dc8725e46
5592024-06-25T22:04:56.243ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2956 zone = oxz_internal_dns_79398434-906b-4472-847f-0189e9312ea1
5602024-06-25T22:04:56.243ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/c1b4be1d-f4e3-4e74-a94a-e989f58db5ee/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
5612024-06-25T22:04:56.243ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/d56b00ad-a3b5-4f85-a7d9-5f806111674c/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
5622024-06-25T22:04:56.244ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 12815577 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:37801 req_id = 5473dbe4-6cf3-4ad7-83b7-90565baab107 response_code = 204 uri = /omicron-zones
5632024-06-25T22:04:56.245ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:549
5642024-06-25T22:04:57.474ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 112.522843ms) dns_config_addr = [fd00:1122:3344:1::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:1::1]:5353/config): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:569
5652024-06-25T22:04:57.623ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:549
5662024-06-25T22:04:57.685ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:549
5672024-06-25T22:04:57.747ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:585
5682024-06-25T22:04:57.747ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:263
5692024-06-25T22:04:57.779ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:280
5702024-06-25T22:04:57.780ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:305
5712024-06-25T22:04:57.780ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:197
5722024-06-25T22:04:57.822ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: 2402ccbd-c33c-4a93-99e0-a27dc8725e46, underlay_address: fd00:1122:3344:1::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b24fcace-6491-450a-a369-72a4fa2f698d (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 79398434-906b-4472-847f-0189e9312ea1, underlay_address: fd00:1122:3344:2::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: bbe28fca-3fd1-4387-a7f4-68f98c1de91a (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: d58098f0-4531-4b55-bc79-e8c8efa00887, underlay_address: fd00:1122:3344:3::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2d7d2d68-0dff-4e99-8278-b931af9c51f9 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 186876d9-c78f-46d8-9abe-0f5de30254b6, underlay_address: fd00:1122:3344:101::1b, zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 36d20914-1828-4d31-b752-987e88f29a01, kind: Service { id: 186876d9-c78f-46d8-9abe-0f5de30254b6 }, name: Name("ntp-186876d9-c78f-46d8-9abe-0f5de30254b6"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 135, 171])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:431 sled_address = [fd00:1122:3344:101::1]:12345
5732024-06-25T22:04:57.822ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45274
5742024-06-25T22:04:57.822ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 2402ccbd-c33c-4a93-99e0-a27dc8725e46, dataset_name: DatasetName { pool_name: ZpoolName { id: b24fcace-6491-450a-a369-72a4fa2f698d (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
5752024-06-25T22:04:57.822ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 2402ccbd-c33c-4a93-99e0-a27dc8725e46, dataset_name: DatasetName { pool_name: ZpoolName { id: b24fcace-6491-450a-a369-72a4fa2f698d (zpool), kind: External }, kind: InternalDns }, responder: ... }
5762024-06-25T22:04:57.844ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 79398434-906b-4472-847f-0189e9312ea1, dataset_name: DatasetName { pool_name: ZpoolName { id: bbe28fca-3fd1-4387-a7f4-68f98c1de91a (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
5772024-06-25T22:04:57.844ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 79398434-906b-4472-847f-0189e9312ea1, dataset_name: DatasetName { pool_name: ZpoolName { id: bbe28fca-3fd1-4387-a7f4-68f98c1de91a (zpool), kind: External }, kind: InternalDns }, responder: ... }
5782024-06-25T22:04:57.865ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d58098f0-4531-4b55-bc79-e8c8efa00887, dataset_name: DatasetName { pool_name: ZpoolName { id: 2d7d2d68-0dff-4e99-8278-b931af9c51f9 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
5792024-06-25T22:04:57.865ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: d58098f0-4531-4b55-bc79-e8c8efa00887, dataset_name: DatasetName { pool_name: ZpoolName { id: 2d7d2d68-0dff-4e99-8278-b931af9c51f9 (zpool), kind: External }, kind: InternalDns }, responder: ... }
5802024-06-25T22:04:57.885ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
5812024-06-25T22:04:57.885ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/c1b4be1d-f4e3-4e74-a94a-e989f58db5ee/config/omicron-zones.json file = common/src/ledger.rs:177
5822024-06-25T22:04:57.885ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/d56b00ad-a3b5-4f85-a7d9-5f806111674c/config/omicron-zones.json file = common/src/ledger.rs:177
5832024-06-25T22:04:57.885ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
5842024-06-25T22:04:57.897ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:263
5852024-06-25T22:04:57.928ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:280
5862024-06-25T22:04:57.929ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:305
5872024-06-25T22:04:57.929ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:197
5882024-06-25T22:04:57.972ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:393 port = Port { inner: PortInner { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 135, 171]), slot: 0, vni: Vni { inner: 100 }, gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 }, vnic: "vopte0" } }
5892024-06-25T22:04:57.972ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1190 zone_type = ntp
5902024-06-25T22:04:57.973ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:83
5912024-06-25T22:04:57.973ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:90
5922024-06-25T22:04:57.973ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:118
5932024-06-25T22:04:57.976ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
5942024-06-25T22:04:57.999ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_186876d9-c78f-46d8-9abe-0f5de30254b6 file = illumos-utils/src/zone.rs:315
5952024-06-25T22:04:58.017ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_186876d9-c78f-46d8-9abe-0f5de30254b6 file = illumos-utils/src/zone.rs:354
5962024-06-25T22:04:58.667ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_186876d9-c78f-46d8-9abe-0f5de30254b6: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService4"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::1b"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value="fd00:1122:3344:100::/56"/> <propval type="boolean" name="boundary" value="true"/> <propval type="astring" name="server" value="0.pool.ntp.org"/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value="vopte0"/> <propval type="astring" name="gateway" value="172.30.3.1"/> <propval type="astring" name="ip" value="172.30.3.5"/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
5972024-06-25T22:04:58.667ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_ntp_186876d9-c78f-46d8-9abe-0f5de30254b6
5982024-06-25T22:04:58.797ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_186876d9-c78f-46d8-9abe-0f5de30254b6") failed: Property not found. retry in 38.727825ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_186876d9-c78f-46d8-9abe-0f5de30254b6
5992024-06-25T22:04:58.842ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_186876d9-c78f-46d8-9abe-0f5de30254b6") failed: Property not found. retry in 79.861542ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_186876d9-c78f-46d8-9abe-0f5de30254b6
6002024-06-25T22:04:58.933ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_186876d9-c78f-46d8-9abe-0f5de30254b6") failed: Property not found. retry in 170.449238ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_186876d9-c78f-46d8-9abe-0f5de30254b6
6012024-06-25T22:04:59.115ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_186876d9-c78f-46d8-9abe-0f5de30254b6") failed: Property not found. retry in 398.818896ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_186876d9-c78f-46d8-9abe-0f5de30254b6
6022024-06-25T22:04:59.523ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_186876d9-c78f-46d8-9abe-0f5de30254b6") failed: Property not found. retry in 744.492269ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_186876d9-c78f-46d8-9abe-0f5de30254b6
6032024-06-25T22:05:00.280ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_186876d9-c78f-46d8-9abe-0f5de30254b6") failed: Property not found. retry in 980.473801ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_186876d9-c78f-46d8-9abe-0f5de30254b6
6042024-06-25T22:05:00.390ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/98068951-ddeb-40ca-9677-d05b350bbf94): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = 98068951-ddeb-40ca-9677-d05b350bbf94
6052024-06-25T22:05:01.268ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_186876d9-c78f-46d8-9abe-0f5de30254b6") failed: Property not found. retry in 1.338232046s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_186876d9-c78f-46d8-9abe-0f5de30254b6
6062024-06-25T22:05:01.381ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/98068951-ddeb-40ca-9677-d05b350bbf94): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:619 sled_id = 98068951-ddeb-40ca-9677-d05b350bbf94
6072024-06-25T22:05:02.616ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_186876d9-c78f-46d8-9abe-0f5de30254b6") failed: Property not found. retry in 1.388851929s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_186876d9-c78f-46d8-9abe-0f5de30254b6
6082024-06-25T22:05:04.026ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2956 zone = oxz_ntp_186876d9-c78f-46d8-9abe-0f5de30254b6
6092024-06-25T22:05:04.026ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/c1b4be1d-f4e3-4e74-a94a-e989f58db5ee/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
6102024-06-25T22:05:04.026ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/d56b00ad-a3b5-4f85-a7d9-5f806111674c/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
6112024-06-25T22:05:04.026ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 6204350 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:45274 req_id = 4d716491-cd9c-44a1-9c3f-a9b77ea774bd response_code = 204 uri = /omicron-zones
6122024-06-25T22:05:04.028ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:626
6132024-06-25T22:05:04.057ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6142024-06-25T22:05:04.057ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61644
6152024-06-25T22:05:04.067ZINFOSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_186876d9-c78f-46d8-9abe-0f5de30254b6': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3533
6162024-06-25T22:05:04.067ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:866 latency_us = 9886 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:61644 req_id = b092a7bb-99d7-487a-acfd-f123f7a79523 response_code = 500 uri = /timesync
6172024-06-25T22:05:04.070ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6182024-06-25T22:05:04.231ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6192024-06-25T22:05:04.231ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33692
6202024-06-25T22:05:08.240ZINFOSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_186876d9-c78f-46d8-9abe-0f5de30254b6': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3533
6212024-06-25T22:05:08.240ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:866 latency_us = 4008824 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:33692 req_id = c1512ef8-e5b5-4319-86bf-18205f8b3eaf response_code = 500 uri = /timesync
6222024-06-25T22:05:08.243ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6232024-06-25T22:05:08.335ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6242024-06-25T22:05:08.335ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40831
6252024-06-25T22:05:08.344ZINFOSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_186876d9-c78f-46d8-9abe-0f5de30254b6': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3533
6262024-06-25T22:05:08.345ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:866 latency_us = 9016 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40831 req_id = b6c8da01-3b17-47d9-81ce-b87b123a09ba response_code = 500 uri = /timesync
6272024-06-25T22:05:08.347ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6282024-06-25T22:05:08.486ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6292024-06-25T22:05:08.487ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40913
6302024-06-25T22:05:12.496ZINFOSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_186876d9-c78f-46d8-9abe-0f5de30254b6': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3533
6312024-06-25T22:05:12.496ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:866 latency_us = 4009515 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40913 req_id = a7d2a9d1-3262-4e8b-94da-321912a7fc4b response_code = 500 uri = /timesync
6322024-06-25T22:05:12.499ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6332024-06-25T22:05:12.704ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6342024-06-25T22:05:12.704ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62496
6352024-06-25T22:05:12.713ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 8776 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:62496 req_id = 08f2f0cd-65db-4a19-ad2a-e485216aed46 response_code = 200 uri = /timesync
6362024-06-25T22:05:12.716ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:634
6372024-06-25T22:05:12.716ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6382024-06-25T22:05:12.852ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 205.011526ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:423 sled_id = 98068951-ddeb-40ca-9677-d05b350bbf94
6392024-06-25T22:05:12.911ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6402024-06-25T22:05:12.911ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60893
6412024-06-25T22:05:12.920ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 9038 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:60893 req_id = 0641ec67-cca0-402e-a549-08eba0b62a98 response_code = 200 uri = /timesync
6422024-06-25T22:05:12.922ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:634
6432024-06-25T22:05:12.922ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6442024-06-25T22:05:13.231ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6452024-06-25T22:05:13.231ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60672
6462024-06-25T22:05:13.240ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 8273 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:60672 req_id = 816549a6-4d63-400a-9f63-d351a7290048 response_code = 200 uri = /timesync
6472024-06-25T22:05:13.242ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:634
6482024-06-25T22:05:13.242ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6492024-06-25T22:05:13.427ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6502024-06-25T22:05:13.427ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45939
6512024-06-25T22:05:13.434ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 7528 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:45939 req_id = 34d64afd-fd1d-4a98-a1e4-a0cbe3b065f9 response_code = 200 uri = /timesync
6522024-06-25T22:05:13.437ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:634
6532024-06-25T22:05:13.437ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6542024-06-25T22:05:13.778ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6552024-06-25T22:05:13.778ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45936
6562024-06-25T22:05:13.787ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 8743 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:45936 req_id = 315f3de9-5514-495e-af68-97e137d98a07 response_code = 200 uri = /timesync
6572024-06-25T22:05:13.789ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:634
6582024-06-25T22:05:13.789ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6592024-06-25T22:05:14.276ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6602024-06-25T22:05:14.276ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47651
6612024-06-25T22:05:14.284ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 8376 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:47651 req_id = 04aeea61-5716-48bc-9fc0-d59051bc15ae response_code = 200 uri = /timesync
6622024-06-25T22:05:14.287ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:634
6632024-06-25T22:05:14.287ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6642024-06-25T22:05:14.668ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6652024-06-25T22:05:14.668ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47134
6662024-06-25T22:05:14.676ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 7326 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:47134 req_id = ce7fc644-c8d8-4ca3-ba37-131479b9269b response_code = 200 uri = /timesync
6672024-06-25T22:05:14.677ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:634
6682024-06-25T22:05:14.677ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6692024-06-25T22:05:15.390ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6702024-06-25T22:05:15.391ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52102
6712024-06-25T22:05:15.400ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 8968 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:52102 req_id = deabbc0d-0331-4d48-a1d7-c0e1727af22c response_code = 200 uri = /timesync
6722024-06-25T22:05:15.401ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:634
6732024-06-25T22:05:15.401ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6742024-06-25T22:05:15.826ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6752024-06-25T22:05:15.826ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35737
6762024-06-25T22:05:15.835ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 8783 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:35737 req_id = 3fda7990-ee02-4e87-82d9-06d89ea5d1a2 response_code = 200 uri = /timesync
6772024-06-25T22:05:15.838ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:634
6782024-06-25T22:05:15.838ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6792024-06-25T22:05:16.843ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6802024-06-25T22:05:16.843ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55889
6812024-06-25T22:05:16.853ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 9236 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:55889 req_id = 18259e1a-986a-4d52-baf3-b815ed6afdff response_code = 200 uri = /timesync
6822024-06-25T22:05:16.855ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:634
6832024-06-25T22:05:16.855ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6842024-06-25T22:05:18.071ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6852024-06-25T22:05:18.071ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54364
6862024-06-25T22:05:18.080ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 8613 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:54364 req_id = 374145c9-3577-4068-a245-d4338048b515 response_code = 200 uri = /timesync
6872024-06-25T22:05:18.082ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:634
6882024-06-25T22:05:18.082ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6892024-06-25T22:05:19.655ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6902024-06-25T22:05:19.656ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36185
6912024-06-25T22:05:19.664ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 8700 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:36185 req_id = 6f326c80-6bbe-4c90-a959-b1ccb33678ca response_code = 200 uri = /timesync
6922024-06-25T22:05:19.668ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:634
6932024-06-25T22:05:19.668ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6942024-06-25T22:05:21.477ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6952024-06-25T22:05:21.477ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49078
6962024-06-25T22:05:21.486ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 8695 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:49078 req_id = a43a0305-eca9-4ad4-8f59-296e7a4e5d02 response_code = 200 uri = /timesync
6972024-06-25T22:05:21.488ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:634
6982024-06-25T22:05:21.488ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6992024-06-25T22:05:23.877ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
7002024-06-25T22:05:23.877ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39050
7012024-06-25T22:05:23.886ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 8972 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39050 req_id = 23cf45e5-ce62-44ce-948a-a5d493281103 response_code = 200 uri = /timesync
7022024-06-25T22:05:23.889ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:634
7032024-06-25T22:05:23.889ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
7042024-06-25T22:05:25.990ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49570
7052024-06-25T22:05:25.990ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 47 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49570 req_id = e0c2edff-a225-46be-98f9-7db31e156a45 response_code = 200 uri = /baseboard
7062024-06-25T22:05:27.173ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
7072024-06-25T22:05:27.173ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36932
7082024-06-25T22:05:27.181ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 8442 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:36932 req_id = c1e8fa4b-8de7-4c17-bd36-ea5744396c97 response_code = 200 uri = /timesync
7092024-06-25T22:05:27.184ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:634
7102024-06-25T22:05:27.184ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
7112024-06-25T22:05:28.666ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 524.469461ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:423 sled_id = 98068951-ddeb-40ca-9677-d05b350bbf94
7122024-06-25T22:05:29.508ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
7132024-06-25T22:05:29.509ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37776
7142024-06-25T22:05:29.518ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 9249 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:37776 req_id = 865f810f-3147-4327-9680-afc348087f5e response_code = 200 uri = /timesync
7152024-06-25T22:05:29.520ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:634
7162024-06-25T22:05:29.520ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
7172024-06-25T22:05:34.199ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
7182024-06-25T22:05:34.199ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55178
7192024-06-25T22:05:34.209ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 9029 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:55178 req_id = af22b5f1-3e55-47dd-8b92-a5a00349586e response_code = 200 uri = /timesync
7202024-06-25T22:05:34.211ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:634
7212024-06-25T22:05:34.211ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
7222024-06-25T22:05:38.237ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
7232024-06-25T22:05:38.237ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34730
7242024-06-25T22:05:38.247ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 9191 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:34730 req_id = 4b1afb85-90fa-4b13-8297-d6212acc773d response_code = 200 uri = /timesync
7252024-06-25T22:05:38.249ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:634
7262024-06-25T22:05:38.249ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
7272024-06-25T22:05:44.225ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.308548657s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:423 sled_id = 98068951-ddeb-40ca-9677-d05b350bbf94
7282024-06-25T22:05:44.956ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
7292024-06-25T22:05:44.956ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56270
7302024-06-25T22:05:44.965ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 8849 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:56270 req_id = 66e0b343-bf01-4961-a842-e8eb4af183e0 response_code = 200 uri = /timesync
7312024-06-25T22:05:44.967ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:634
7322024-06-25T22:05:44.967ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
7332024-06-25T22:05:53.175ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
7342024-06-25T22:05:53.175ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55582
7352024-06-25T22:05:53.184ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 8931 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:55582 req_id = e3f1d62e-1946-40b6-9281-77c515f1beaf response_code = 200 uri = /timesync
7362024-06-25T22:05:53.186ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:634
7372024-06-25T22:05:53.186ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
7382024-06-25T22:05:56.023ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:57026
7392024-06-25T22:05:56.023ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 43 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:57026 req_id = c06cad95-7c46-47aa-8b49-eb00d947fbc9 response_code = 200 uri = /baseboard
7402024-06-25T22:05:57.546ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
7412024-06-25T22:05:57.546ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64354
7422024-06-25T22:05:57.555ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 9422 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:64354 req_id = 017495e7-bbd4-489f-8de8-02f871f4eec3 response_code = 200 uri = /timesync
7432024-06-25T22:05:57.558ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:634
7442024-06-25T22:05:57.558ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
7452024-06-25T22:06:00.569ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 2.795073903s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:423 sled_id = 98068951-ddeb-40ca-9677-d05b350bbf94
7462024-06-25T22:06:03.991ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
7472024-06-25T22:06:03.992ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33097
7482024-06-25T22:06:04.001ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 8771 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:33097 req_id = d55cf9fa-deec-4d0f-8944-7690faa46a0f response_code = 200 uri = /timesync
7492024-06-25T22:06:04.003ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:634
7502024-06-25T22:06:04.003ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
7512024-06-25T22:06:16.219ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
7522024-06-25T22:06:16.219ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34941
7532024-06-25T22:06:16.228ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 8977 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:34941 req_id = f7afa28a-793a-44de-bd87-6331359fb213 response_code = 200 uri = /timesync
7542024-06-25T22:06:16.230ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:634
7552024-06-25T22:06:16.230ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
7562024-06-25T22:06:18.399ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 3.172935154s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:423 sled_id = 98068951-ddeb-40ca-9677-d05b350bbf94
7572024-06-25T22:06:23.288ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
7582024-06-25T22:06:23.288ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38169
7592024-06-25T22:06:23.297ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 8841 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:38169 req_id = e2cce1e4-c7f3-4406-90d9-020f19bb16bb response_code = 200 uri = /timesync
7602024-06-25T22:06:23.300ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:634
7612024-06-25T22:06:23.300ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
7622024-06-25T22:06:26.188ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54482
7632024-06-25T22:06:26.189ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 501 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54482 req_id = 5028ae7c-e622-463b-847f-847ae910e576 response_code = 200 uri = /baseboard
7642024-06-25T22:06:36.741ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 4.04678071s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:423 sled_id = 98068951-ddeb-40ca-9677-d05b350bbf94
7652024-06-25T22:06:42.770ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
7662024-06-25T22:06:42.770ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62884
7672024-06-25T22:06:42.780ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 8938 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:62884 req_id = c4590fde-b202-4e40-aef4-74ea5456cb0c response_code = 200 uri = /timesync
7682024-06-25T22:06:42.782ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:634
7692024-06-25T22:06:42.782ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
7702024-06-25T22:06:55.821ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 22.042442107s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:423 sled_id = 98068951-ddeb-40ca-9677-d05b350bbf94
7712024-06-25T22:06:56.221ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:47215
7722024-06-25T22:06:56.221ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 44 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:47215 req_id = a6bc94eb-924f-4e8a-88fd-ed39c8df7710 response_code = 200 uri = /baseboard
7732024-06-25T22:07:00.746ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
7742024-06-25T22:07:00.747ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53623
7752024-06-25T22:07:00.755ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 8250 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:53623 req_id = 2909706f-cbc1-4505-819e-9435fad675a9 response_code = 200 uri = /timesync
7762024-06-25T22:07:00.758ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:634
7772024-06-25T22:07:00.758ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
7782024-06-25T22:07:20.650ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
7792024-06-25T22:07:20.650ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45883
7802024-06-25T22:07:20.660ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 8957 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:45883 req_id = 850356f5-8cce-4155-a665-dc311315cbcd response_code = 200 uri = /timesync
7812024-06-25T22:07:20.662ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:634
7822024-06-25T22:07:20.662ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
7832024-06-25T22:07:26.252ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42041
7842024-06-25T22:07:26.253ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 835 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42041 req_id = db4e1e1e-4f3e-4e16-a233-0dbab39f36ff response_code = 200 uri = /baseboard
7852024-06-25T22:07:32.881ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 25.747660666s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:423 sled_id = 98068951-ddeb-40ca-9677-d05b350bbf94
7862024-06-25T22:07:45.195ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
7872024-06-25T22:07:45.195ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47150
7882024-06-25T22:07:45.204ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 9220 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:47150 req_id = 4a078af4-d158-4abc-8ef2-ff9faef791f4 response_code = 200 uri = /timesync
7892024-06-25T22:07:45.207ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.26331532 } file = sled-agent/src/rack_setup/service.rs:634
7902024-06-25T22:07:45.207ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
7912024-06-25T22:07:56.207ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42741
7922024-06-25T22:07:56.207ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 47 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42741 req_id = 4bedc8f1-7174-41a7-8952-bb2a76cdf504 response_code = 200 uri = /baseboard
7932024-06-25T22:08:13.551ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 84.62325416s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:423 sled_id = 98068951-ddeb-40ca-9677-d05b350bbf94
7942024-06-25T22:08:20.753ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
7952024-06-25T22:08:20.753ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:32882
7962024-06-25T22:08:20.762ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 8940 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:32882 req_id = 300a2ad1-fe9d-4ada-bfde-76f4da95f4b0 response_code = 200 uri = /timesync
7972024-06-25T22:08:20.765ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.166752264 } file = sled-agent/src/rack_setup/service.rs:634
7982024-06-25T22:08:20.765ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
7992024-06-25T22:08:26.159ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46287
8002024-06-25T22:08:26.159ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 31 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46287 req_id = 48749f98-6608-4d83-b29f-3fc4bba52b2f response_code = 200 uri = /baseboard
8012024-06-25T22:08:56.111ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:35109
8022024-06-25T22:08:56.112ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 533 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:35109 req_id = 0da9d77b-b466-4696-8046-07edb61e3e6b response_code = 200 uri = /baseboard
8032024-06-25T22:09:11.653ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
8042024-06-25T22:09:11.653ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58247
8052024-06-25T22:09:11.674ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 20364 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:58247 req_id = 4bfdb0f7-9677-4b4c-aebb-5af403740981 response_code = 200 uri = /timesync
8062024-06-25T22:09:11.677ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 1097084582, ip_addr: 65.100.46.166, stratum: 2, ref_time: 1719353313.7549624, correction: -0.019774102 } file = sled-agent/src/rack_setup/service.rs:634
8072024-06-25T22:09:11.677ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1224
8082024-06-25T22:09:11.705ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 2402ccbd-c33c-4a93-99e0-a27dc8725e46, underlay_address: fd00:1122:3344:1::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b24fcace-6491-450a-a369-72a4fa2f698d (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 79398434-906b-4472-847f-0189e9312ea1, underlay_address: fd00:1122:3344:2::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: bbe28fca-3fd1-4387-a7f4-68f98c1de91a (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: d58098f0-4531-4b55-bc79-e8c8efa00887, underlay_address: fd00:1122:3344:3::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2d7d2d68-0dff-4e99-8278-b931af9c51f9 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 186876d9-c78f-46d8-9abe-0f5de30254b6, underlay_address: fd00:1122:3344:101::1b, zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 36d20914-1828-4d31-b752-987e88f29a01, kind: Service { id: 186876d9-c78f-46d8-9abe-0f5de30254b6 }, name: Name("ntp-186876d9-c78f-46d8-9abe-0f5de30254b6"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 135, 171])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 31d34a28-7501-4edf-a58c-efd9a1993026, underlay_address: fd00:1122:3344:101::3, zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b24fcace-6491-450a-a369-72a4fa2f698d (zpool), kind: External } } } }, OmicronZoneConfig { id: ff00699e-45ec-4610-a593-0fc5d5829200, underlay_address: fd00:1122:3344:101::4, zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: bbe28fca-3fd1-4387-a7f4-68f98c1de91a (zpool), kind: External } } } }, OmicronZoneConfig { id: edda0e18-89d1-46a3-9203-7ad35afbf850, underlay_address: fd00:1122:3344:101::5, zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2d7d2d68-0dff-4e99-8278-b931af9c51f9 (zpool), kind: External } } } }, OmicronZoneConfig { id: 2c991204-d84e-45c4-8ed3-3d12139a50db, underlay_address: fd00:1122:3344:101::6, zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a53379c5-166a-4c1c-987d-bc15e7c6ea9a (zpool), kind: External } } } }, OmicronZoneConfig { id: 183f869e-6d79-4fc9-b2ce-5673630f7297, underlay_address: fd00:1122:3344:101::7, zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d48dc185-6776-4e11-be12-99d059cde9ba (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:431 sled_address = [fd00:1122:3344:101::1]:12345
8092024-06-25T22:09:11.705ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52152
8102024-06-25T22:09:11.706ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 2402ccbd-c33c-4a93-99e0-a27dc8725e46, dataset_name: DatasetName { pool_name: ZpoolName { id: b24fcace-6491-450a-a369-72a4fa2f698d (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
8112024-06-25T22:09:11.706ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 2402ccbd-c33c-4a93-99e0-a27dc8725e46, dataset_name: DatasetName { pool_name: ZpoolName { id: b24fcace-6491-450a-a369-72a4fa2f698d (zpool), kind: External }, kind: InternalDns }, responder: ... }
8122024-06-25T22:09:11.726ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 79398434-906b-4472-847f-0189e9312ea1, dataset_name: DatasetName { pool_name: ZpoolName { id: bbe28fca-3fd1-4387-a7f4-68f98c1de91a (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
8132024-06-25T22:09:11.726ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 79398434-906b-4472-847f-0189e9312ea1, dataset_name: DatasetName { pool_name: ZpoolName { id: bbe28fca-3fd1-4387-a7f4-68f98c1de91a (zpool), kind: External }, kind: InternalDns }, responder: ... }
8142024-06-25T22:09:11.745ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d58098f0-4531-4b55-bc79-e8c8efa00887, dataset_name: DatasetName { pool_name: ZpoolName { id: 2d7d2d68-0dff-4e99-8278-b931af9c51f9 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
8152024-06-25T22:09:11.745ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: d58098f0-4531-4b55-bc79-e8c8efa00887, dataset_name: DatasetName { pool_name: ZpoolName { id: 2d7d2d68-0dff-4e99-8278-b931af9c51f9 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8162024-06-25T22:09:11.763ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 31d34a28-7501-4edf-a58c-efd9a1993026, dataset_name: DatasetName { pool_name: ZpoolName { id: b24fcace-6491-450a-a369-72a4fa2f698d (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
8172024-06-25T22:09:11.763ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 31d34a28-7501-4edf-a58c-efd9a1993026, dataset_name: DatasetName { pool_name: ZpoolName { id: b24fcace-6491-450a-a369-72a4fa2f698d (zpool), kind: External }, kind: CockroachDb }, responder: ... }
8182024-06-25T22:09:11.826ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: ff00699e-45ec-4610-a593-0fc5d5829200, dataset_name: DatasetName { pool_name: ZpoolName { id: bbe28fca-3fd1-4387-a7f4-68f98c1de91a (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
8192024-06-25T22:09:11.826ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: ff00699e-45ec-4610-a593-0fc5d5829200, dataset_name: DatasetName { pool_name: ZpoolName { id: bbe28fca-3fd1-4387-a7f4-68f98c1de91a (zpool), kind: External }, kind: CockroachDb }, responder: ... }
8202024-06-25T22:09:11.888ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: edda0e18-89d1-46a3-9203-7ad35afbf850, dataset_name: DatasetName { pool_name: ZpoolName { id: 2d7d2d68-0dff-4e99-8278-b931af9c51f9 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
8212024-06-25T22:09:11.888ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: edda0e18-89d1-46a3-9203-7ad35afbf850, dataset_name: DatasetName { pool_name: ZpoolName { id: 2d7d2d68-0dff-4e99-8278-b931af9c51f9 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
8222024-06-25T22:09:11.952ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 2c991204-d84e-45c4-8ed3-3d12139a50db, dataset_name: DatasetName { pool_name: ZpoolName { id: a53379c5-166a-4c1c-987d-bc15e7c6ea9a (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
8232024-06-25T22:09:11.952ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 2c991204-d84e-45c4-8ed3-3d12139a50db, dataset_name: DatasetName { pool_name: ZpoolName { id: a53379c5-166a-4c1c-987d-bc15e7c6ea9a (zpool), kind: External }, kind: CockroachDb }, responder: ... }
8242024-06-25T22:09:12.014ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 183f869e-6d79-4fc9-b2ce-5673630f7297, dataset_name: DatasetName { pool_name: ZpoolName { id: d48dc185-6776-4e11-be12-99d059cde9ba (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
8252024-06-25T22:09:12.014ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 183f869e-6d79-4fc9-b2ce-5673630f7297, dataset_name: DatasetName { pool_name: ZpoolName { id: d48dc185-6776-4e11-be12-99d059cde9ba (zpool), kind: External }, kind: CockroachDb }, responder: ... }
8262024-06-25T22:09:12.078ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
8272024-06-25T22:09:12.078ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/c1b4be1d-f4e3-4e74-a94a-e989f58db5ee/config/omicron-zones.json file = common/src/ledger.rs:177
8282024-06-25T22:09:12.078ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/d56b00ad-a3b5-4f85-a7d9-5f806111674c/config/omicron-zones.json file = common/src/ledger.rs:177
8292024-06-25T22:09:12.079ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
8302024-06-25T22:09:12.164ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
8312024-06-25T22:09:12.164ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
8322024-06-25T22:09:12.164ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
8332024-06-25T22:09:12.164ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
8342024-06-25T22:09:12.164ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
8352024-06-25T22:09:12.248ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_ff00699e-45ec-4610-a593-0fc5d5829200 file = illumos-utils/src/zone.rs:315
8362024-06-25T22:09:12.252ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_31d34a28-7501-4edf-a58c-efd9a1993026 file = illumos-utils/src/zone.rs:315
8372024-06-25T22:09:12.256ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_edda0e18-89d1-46a3-9203-7ad35afbf850 file = illumos-utils/src/zone.rs:315
8382024-06-25T22:09:12.261ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_183f869e-6d79-4fc9-b2ce-5673630f7297 file = illumos-utils/src/zone.rs:315
8392024-06-25T22:09:12.266ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_2c991204-d84e-45c4-8ed3-3d12139a50db file = illumos-utils/src/zone.rs:315
8402024-06-25T22:09:12.271ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_ff00699e-45ec-4610-a593-0fc5d5829200 file = illumos-utils/src/zone.rs:354
8412024-06-25T22:09:12.275ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_31d34a28-7501-4edf-a58c-efd9a1993026 file = illumos-utils/src/zone.rs:354
8422024-06-25T22:09:12.281ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_edda0e18-89d1-46a3-9203-7ad35afbf850 file = illumos-utils/src/zone.rs:354
8432024-06-25T22:09:12.285ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_183f869e-6d79-4fc9-b2ce-5673630f7297 file = illumos-utils/src/zone.rs:354
8442024-06-25T22:09:12.290ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_2c991204-d84e-45c4-8ed3-3d12139a50db file = illumos-utils/src/zone.rs:354
8452024-06-25T22:09:15.247ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_183f869e-6d79-4fc9-b2ce-5673630f7297: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService8"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::7"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="[fd00:1122:3344:101::7]:32221"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value="183f869e-6d79-4fc9-b2ce-5673630f7297"/> <propval type="astring" name="cockroach_address" value="[fd00:1122:3344:101::7]:32221"/> <propval type="astring" name="http_address" value="[fd00:1122:3344:101::7]:32222"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8462024-06-25T22:09:15.247ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_cockroachdb_183f869e-6d79-4fc9-b2ce-5673630f7297
8472024-06-25T22:09:15.257ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_ff00699e-45ec-4610-a593-0fc5d5829200: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService5"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::4"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="[fd00:1122:3344:101::4]:32221"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value="ff00699e-45ec-4610-a593-0fc5d5829200"/> <propval type="astring" name="cockroach_address" value="[fd00:1122:3344:101::4]:32221"/> <propval type="astring" name="http_address" value="[fd00:1122:3344:101::4]:32222"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8482024-06-25T22:09:15.257ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_31d34a28-7501-4edf-a58c-efd9a1993026: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService6"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::3"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="[fd00:1122:3344:101::3]:32221"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value="31d34a28-7501-4edf-a58c-efd9a1993026"/> <propval type="astring" name="cockroach_address" value="[fd00:1122:3344:101::3]:32221"/> <propval type="astring" name="http_address" value="[fd00:1122:3344:101::3]:32222"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8492024-06-25T22:09:15.257ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_cockroachdb_ff00699e-45ec-4610-a593-0fc5d5829200
8502024-06-25T22:09:15.263ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_cockroachdb_31d34a28-7501-4edf-a58c-efd9a1993026
8512024-06-25T22:09:15.271ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_edda0e18-89d1-46a3-9203-7ad35afbf850: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService7"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::5"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="[fd00:1122:3344:101::5]:32221"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value="edda0e18-89d1-46a3-9203-7ad35afbf850"/> <propval type="astring" name="cockroach_address" value="[fd00:1122:3344:101::5]:32221"/> <propval type="astring" name="http_address" value="[fd00:1122:3344:101::5]:32222"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8522024-06-25T22:09:15.271ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_cockroachdb_edda0e18-89d1-46a3-9203-7ad35afbf850
8532024-06-25T22:09:15.370ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_2c991204-d84e-45c4-8ed3-3d12139a50db: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService9"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::6"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="[fd00:1122:3344:101::6]:32221"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value="2c991204-d84e-45c4-8ed3-3d12139a50db"/> <propval type="astring" name="cockroach_address" value="[fd00:1122:3344:101::6]:32221"/> <propval type="astring" name="http_address" value="[fd00:1122:3344:101::6]:32222"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8542024-06-25T22:09:15.371ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_cockroachdb_2c991204-d84e-45c4-8ed3-3d12139a50db
8552024-06-25T22:09:15.384ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_183f869e-6d79-4fc9-b2ce-5673630f7297") failed: Property not found. retry in 57.936949ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_183f869e-6d79-4fc9-b2ce-5673630f7297
8562024-06-25T22:09:15.402ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_31d34a28-7501-4edf-a58c-efd9a1993026") failed: Property not found. retry in 38.406663ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_31d34a28-7501-4edf-a58c-efd9a1993026
8572024-06-25T22:09:15.409ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ff00699e-45ec-4610-a593-0fc5d5829200") failed: Property not found. retry in 27.204552ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ff00699e-45ec-4610-a593-0fc5d5829200
8582024-06-25T22:09:15.416ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_edda0e18-89d1-46a3-9203-7ad35afbf850") failed: Property not found. retry in 74.29733ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_edda0e18-89d1-46a3-9203-7ad35afbf850
8592024-06-25T22:09:15.457ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ff00699e-45ec-4610-a593-0fc5d5829200") failed: Property not found. retry in 98.106379ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ff00699e-45ec-4610-a593-0fc5d5829200
8602024-06-25T22:09:15.683ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_31d34a28-7501-4edf-a58c-efd9a1993026") failed: Property not found. retry in 145.03155ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_31d34a28-7501-4edf-a58c-efd9a1993026
8612024-06-25T22:09:15.773ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_183f869e-6d79-4fc9-b2ce-5673630f7297") failed: Property not found. retry in 56.742226ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_183f869e-6d79-4fc9-b2ce-5673630f7297
8622024-06-25T22:09:15.840ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ff00699e-45ec-4610-a593-0fc5d5829200") failed: Property not found. retry in 207.455102ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ff00699e-45ec-4610-a593-0fc5d5829200
8632024-06-25T22:09:15.915ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_31d34a28-7501-4edf-a58c-efd9a1993026") failed: Property not found. retry in 231.196941ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_31d34a28-7501-4edf-a58c-efd9a1993026
8642024-06-25T22:09:15.988ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_edda0e18-89d1-46a3-9203-7ad35afbf850") failed: Property not found. retry in 62.325178ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_edda0e18-89d1-46a3-9203-7ad35afbf850
8652024-06-25T22:09:16.116ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_183f869e-6d79-4fc9-b2ce-5673630f7297") failed: Property not found. retry in 111.724052ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_183f869e-6d79-4fc9-b2ce-5673630f7297
8662024-06-25T22:09:16.161ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2c991204-d84e-45c4-8ed3-3d12139a50db") failed: Property not found. retry in 36.816358ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2c991204-d84e-45c4-8ed3-3d12139a50db
8672024-06-25T22:09:16.206ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ff00699e-45ec-4610-a593-0fc5d5829200") failed: Property not found. retry in 228.642422ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ff00699e-45ec-4610-a593-0fc5d5829200
8682024-06-25T22:09:16.253ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_31d34a28-7501-4edf-a58c-efd9a1993026") failed: Property not found. retry in 389.516787ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_31d34a28-7501-4edf-a58c-efd9a1993026
8692024-06-25T22:09:16.290ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_edda0e18-89d1-46a3-9203-7ad35afbf850") failed: Property not found. retry in 228.473179ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_edda0e18-89d1-46a3-9203-7ad35afbf850
8702024-06-25T22:09:16.328ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_183f869e-6d79-4fc9-b2ce-5673630f7297") failed: Property not found. retry in 519.109842ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_183f869e-6d79-4fc9-b2ce-5673630f7297
8712024-06-25T22:09:16.384ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2c991204-d84e-45c4-8ed3-3d12139a50db") failed: Property not found. retry in 63.450083ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2c991204-d84e-45c4-8ed3-3d12139a50db
8722024-06-25T22:09:16.663ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ff00699e-45ec-4610-a593-0fc5d5829200") failed: Property not found. retry in 635.154244ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ff00699e-45ec-4610-a593-0fc5d5829200
8732024-06-25T22:09:16.790ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_31d34a28-7501-4edf-a58c-efd9a1993026") failed: Property not found. retry in 717.838524ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_31d34a28-7501-4edf-a58c-efd9a1993026
8742024-06-25T22:09:16.851ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_edda0e18-89d1-46a3-9203-7ad35afbf850") failed: Property not found. retry in 381.462813ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_edda0e18-89d1-46a3-9203-7ad35afbf850
8752024-06-25T22:09:16.931ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_183f869e-6d79-4fc9-b2ce-5673630f7297") failed: Property not found. retry in 1.007748217s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_183f869e-6d79-4fc9-b2ce-5673630f7297
8762024-06-25T22:09:17.015ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2c991204-d84e-45c4-8ed3-3d12139a50db") failed: Property not found. retry in 104.972068ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2c991204-d84e-45c4-8ed3-3d12139a50db
8772024-06-25T22:09:17.159ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2c991204-d84e-45c4-8ed3-3d12139a50db") failed: Property not found. retry in 290.20942ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2c991204-d84e-45c4-8ed3-3d12139a50db
8782024-06-25T22:09:17.273ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_edda0e18-89d1-46a3-9203-7ad35afbf850") failed: Property not found. retry in 433.377074ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_edda0e18-89d1-46a3-9203-7ad35afbf850
8792024-06-25T22:09:17.324ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ff00699e-45ec-4610-a593-0fc5d5829200") failed: Property not found. retry in 705.925466ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ff00699e-45ec-4610-a593-0fc5d5829200
8802024-06-25T22:09:17.470ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2c991204-d84e-45c4-8ed3-3d12139a50db") failed: Property not found. retry in 836.916463ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2c991204-d84e-45c4-8ed3-3d12139a50db
8812024-06-25T22:09:17.577ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_31d34a28-7501-4edf-a58c-efd9a1993026") failed: Property not found. retry in 624.354618ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_31d34a28-7501-4edf-a58c-efd9a1993026
8822024-06-25T22:09:17.809ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_edda0e18-89d1-46a3-9203-7ad35afbf850") failed: Property not found. retry in 824.205291ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_edda0e18-89d1-46a3-9203-7ad35afbf850
8832024-06-25T22:09:17.993ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_183f869e-6d79-4fc9-b2ce-5673630f7297") failed: Property not found. retry in 993.063306ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_183f869e-6d79-4fc9-b2ce-5673630f7297
8842024-06-25T22:09:18.045ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ff00699e-45ec-4610-a593-0fc5d5829200") failed: Property not found. retry in 1.151847565s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ff00699e-45ec-4610-a593-0fc5d5829200
8852024-06-25T22:09:18.211ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_31d34a28-7501-4edf-a58c-efd9a1993026") failed: Property not found. retry in 885.831499ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_31d34a28-7501-4edf-a58c-efd9a1993026
8862024-06-25T22:09:18.318ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2c991204-d84e-45c4-8ed3-3d12139a50db") failed: Property not found. retry in 916.991632ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2c991204-d84e-45c4-8ed3-3d12139a50db
8872024-06-25T22:09:18.641ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_edda0e18-89d1-46a3-9203-7ad35afbf850") failed: Property not found. retry in 620.791343ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_edda0e18-89d1-46a3-9203-7ad35afbf850
8882024-06-25T22:09:18.994ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_183f869e-6d79-4fc9-b2ce-5673630f7297") failed: Property not found. retry in 1.180458348s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_183f869e-6d79-4fc9-b2ce-5673630f7297
8892024-06-25T22:09:19.105ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_31d34a28-7501-4edf-a58c-efd9a1993026") failed: Property not found. retry in 1.343176001s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_31d34a28-7501-4edf-a58c-efd9a1993026
8902024-06-25T22:09:19.202ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ff00699e-45ec-4610-a593-0fc5d5829200") failed: Property not found. retry in 1.43303129s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ff00699e-45ec-4610-a593-0fc5d5829200
8912024-06-25T22:09:19.243ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2c991204-d84e-45c4-8ed3-3d12139a50db") failed: Property not found. retry in 596.404967ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2c991204-d84e-45c4-8ed3-3d12139a50db
8922024-06-25T22:09:19.269ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_edda0e18-89d1-46a3-9203-7ad35afbf850") failed: Property not found. retry in 1.463319847s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_edda0e18-89d1-46a3-9203-7ad35afbf850
8932024-06-25T22:09:19.850ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2c991204-d84e-45c4-8ed3-3d12139a50db") failed: Property not found. retry in 1.328830344s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2c991204-d84e-45c4-8ed3-3d12139a50db
8942024-06-25T22:09:20.186ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_183f869e-6d79-4fc9-b2ce-5673630f7297") failed: Property not found. retry in 1.278185669s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_183f869e-6d79-4fc9-b2ce-5673630f7297
8952024-06-25T22:09:20.462ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_31d34a28-7501-4edf-a58c-efd9a1993026") failed: Property not found. retry in 1.364527207s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_31d34a28-7501-4edf-a58c-efd9a1993026
8962024-06-25T22:09:20.648ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ff00699e-45ec-4610-a593-0fc5d5829200") failed: Property not found. retry in 770.522138ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ff00699e-45ec-4610-a593-0fc5d5829200
8972024-06-25T22:09:20.748ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_edda0e18-89d1-46a3-9203-7ad35afbf850") failed: Property not found. retry in 675.685884ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_edda0e18-89d1-46a3-9203-7ad35afbf850
8982024-06-25T22:09:21.190ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2c991204-d84e-45c4-8ed3-3d12139a50db") failed: Property not found. retry in 570.935198ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2c991204-d84e-45c4-8ed3-3d12139a50db
8992024-06-25T22:09:21.428ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ff00699e-45ec-4610-a593-0fc5d5829200") failed: Property not found. retry in 1.406998261s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ff00699e-45ec-4610-a593-0fc5d5829200
9002024-06-25T22:09:21.436ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_edda0e18-89d1-46a3-9203-7ad35afbf850") failed: Property not found. retry in 970.942323ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_edda0e18-89d1-46a3-9203-7ad35afbf850
9012024-06-25T22:09:21.473ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_183f869e-6d79-4fc9-b2ce-5673630f7297") failed: Property not found. retry in 987.551229ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_183f869e-6d79-4fc9-b2ce-5673630f7297
9022024-06-25T22:09:21.769ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2c991204-d84e-45c4-8ed3-3d12139a50db") failed: Property not found. retry in 1.176701613s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2c991204-d84e-45c4-8ed3-3d12139a50db
9032024-06-25T22:09:21.835ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_31d34a28-7501-4edf-a58c-efd9a1993026") failed: Property not found. retry in 684.274451ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_31d34a28-7501-4edf-a58c-efd9a1993026
9042024-06-25T22:09:22.415ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_edda0e18-89d1-46a3-9203-7ad35afbf850") failed: Property not found. retry in 1.264407955s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_edda0e18-89d1-46a3-9203-7ad35afbf850
9052024-06-25T22:09:22.469ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_183f869e-6d79-4fc9-b2ce-5673630f7297") failed: Property not found. retry in 502.566702ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_183f869e-6d79-4fc9-b2ce-5673630f7297
9062024-06-25T22:09:22.528ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_31d34a28-7501-4edf-a58c-efd9a1993026") failed: Property not found. retry in 918.655551ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_31d34a28-7501-4edf-a58c-efd9a1993026
9072024-06-25T22:09:22.844ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ff00699e-45ec-4610-a593-0fc5d5829200") failed: Property not found. retry in 1.491977434s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ff00699e-45ec-4610-a593-0fc5d5829200
9082024-06-25T22:09:22.956ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2c991204-d84e-45c4-8ed3-3d12139a50db") failed: Property not found. retry in 1.164274365s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2c991204-d84e-45c4-8ed3-3d12139a50db
9092024-06-25T22:09:22.982ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_183f869e-6d79-4fc9-b2ce-5673630f7297") failed: Property not found. retry in 998.175877ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_183f869e-6d79-4fc9-b2ce-5673630f7297
9102024-06-25T22:09:23.456ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_31d34a28-7501-4edf-a58c-efd9a1993026") failed: Property not found. retry in 649.877546ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_31d34a28-7501-4edf-a58c-efd9a1993026
9112024-06-25T22:09:23.690ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_edda0e18-89d1-46a3-9203-7ad35afbf850") failed: Property not found. retry in 966.428631ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_edda0e18-89d1-46a3-9203-7ad35afbf850
9122024-06-25T22:09:23.992ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_183f869e-6d79-4fc9-b2ce-5673630f7297") failed: Property not found. retry in 1.4722417s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_183f869e-6d79-4fc9-b2ce-5673630f7297
9132024-06-25T22:09:24.117ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_31d34a28-7501-4edf-a58c-efd9a1993026") failed: Property not found. retry in 1.044585931s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_31d34a28-7501-4edf-a58c-efd9a1993026
9142024-06-25T22:09:24.131ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2c991204-d84e-45c4-8ed3-3d12139a50db") failed: Property not found. retry in 1.201811477s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2c991204-d84e-45c4-8ed3-3d12139a50db
9152024-06-25T22:09:24.346ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ff00699e-45ec-4610-a593-0fc5d5829200") failed: Property not found. retry in 569.081998ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ff00699e-45ec-4610-a593-0fc5d5829200
9162024-06-25T22:09:24.666ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_edda0e18-89d1-46a3-9203-7ad35afbf850") failed: Property not found. retry in 841.482956ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_edda0e18-89d1-46a3-9203-7ad35afbf850
9172024-06-25T22:09:24.925ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ff00699e-45ec-4610-a593-0fc5d5829200") failed: Property not found. retry in 1.335071939s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ff00699e-45ec-4610-a593-0fc5d5829200
9182024-06-25T22:09:25.477ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_183f869e-6d79-4fc9-b2ce-5673630f7297") failed: Property not found. retry in 1.107094398s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_183f869e-6d79-4fc9-b2ce-5673630f7297
9192024-06-25T22:09:25.517ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_edda0e18-89d1-46a3-9203-7ad35afbf850") failed: Property not found. retry in 542.629134ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_edda0e18-89d1-46a3-9203-7ad35afbf850
9202024-06-25T22:09:26.072ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_edda0e18-89d1-46a3-9203-7ad35afbf850") failed: Property not found. retry in 957.878215ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_edda0e18-89d1-46a3-9203-7ad35afbf850
9212024-06-25T22:09:26.103ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:65346
9222024-06-25T22:09:26.103ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 79 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:65346 req_id = 656d06f0-2f76-4b9f-94e8-3033c12b2f72 response_code = 200 uri = /baseboard
9232024-06-25T22:09:26.270ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ff00699e-45ec-4610-a593-0fc5d5829200") failed: Property not found. retry in 791.55524ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ff00699e-45ec-4610-a593-0fc5d5829200
9242024-06-25T22:09:26.595ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_183f869e-6d79-4fc9-b2ce-5673630f7297") failed: Property not found. retry in 742.567854ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_183f869e-6d79-4fc9-b2ce-5673630f7297
9252024-06-25T22:09:27.040ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_edda0e18-89d1-46a3-9203-7ad35afbf850") failed: Property not found. retry in 1.00345098s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_edda0e18-89d1-46a3-9203-7ad35afbf850
9262024-06-25T22:09:27.073ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ff00699e-45ec-4610-a593-0fc5d5829200") failed: Property not found. retry in 761.801539ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ff00699e-45ec-4610-a593-0fc5d5829200
9272024-06-25T22:09:27.349ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_183f869e-6d79-4fc9-b2ce-5673630f7297") failed: Property not found. retry in 787.845983ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_183f869e-6d79-4fc9-b2ce-5673630f7297
9282024-06-25T22:09:27.845ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ff00699e-45ec-4610-a593-0fc5d5829200") failed: Property not found. retry in 1.13769211s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ff00699e-45ec-4610-a593-0fc5d5829200
9292024-06-25T22:09:28.052ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_edda0e18-89d1-46a3-9203-7ad35afbf850") failed: Property not found. retry in 1.032620898s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_edda0e18-89d1-46a3-9203-7ad35afbf850
9302024-06-25T22:09:28.146ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_183f869e-6d79-4fc9-b2ce-5673630f7297") failed: Property not found. retry in 1.04191983s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_183f869e-6d79-4fc9-b2ce-5673630f7297
9312024-06-25T22:09:28.992ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ff00699e-45ec-4610-a593-0fc5d5829200") failed: Property not found. retry in 896.188754ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ff00699e-45ec-4610-a593-0fc5d5829200
9322024-06-25T22:09:29.094ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_edda0e18-89d1-46a3-9203-7ad35afbf850") failed: Property not found. retry in 599.4754ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_edda0e18-89d1-46a3-9203-7ad35afbf850
9332024-06-25T22:09:29.197ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_183f869e-6d79-4fc9-b2ce-5673630f7297") failed: Property not found. retry in 1.090821775s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_183f869e-6d79-4fc9-b2ce-5673630f7297
9342024-06-25T22:09:29.703ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_edda0e18-89d1-46a3-9203-7ad35afbf850") failed: Property not found. retry in 673.165741ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_edda0e18-89d1-46a3-9203-7ad35afbf850
9352024-06-25T22:09:29.898ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ff00699e-45ec-4610-a593-0fc5d5829200") failed: Property not found. retry in 796.524451ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ff00699e-45ec-4610-a593-0fc5d5829200
9362024-06-25T22:09:30.298ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_183f869e-6d79-4fc9-b2ce-5673630f7297") failed: Property not found. retry in 709.795999ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_183f869e-6d79-4fc9-b2ce-5673630f7297
9372024-06-25T22:09:30.384ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_edda0e18-89d1-46a3-9203-7ad35afbf850") failed: Property not found. retry in 1.173686061s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_edda0e18-89d1-46a3-9203-7ad35afbf850
9382024-06-25T22:09:30.703ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ff00699e-45ec-4610-a593-0fc5d5829200") failed: Property not found. retry in 1.006403021s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ff00699e-45ec-4610-a593-0fc5d5829200
9392024-06-25T22:09:31.015ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_183f869e-6d79-4fc9-b2ce-5673630f7297") failed: Property not found. retry in 605.351615ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_183f869e-6d79-4fc9-b2ce-5673630f7297
9402024-06-25T22:09:31.567ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_edda0e18-89d1-46a3-9203-7ad35afbf850") failed: Property not found. retry in 1.391421242s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_edda0e18-89d1-46a3-9203-7ad35afbf850
9412024-06-25T22:09:31.628ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_183f869e-6d79-4fc9-b2ce-5673630f7297") failed: Property not found. retry in 1.01036287s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_183f869e-6d79-4fc9-b2ce-5673630f7297
9422024-06-25T22:09:31.720ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ff00699e-45ec-4610-a593-0fc5d5829200") failed: Property not found. retry in 648.552905ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ff00699e-45ec-4610-a593-0fc5d5829200
9432024-06-25T22:09:32.378ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ff00699e-45ec-4610-a593-0fc5d5829200") failed: Property not found. retry in 597.306106ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ff00699e-45ec-4610-a593-0fc5d5829200
9442024-06-25T22:09:32.647ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_183f869e-6d79-4fc9-b2ce-5673630f7297") failed: Property not found. retry in 953.293236ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_183f869e-6d79-4fc9-b2ce-5673630f7297
9452024-06-25T22:09:32.968ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_edda0e18-89d1-46a3-9203-7ad35afbf850") failed: Property not found. retry in 623.850468ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_edda0e18-89d1-46a3-9203-7ad35afbf850
9462024-06-25T22:09:32.986ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ff00699e-45ec-4610-a593-0fc5d5829200") failed: Property not found. retry in 537.389396ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ff00699e-45ec-4610-a593-0fc5d5829200
9472024-06-25T22:09:33.532ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ff00699e-45ec-4610-a593-0fc5d5829200") failed: Property not found. retry in 896.584584ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ff00699e-45ec-4610-a593-0fc5d5829200
9482024-06-25T22:09:33.599ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_edda0e18-89d1-46a3-9203-7ad35afbf850") failed: Property not found. retry in 1.107899968s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_edda0e18-89d1-46a3-9203-7ad35afbf850
9492024-06-25T22:09:33.610ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_183f869e-6d79-4fc9-b2ce-5673630f7297") failed: Property not found. retry in 1.124166238s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_183f869e-6d79-4fc9-b2ce-5673630f7297
9502024-06-25T22:09:34.756ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2956 zone = oxz_cockroachdb_ff00699e-45ec-4610-a593-0fc5d5829200
9512024-06-25T22:09:34.756ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2956 zone = oxz_cockroachdb_31d34a28-7501-4edf-a58c-efd9a1993026
9522024-06-25T22:09:34.756ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2956 zone = oxz_cockroachdb_edda0e18-89d1-46a3-9203-7ad35afbf850
9532024-06-25T22:09:34.756ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2956 zone = oxz_cockroachdb_183f869e-6d79-4fc9-b2ce-5673630f7297
9542024-06-25T22:09:34.756ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2956 zone = oxz_cockroachdb_2c991204-d84e-45c4-8ed3-3d12139a50db
9552024-06-25T22:09:34.756ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/c1b4be1d-f4e3-4e74-a94a-e989f58db5ee/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
9562024-06-25T22:09:34.757ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/d56b00ad-a3b5-4f85-a7d9-5f806111674c/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
9572024-06-25T22:09:34.757ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 23070561 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:52152 req_id = d907b546-a4e0-4efc-b102-4880fa65ce17 response_code = 204 uri = /omicron-zones
9582024-06-25T22:09:34.790ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49308
9592024-06-25T22:09:34.817ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_183f869e-6d79-4fc9-b2ce-5673630f7297: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_183f869e-6d79-4fc9-b2ce-5673630f7297 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Address object not found file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:866 latency_us = 26695 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:49308 req_id = 928ec3c7-732d-4408-814d-4a51fa00cbab response_code = 500 uri = /cockroachdb
9602024-06-25T22:09:34.817ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "928ec3c7-732d-4408-814d-4a51fa00cbab", "content-length": "124", "date": "Tue, 25 Jun 2024 22:09:34 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "928ec3c7-732d-4408-814d-4a51fa00cbab" } file = sled-agent/src/rack_setup/service.rs:966 retry_after = 105.915125ms
9612024-06-25T22:09:34.949ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_183f869e-6d79-4fc9-b2ce-5673630f7297: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_183f869e-6d79-4fc9-b2ce-5673630f7297 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Address object not found file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:866 latency_us = 25660 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:49308 req_id = 58b23062-5fbb-499b-8105-b105e1640438 response_code = 500 uri = /cockroachdb
9622024-06-25T22:09:34.950ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "58b23062-5fbb-499b-8105-b105e1640438", "content-length": "124", "date": "Tue, 25 Jun 2024 22:09:34 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "58b23062-5fbb-499b-8105-b105e1640438" } file = sled-agent/src/rack_setup/service.rs:966 retry_after = 79.762241ms
9632024-06-25T22:09:35.058ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::7]:32221 file = sled-agent/src/services.rs:3367
9642024-06-25T22:09:42.419ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3385
9652024-06-25T22:09:45.565ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3408
9662024-06-25T22:09:45.565ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 10535859 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:49308 req_id = 7a50db3d-54b0-48af-b0ab-9f6ae830394d response_code = 204 uri = /cockroachdb
9672024-06-25T22:09:45.566ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
9682024-06-25T22:09:45.670ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: 2402ccbd-c33c-4a93-99e0-a27dc8725e46, underlay_address: fd00:1122:3344:1::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b24fcace-6491-450a-a369-72a4fa2f698d (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 79398434-906b-4472-847f-0189e9312ea1, underlay_address: fd00:1122:3344:2::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: bbe28fca-3fd1-4387-a7f4-68f98c1de91a (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: d58098f0-4531-4b55-bc79-e8c8efa00887, underlay_address: fd00:1122:3344:3::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2d7d2d68-0dff-4e99-8278-b931af9c51f9 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 186876d9-c78f-46d8-9abe-0f5de30254b6, underlay_address: fd00:1122:3344:101::1b, zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 36d20914-1828-4d31-b752-987e88f29a01, kind: Service { id: 186876d9-c78f-46d8-9abe-0f5de30254b6 }, name: Name("ntp-186876d9-c78f-46d8-9abe-0f5de30254b6"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 135, 171])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 31d34a28-7501-4edf-a58c-efd9a1993026, underlay_address: fd00:1122:3344:101::3, zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b24fcace-6491-450a-a369-72a4fa2f698d (zpool), kind: External } } } }, OmicronZoneConfig { id: ff00699e-45ec-4610-a593-0fc5d5829200, underlay_address: fd00:1122:3344:101::4, zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: bbe28fca-3fd1-4387-a7f4-68f98c1de91a (zpool), kind: External } } } }, OmicronZoneConfig { id: edda0e18-89d1-46a3-9203-7ad35afbf850, underlay_address: fd00:1122:3344:101::5, zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2d7d2d68-0dff-4e99-8278-b931af9c51f9 (zpool), kind: External } } } }, OmicronZoneConfig { id: 2c991204-d84e-45c4-8ed3-3d12139a50db, underlay_address: fd00:1122:3344:101::6, zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a53379c5-166a-4c1c-987d-bc15e7c6ea9a (zpool), kind: External } } } }, OmicronZoneConfig { id: 183f869e-6d79-4fc9-b2ce-5673630f7297, underlay_address: fd00:1122:3344:101::7, zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d48dc185-6776-4e11-be12-99d059cde9ba (zpool), kind: External } } } }, OmicronZoneConfig { id: 090cab3e-c3ab-4330-b9c9-1127a32f39f2, underlay_address: fd00:1122:3344:101::8, zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b24fcace-6491-450a-a369-72a4fa2f698d (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.1.164:53, nic: NetworkInterface { id: 9112163e-3dcb-4580-845f-2c99d0c20231, kind: Service { id: 090cab3e-c3ab-4330-b9c9-1127a32f39f2 }, name: Name("external-dns-090cab3e-c3ab-4330-b9c9-1127a32f39f2"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 159, 39])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 } } }, OmicronZoneConfig { id: b8926782-287c-4933-bfeb-32cf3be7f706, underlay_address: fd00:1122:3344:101::9, zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: bbe28fca-3fd1-4387-a7f4-68f98c1de91a (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.1.165:53, nic: NetworkInterface { id: 0e5c0224-5418-43a7-a584-d49561dc9b2f, kind: Service { id: b8926782-287c-4933-bfeb-32cf3be7f706 }, name: Name("external-dns-b8926782-287c-4933-bfeb-32cf3be7f706"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 163, 72])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 } } }, OmicronZoneConfig { id: 211fbf99-1061-4acf-8e74-43eed5e3a08d, underlay_address: fd00:1122:3344:101::a, zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.1.166, nic: NetworkInterface { id: c3eb96b1-13ec-4977-b5bb-24ab91071404, kind: Service { id: 211fbf99-1061-4acf-8e74-43eed5e3a08d }, name: Name("nexus-211fbf99-1061-4acf-8e74-43eed5e3a08d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 135, 241])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 63818da9-9b47-4961-acee-684195690598, underlay_address: fd00:1122:3344:101::b, zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.1.167, nic: NetworkInterface { id: f408d23f-8ca5-4b0c-ab98-3078caa08f15, kind: Service { id: 63818da9-9b47-4961-acee-684195690598 }, name: Name("nexus-63818da9-9b47-4961-acee-684195690598"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 0])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 1767227d-844e-45e4-9835-24fb7251a22f, underlay_address: fd00:1122:3344:101::c, zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.1.168, nic: NetworkInterface { id: 94ed2baf-348c-4487-85a2-b16ce8ce33a8, kind: Service { id: 1767227d-844e-45e4-9835-24fb7251a22f }, name: Name("nexus-1767227d-844e-45e4-9835-24fb7251a22f"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 234, 65])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 57d2d09d-5105-45b1-928c-c7148eba9fbb, underlay_address: fd00:1122:3344:101::d, zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: e3a931fa-0dc4-4413-acff-07a88fa4b22f, underlay_address: fd00:1122:3344:101::e, zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b24fcace-6491-450a-a369-72a4fa2f698d (zpool), kind: External } } } }, OmicronZoneConfig { id: daf287cf-2ef4-4650-8e49-7ff4d72bac03, underlay_address: fd00:1122:3344:101::f, zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: ec8d60b8-1950-4791-b741-b3377213babd, underlay_address: fd00:1122:3344:101::10, zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: e76e124b-7516-4909-90c2-5e334a704c61, underlay_address: fd00:1122:3344:101::11, zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: 93169012-721e-458e-8264-ae8f477750e9, underlay_address: fd00:1122:3344:101::12, zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b24fcace-6491-450a-a369-72a4fa2f698d (zpool), kind: External } } } }, OmicronZoneConfig { id: 31025c13-8a1b-4681-a5f3-5f5002b54c1e, underlay_address: fd00:1122:3344:101::13, zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: bbe28fca-3fd1-4387-a7f4-68f98c1de91a (zpool), kind: External } } } }, OmicronZoneConfig { id: a9f63144-1150-4d68-bbd0-474799934844, underlay_address: fd00:1122:3344:101::14, zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2d7d2d68-0dff-4e99-8278-b931af9c51f9 (zpool), kind: External } } } }, OmicronZoneConfig { id: 39414697-c0fa-4175-9995-5ce327f254cb, underlay_address: fd00:1122:3344:101::15, zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a53379c5-166a-4c1c-987d-bc15e7c6ea9a (zpool), kind: External } } } }, OmicronZoneConfig { id: c1b69c41-cc2f-4b1c-aa33-864a47332b73, underlay_address: fd00:1122:3344:101::16, zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d48dc185-6776-4e11-be12-99d059cde9ba (zpool), kind: External } } } }, OmicronZoneConfig { id: 489d3d8d-d211-4e20-b108-a0ff7b3a7978, underlay_address: fd00:1122:3344:101::17, zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e5688a20-d1b3-481e-838c-caf5db3530b8 (zpool), kind: External } } } }, OmicronZoneConfig { id: d63f510d-32cb-47e8-bcbc-0fedff2f6b57, underlay_address: fd00:1122:3344:101::18, zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 312c3038-d536-4c5a-9806-84746920ad0d (zpool), kind: External } } } }, OmicronZoneConfig { id: bae337bd-17bd-4f85-95ae-43ef570b4825, underlay_address: fd00:1122:3344:101::19, zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 97cef6c3-7be9-4f86-b962-06f70386b56f (zpool), kind: External } } } }, OmicronZoneConfig { id: 09790c06-6bd6-40de-90d1-ccdaeb06d637, underlay_address: fd00:1122:3344:101::1a, zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: facb4ef1-3898-4a96-a381-88ad4e3fa4e0 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:431 sled_address = [fd00:1122:3344:101::1]:12345
9692024-06-25T22:09:45.670ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55920
9702024-06-25T22:09:45.671ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 2402ccbd-c33c-4a93-99e0-a27dc8725e46, dataset_name: DatasetName { pool_name: ZpoolName { id: b24fcace-6491-450a-a369-72a4fa2f698d (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
9712024-06-25T22:09:45.671ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 2402ccbd-c33c-4a93-99e0-a27dc8725e46, dataset_name: DatasetName { pool_name: ZpoolName { id: b24fcace-6491-450a-a369-72a4fa2f698d (zpool), kind: External }, kind: InternalDns }, responder: ... }
9722024-06-25T22:09:45.698ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 79398434-906b-4472-847f-0189e9312ea1, dataset_name: DatasetName { pool_name: ZpoolName { id: bbe28fca-3fd1-4387-a7f4-68f98c1de91a (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
9732024-06-25T22:09:45.698ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 79398434-906b-4472-847f-0189e9312ea1, dataset_name: DatasetName { pool_name: ZpoolName { id: bbe28fca-3fd1-4387-a7f4-68f98c1de91a (zpool), kind: External }, kind: InternalDns }, responder: ... }
9742024-06-25T22:09:45.720ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d58098f0-4531-4b55-bc79-e8c8efa00887, dataset_name: DatasetName { pool_name: ZpoolName { id: 2d7d2d68-0dff-4e99-8278-b931af9c51f9 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
9752024-06-25T22:09:45.720ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: d58098f0-4531-4b55-bc79-e8c8efa00887, dataset_name: DatasetName { pool_name: ZpoolName { id: 2d7d2d68-0dff-4e99-8278-b931af9c51f9 (zpool), kind: External }, kind: InternalDns }, responder: ... }
9762024-06-25T22:09:45.741ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 31d34a28-7501-4edf-a58c-efd9a1993026, dataset_name: DatasetName { pool_name: ZpoolName { id: b24fcace-6491-450a-a369-72a4fa2f698d (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
9772024-06-25T22:09:45.741ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 31d34a28-7501-4edf-a58c-efd9a1993026, dataset_name: DatasetName { pool_name: ZpoolName { id: b24fcace-6491-450a-a369-72a4fa2f698d (zpool), kind: External }, kind: CockroachDb }, responder: ... }
9782024-06-25T22:09:45.761ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: ff00699e-45ec-4610-a593-0fc5d5829200, dataset_name: DatasetName { pool_name: ZpoolName { id: bbe28fca-3fd1-4387-a7f4-68f98c1de91a (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
9792024-06-25T22:09:45.761ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: ff00699e-45ec-4610-a593-0fc5d5829200, dataset_name: DatasetName { pool_name: ZpoolName { id: bbe28fca-3fd1-4387-a7f4-68f98c1de91a (zpool), kind: External }, kind: CockroachDb }, responder: ... }
9802024-06-25T22:09:45.781ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: edda0e18-89d1-46a3-9203-7ad35afbf850, dataset_name: DatasetName { pool_name: ZpoolName { id: 2d7d2d68-0dff-4e99-8278-b931af9c51f9 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
9812024-06-25T22:09:45.781ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: edda0e18-89d1-46a3-9203-7ad35afbf850, dataset_name: DatasetName { pool_name: ZpoolName { id: 2d7d2d68-0dff-4e99-8278-b931af9c51f9 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
9822024-06-25T22:09:45.800ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 2c991204-d84e-45c4-8ed3-3d12139a50db, dataset_name: DatasetName { pool_name: ZpoolName { id: a53379c5-166a-4c1c-987d-bc15e7c6ea9a (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
9832024-06-25T22:09:45.800ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 2c991204-d84e-45c4-8ed3-3d12139a50db, dataset_name: DatasetName { pool_name: ZpoolName { id: a53379c5-166a-4c1c-987d-bc15e7c6ea9a (zpool), kind: External }, kind: CockroachDb }, responder: ... }
9842024-06-25T22:09:45.819ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 183f869e-6d79-4fc9-b2ce-5673630f7297, dataset_name: DatasetName { pool_name: ZpoolName { id: d48dc185-6776-4e11-be12-99d059cde9ba (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
9852024-06-25T22:09:45.819ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 183f869e-6d79-4fc9-b2ce-5673630f7297, dataset_name: DatasetName { pool_name: ZpoolName { id: d48dc185-6776-4e11-be12-99d059cde9ba (zpool), kind: External }, kind: CockroachDb }, responder: ... }
9862024-06-25T22:09:45.838ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 090cab3e-c3ab-4330-b9c9-1127a32f39f2, dataset_name: DatasetName { pool_name: ZpoolName { id: b24fcace-6491-450a-a369-72a4fa2f698d (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
9872024-06-25T22:09:45.838ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 090cab3e-c3ab-4330-b9c9-1127a32f39f2, dataset_name: DatasetName { pool_name: ZpoolName { id: b24fcace-6491-450a-a369-72a4fa2f698d (zpool), kind: External }, kind: ExternalDns }, responder: ... }
9882024-06-25T22:09:45.912ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: b8926782-287c-4933-bfeb-32cf3be7f706, dataset_name: DatasetName { pool_name: ZpoolName { id: bbe28fca-3fd1-4387-a7f4-68f98c1de91a (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
9892024-06-25T22:09:45.912ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: b8926782-287c-4933-bfeb-32cf3be7f706, dataset_name: DatasetName { pool_name: ZpoolName { id: bbe28fca-3fd1-4387-a7f4-68f98c1de91a (zpool), kind: External }, kind: ExternalDns }, responder: ... }
9902024-06-25T22:09:45.983ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e3a931fa-0dc4-4413-acff-07a88fa4b22f, dataset_name: DatasetName { pool_name: ZpoolName { id: b24fcace-6491-450a-a369-72a4fa2f698d (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:381
9912024-06-25T22:09:45.983ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: e3a931fa-0dc4-4413-acff-07a88fa4b22f, dataset_name: DatasetName { pool_name: ZpoolName { id: b24fcace-6491-450a-a369-72a4fa2f698d (zpool), kind: External }, kind: Clickhouse }, responder: ... }
9922024-06-25T22:09:46.062ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 93169012-721e-458e-8264-ae8f477750e9, dataset_name: DatasetName { pool_name: ZpoolName { id: b24fcace-6491-450a-a369-72a4fa2f698d (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
9932024-06-25T22:09:46.062ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 93169012-721e-458e-8264-ae8f477750e9, dataset_name: DatasetName { pool_name: ZpoolName { id: b24fcace-6491-450a-a369-72a4fa2f698d (zpool), kind: External }, kind: Crucible }, responder: ... }
9942024-06-25T22:09:46.139ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 31025c13-8a1b-4681-a5f3-5f5002b54c1e, dataset_name: DatasetName { pool_name: ZpoolName { id: bbe28fca-3fd1-4387-a7f4-68f98c1de91a (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
9952024-06-25T22:09:46.139ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 31025c13-8a1b-4681-a5f3-5f5002b54c1e, dataset_name: DatasetName { pool_name: ZpoolName { id: bbe28fca-3fd1-4387-a7f4-68f98c1de91a (zpool), kind: External }, kind: Crucible }, responder: ... }
9962024-06-25T22:09:46.207ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: a9f63144-1150-4d68-bbd0-474799934844, dataset_name: DatasetName { pool_name: ZpoolName { id: 2d7d2d68-0dff-4e99-8278-b931af9c51f9 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
9972024-06-25T22:09:46.207ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: a9f63144-1150-4d68-bbd0-474799934844, dataset_name: DatasetName { pool_name: ZpoolName { id: 2d7d2d68-0dff-4e99-8278-b931af9c51f9 (zpool), kind: External }, kind: Crucible }, responder: ... }
9982024-06-25T22:09:46.283ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 39414697-c0fa-4175-9995-5ce327f254cb, dataset_name: DatasetName { pool_name: ZpoolName { id: a53379c5-166a-4c1c-987d-bc15e7c6ea9a (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
9992024-06-25T22:09:46.283ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 39414697-c0fa-4175-9995-5ce327f254cb, dataset_name: DatasetName { pool_name: ZpoolName { id: a53379c5-166a-4c1c-987d-bc15e7c6ea9a (zpool), kind: External }, kind: Crucible }, responder: ... }
10002024-06-25T22:09:46.361ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c1b69c41-cc2f-4b1c-aa33-864a47332b73, dataset_name: DatasetName { pool_name: ZpoolName { id: d48dc185-6776-4e11-be12-99d059cde9ba (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
10012024-06-25T22:09:46.361ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: c1b69c41-cc2f-4b1c-aa33-864a47332b73, dataset_name: DatasetName { pool_name: ZpoolName { id: d48dc185-6776-4e11-be12-99d059cde9ba (zpool), kind: External }, kind: Crucible }, responder: ... }
10022024-06-25T22:09:46.448ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 489d3d8d-d211-4e20-b108-a0ff7b3a7978, dataset_name: DatasetName { pool_name: ZpoolName { id: e5688a20-d1b3-481e-838c-caf5db3530b8 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
10032024-06-25T22:09:46.448ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 489d3d8d-d211-4e20-b108-a0ff7b3a7978, dataset_name: DatasetName { pool_name: ZpoolName { id: e5688a20-d1b3-481e-838c-caf5db3530b8 (zpool), kind: External }, kind: Crucible }, responder: ... }
10042024-06-25T22:09:46.521ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d63f510d-32cb-47e8-bcbc-0fedff2f6b57, dataset_name: DatasetName { pool_name: ZpoolName { id: 312c3038-d536-4c5a-9806-84746920ad0d (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
10052024-06-25T22:09:46.521ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: d63f510d-32cb-47e8-bcbc-0fedff2f6b57, dataset_name: DatasetName { pool_name: ZpoolName { id: 312c3038-d536-4c5a-9806-84746920ad0d (zpool), kind: External }, kind: Crucible }, responder: ... }
10062024-06-25T22:09:46.588ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: bae337bd-17bd-4f85-95ae-43ef570b4825, dataset_name: DatasetName { pool_name: ZpoolName { id: 97cef6c3-7be9-4f86-b962-06f70386b56f (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
10072024-06-25T22:09:46.588ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: bae337bd-17bd-4f85-95ae-43ef570b4825, dataset_name: DatasetName { pool_name: ZpoolName { id: 97cef6c3-7be9-4f86-b962-06f70386b56f (zpool), kind: External }, kind: Crucible }, responder: ... }
10082024-06-25T22:09:46.657ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 09790c06-6bd6-40de-90d1-ccdaeb06d637, dataset_name: DatasetName { pool_name: ZpoolName { id: facb4ef1-3898-4a96-a381-88ad4e3fa4e0 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
10092024-06-25T22:09:46.657ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 09790c06-6bd6-40de-90d1-ccdaeb06d637, dataset_name: DatasetName { pool_name: ZpoolName { id: facb4ef1-3898-4a96-a381-88ad4e3fa4e0 (zpool), kind: External }, kind: Crucible }, responder: ... }
10102024-06-25T22:09:46.725ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
10112024-06-25T22:09:46.725ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/c1b4be1d-f4e3-4e74-a94a-e989f58db5ee/config/omicron-zones.json file = common/src/ledger.rs:177
10122024-06-25T22:09:46.726ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/d56b00ad-a3b5-4f85-a7d9-5f806111674c/config/omicron-zones.json file = common/src/ledger.rs:177
10132024-06-25T22:09:46.726ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
10142024-06-25T22:09:46.825ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:263
10152024-06-25T22:09:46.872ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:263
10162024-06-25T22:09:46.873ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
10172024-06-25T22:09:46.873ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
10182024-06-25T22:09:46.873ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
10192024-06-25T22:09:46.873ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
10202024-06-25T22:09:46.899ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
10212024-06-25T22:09:46.899ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
10222024-06-25T22:09:46.899ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
10232024-06-25T22:09:46.899ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
10242024-06-25T22:09:47.077ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:263
10252024-06-25T22:09:47.077ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
10262024-06-25T22:09:47.077ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
10272024-06-25T22:09:47.124ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:263
10282024-06-25T22:09:47.124ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
10292024-06-25T22:09:47.124ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
10302024-06-25T22:09:47.124ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
10312024-06-25T22:09:47.124ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
10322024-06-25T22:09:47.126ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:263
10332024-06-25T22:09:47.126ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_daf287cf-2ef4-4650-8e49-7ff4d72bac03 file = illumos-utils/src/zone.rs:315
10342024-06-25T22:09:47.132ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_39414697-c0fa-4175-9995-5ce327f254cb file = illumos-utils/src/zone.rs:315
10352024-06-25T22:09:47.137ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_d63f510d-32cb-47e8-bcbc-0fedff2f6b57 file = illumos-utils/src/zone.rs:315
10362024-06-25T22:09:47.143ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_09790c06-6bd6-40de-90d1-ccdaeb06d637 file = illumos-utils/src/zone.rs:315
10372024-06-25T22:09:47.149ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_ec8d60b8-1950-4791-b741-b3377213babd file = illumos-utils/src/zone.rs:315
10382024-06-25T22:09:47.154ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_a9f63144-1150-4d68-bbd0-474799934844 file = illumos-utils/src/zone.rs:315
10392024-06-25T22:09:47.159ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_57d2d09d-5105-45b1-928c-c7148eba9fbb file = illumos-utils/src/zone.rs:315
10402024-06-25T22:09:47.164ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_489d3d8d-d211-4e20-b108-a0ff7b3a7978 file = illumos-utils/src/zone.rs:315
10412024-06-25T22:09:47.288ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_daf287cf-2ef4-4650-8e49-7ff4d72bac03 file = illumos-utils/src/zone.rs:354
10422024-06-25T22:09:47.292ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_39414697-c0fa-4175-9995-5ce327f254cb file = illumos-utils/src/zone.rs:354
10432024-06-25T22:09:47.296ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_d63f510d-32cb-47e8-bcbc-0fedff2f6b57 file = illumos-utils/src/zone.rs:354
10442024-06-25T22:09:47.301ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_09790c06-6bd6-40de-90d1-ccdaeb06d637 file = illumos-utils/src/zone.rs:354
10452024-06-25T22:09:47.306ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_ec8d60b8-1950-4791-b741-b3377213babd file = illumos-utils/src/zone.rs:354
10462024-06-25T22:09:47.311ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_a9f63144-1150-4d68-bbd0-474799934844 file = illumos-utils/src/zone.rs:354
10472024-06-25T22:09:47.317ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_57d2d09d-5105-45b1-928c-c7148eba9fbb file = illumos-utils/src/zone.rs:354
10482024-06-25T22:09:47.322ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_489d3d8d-d211-4e20-b108-a0ff7b3a7978 file = illumos-utils/src/zone.rs:354
10492024-06-25T22:09:47.327ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_c1b69c41-cc2f-4b1c-aa33-864a47332b73 file = illumos-utils/src/zone.rs:315
10502024-06-25T22:09:47.333ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_93169012-721e-458e-8264-ae8f477750e9 file = illumos-utils/src/zone.rs:315
10512024-06-25T22:09:47.338ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_e3a931fa-0dc4-4413-acff-07a88fa4b22f file = illumos-utils/src/zone.rs:315
10522024-06-25T22:09:47.345ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_e76e124b-7516-4909-90c2-5e334a704c61 file = illumos-utils/src/zone.rs:315
10532024-06-25T22:09:47.351ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_31025c13-8a1b-4681-a5f3-5f5002b54c1e file = illumos-utils/src/zone.rs:315
10542024-06-25T22:09:47.357ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_bae337bd-17bd-4f85-95ae-43ef570b4825 file = illumos-utils/src/zone.rs:315
10552024-06-25T22:09:47.365ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_c1b69c41-cc2f-4b1c-aa33-864a47332b73 file = illumos-utils/src/zone.rs:354
10562024-06-25T22:09:47.371ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_93169012-721e-458e-8264-ae8f477750e9 file = illumos-utils/src/zone.rs:354
10572024-06-25T22:09:47.377ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_e3a931fa-0dc4-4413-acff-07a88fa4b22f file = illumos-utils/src/zone.rs:354
10582024-06-25T22:09:47.383ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_e76e124b-7516-4909-90c2-5e334a704c61 file = illumos-utils/src/zone.rs:354
10592024-06-25T22:09:47.389ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_31025c13-8a1b-4681-a5f3-5f5002b54c1e file = illumos-utils/src/zone.rs:354
10602024-06-25T22:09:47.396ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_bae337bd-17bd-4f85-95ae-43ef570b4825 file = illumos-utils/src/zone.rs:354
10612024-06-25T22:09:47.467ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:280
10622024-06-25T22:09:47.535ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:280
10632024-06-25T22:09:47.607ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:280
10642024-06-25T22:09:47.666ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:280
10652024-06-25T22:09:47.724ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:280
10662024-06-25T22:09:47.726ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:305
10672024-06-25T22:09:47.726ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:197
10682024-06-25T22:09:47.839ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:393 port = Port { inner: PortInner { name: "opte1", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 163, 72]), slot: 0, vni: Vni { inner: 100 }, gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 }, vnic: "vopte1" } }
10692024-06-25T22:09:47.839ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1190 zone_type = external_dns
10702024-06-25T22:09:47.844ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:305
10712024-06-25T22:09:47.844ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:197
10722024-06-25T22:09:48.047ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:393 port = Port { inner: PortInner { name: "opte2", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 151, 0]), slot: 0, vni: Vni { inner: 100 }, gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 }, vnic: "vopte2" } }
10732024-06-25T22:09:48.047ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1190 zone_type = nexus
10742024-06-25T22:09:48.049ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:305
10752024-06-25T22:09:48.049ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:197
10762024-06-25T22:09:48.179ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:393 port = Port { inner: PortInner { name: "opte3", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 159, 39]), slot: 0, vni: Vni { inner: 100 }, gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 }, vnic: "vopte3" } }
10772024-06-25T22:09:48.179ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1190 zone_type = external_dns
10782024-06-25T22:09:48.182ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:305
10792024-06-25T22:09:48.182ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:197
10802024-06-25T22:09:48.281ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:393 port = Port { inner: PortInner { name: "opte4", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 234, 65]), slot: 0, vni: Vni { inner: 100 }, gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 }, vnic: "vopte4" } }
10812024-06-25T22:09:48.281ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1190 zone_type = nexus
10822024-06-25T22:09:48.287ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:305
10832024-06-25T22:09:48.287ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:197
10842024-06-25T22:09:48.402ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:393 port = Port { inner: PortInner { name: "opte5", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 135, 241]), slot: 0, vni: Vni { inner: 100 }, gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 }, vnic: "vopte5" } }
10852024-06-25T22:09:48.402ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1190 zone_type = nexus
10862024-06-25T22:09:48.405ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:83
10872024-06-25T22:09:48.405ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:90
10882024-06-25T22:09:48.408ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:83
10892024-06-25T22:09:48.408ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:90
10902024-06-25T22:09:48.408ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:83
10912024-06-25T22:09:48.408ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:90
10922024-06-25T22:09:48.408ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:83
10932024-06-25T22:09:48.408ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:90
10942024-06-25T22:09:48.408ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:83
10952024-06-25T22:09:48.408ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:90
10962024-06-25T22:09:48.423ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:118
10972024-06-25T22:09:48.429ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:118
10982024-06-25T22:09:48.435ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:118
10992024-06-25T22:09:48.435ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
11002024-06-25T22:09:48.435ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
11012024-06-25T22:09:48.438ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:118
11022024-06-25T22:09:48.442ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
11032024-06-25T22:09:48.442ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:118
11042024-06-25T22:09:48.442ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
11052024-06-25T22:09:48.445ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
11062024-06-25T22:09:48.725ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_211fbf99-1061-4acf-8e74-43eed5e3a08d file = illumos-utils/src/zone.rs:315
11072024-06-25T22:09:48.741ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_b8926782-287c-4933-bfeb-32cf3be7f706 file = illumos-utils/src/zone.rs:315
11082024-06-25T22:09:48.760ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_63818da9-9b47-4961-acee-684195690598 file = illumos-utils/src/zone.rs:315
11092024-06-25T22:09:48.774ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_090cab3e-c3ab-4330-b9c9-1127a32f39f2 file = illumos-utils/src/zone.rs:315
11102024-06-25T22:09:48.786ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_1767227d-844e-45e4-9835-24fb7251a22f file = illumos-utils/src/zone.rs:315
11112024-06-25T22:09:48.798ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_211fbf99-1061-4acf-8e74-43eed5e3a08d file = illumos-utils/src/zone.rs:354
11122024-06-25T22:09:48.811ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_b8926782-287c-4933-bfeb-32cf3be7f706 file = illumos-utils/src/zone.rs:354
11132024-06-25T22:09:48.822ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_63818da9-9b47-4961-acee-684195690598 file = illumos-utils/src/zone.rs:354
11142024-06-25T22:09:48.832ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_090cab3e-c3ab-4330-b9c9-1127a32f39f2 file = illumos-utils/src/zone.rs:354
11152024-06-25T22:09:48.842ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_1767227d-844e-45e4-9835-24fb7251a22f file = illumos-utils/src/zone.rs:354
11162024-06-25T22:09:50.143ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_d63f510d-32cb-47e8-bcbc-0fedff2f6b57: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService12"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::18"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_312c3038-d536-4c5a-9806-84746920ad0d/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::18"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="366e1f46-ee12-46e2-b521-c7c578103af8"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11172024-06-25T22:09:50.143ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_d63f510d-32cb-47e8-bcbc-0fedff2f6b57
11182024-06-25T22:09:50.162ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_489d3d8d-d211-4e20-b108-a0ff7b3a7978: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService17"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::17"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_e5688a20-d1b3-481e-838c-caf5db3530b8/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::17"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="46b534ae-b30c-4ea6-b3c5-8f19f4b7baf1"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11192024-06-25T22:09:50.163ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_489d3d8d-d211-4e20-b108-a0ff7b3a7978
11202024-06-25T22:09:50.169ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_31025c13-8a1b-4681-a5f3-5f5002b54c1e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService22"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::13"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_bbe28fca-3fd1-4387-a7f4-68f98c1de91a/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::13"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="15de7313-0a50-47f1-a116-b85baaea893f"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11212024-06-25T22:09:50.169ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_31025c13-8a1b-4681-a5f3-5f5002b54c1e
11222024-06-25T22:09:50.189ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_daf287cf-2ef4-4650-8e49-7ff4d72bac03: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService10"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::f"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::f"/> <propval type="astring" name="listen_port" value="17000"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11232024-06-25T22:09:50.189ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_pantry_daf287cf-2ef4-4650-8e49-7ff4d72bac03
11242024-06-25T22:09:50.196ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_39414697-c0fa-4175-9995-5ce327f254cb: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService11"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::15"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_a53379c5-166a-4c1c-987d-bc15e7c6ea9a/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::15"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="395639cc-b0af-44de-9a79-903ec0bd1baa"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11252024-06-25T22:09:50.196ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_bae337bd-17bd-4f85-95ae-43ef570b4825: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService23"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::19"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_97cef6c3-7be9-4f86-b962-06f70386b56f/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::19"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="6aa480fa-8b8d-4e82-a2fe-0a04baa14127"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11262024-06-25T22:09:50.196ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_39414697-c0fa-4175-9995-5ce327f254cb
11272024-06-25T22:09:50.202ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_bae337bd-17bd-4f85-95ae-43ef570b4825
11282024-06-25T22:09:50.212ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_c1b69c41-cc2f-4b1c-aa33-864a47332b73: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService18"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::16"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_d48dc185-6776-4e11-be12-99d059cde9ba/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::16"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="0078f28d-5218-4a2e-8f7b-ae7588984a94"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11292024-06-25T22:09:50.212ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_c1b69c41-cc2f-4b1c-aa33-864a47332b73
11302024-06-25T22:09:50.245ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_57d2d09d-5105-45b1-928c-c7148eba9fbb: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService16"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::d"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value="57d2d09d-5105-45b1-928c-c7148eba9fbb"/> <propval type="astring" name="address" value="[fd00:1122:3344:101::d]:12223"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11312024-06-25T22:09:50.245ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_oximeter_57d2d09d-5105-45b1-928c-c7148eba9fbb
11322024-06-25T22:09:50.325ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_09790c06-6bd6-40de-90d1-ccdaeb06d637: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService13"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::1a"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_facb4ef1-3898-4a96-a381-88ad4e3fa4e0/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::1a"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="89d95f14-0734-4eaa-bbb7-22c85503d448"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11332024-06-25T22:09:50.325ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_09790c06-6bd6-40de-90d1-ccdaeb06d637
11342024-06-25T22:09:50.338ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_a9f63144-1150-4d68-bbd0-474799934844: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService15"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::14"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_2d7d2d68-0dff-4e99-8278-b931af9c51f9/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::14"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="854618d4-984c-4591-94d8-71fbcca393a6"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11352024-06-25T22:09:50.338ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_a9f63144-1150-4d68-bbd0-474799934844
11362024-06-25T22:09:50.413ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_31025c13-8a1b-4681-a5f3-5f5002b54c1e") failed: Property not found. retry in 49.833003ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_31025c13-8a1b-4681-a5f3-5f5002b54c1e
11372024-06-25T22:09:50.426ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_daf287cf-2ef4-4650-8e49-7ff4d72bac03") failed: Property not found. retry in 71.029733ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_daf287cf-2ef4-4650-8e49-7ff4d72bac03
11382024-06-25T22:09:50.437ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_39414697-c0fa-4175-9995-5ce327f254cb") failed: Property not found. retry in 70.863249ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_39414697-c0fa-4175-9995-5ce327f254cb
11392024-06-25T22:09:50.448ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d63f510d-32cb-47e8-bcbc-0fedff2f6b57") failed: Property not found. retry in 34.345797ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d63f510d-32cb-47e8-bcbc-0fedff2f6b57
11402024-06-25T22:09:50.459ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_489d3d8d-d211-4e20-b108-a0ff7b3a7978") failed: Property not found. retry in 34.870749ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_489d3d8d-d211-4e20-b108-a0ff7b3a7978
11412024-06-25T22:09:50.469ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c1b69c41-cc2f-4b1c-aa33-864a47332b73") failed: Property not found. retry in 72.704036ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c1b69c41-cc2f-4b1c-aa33-864a47332b73
11422024-06-25T22:09:50.481ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bae337bd-17bd-4f85-95ae-43ef570b4825") failed: Property not found. retry in 54.011905ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bae337bd-17bd-4f85-95ae-43ef570b4825
11432024-06-25T22:09:50.572ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_31025c13-8a1b-4681-a5f3-5f5002b54c1e") failed: Property not found. retry in 116.392418ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_31025c13-8a1b-4681-a5f3-5f5002b54c1e
11442024-06-25T22:09:50.741ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_daf287cf-2ef4-4650-8e49-7ff4d72bac03") failed: Property not found. retry in 126.27551ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_daf287cf-2ef4-4650-8e49-7ff4d72bac03
11452024-06-25T22:09:50.765ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_39414697-c0fa-4175-9995-5ce327f254cb") failed: Property not found. retry in 70.517823ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_39414697-c0fa-4175-9995-5ce327f254cb
11462024-06-25T22:09:50.815ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d63f510d-32cb-47e8-bcbc-0fedff2f6b57") failed: Property not found. retry in 128.010301ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d63f510d-32cb-47e8-bcbc-0fedff2f6b57
11472024-06-25T22:09:55.239ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_09790c06-6bd6-40de-90d1-ccdaeb06d637") failed: Property not found. retry in 37.288474ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_09790c06-6bd6-40de-90d1-ccdaeb06d637
11482024-06-25T22:09:55.610ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a9f63144-1150-4d68-bbd0-474799934844") failed: Property not found. retry in 39.348844ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a9f63144-1150-4d68-bbd0-474799934844
11492024-06-25T22:09:55.858ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_57d2d09d-5105-45b1-928c-c7148eba9fbb") failed: Property not found. retry in 26.381396ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_57d2d09d-5105-45b1-928c-c7148eba9fbb
11502024-06-25T22:09:56.305ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_489d3d8d-d211-4e20-b108-a0ff7b3a7978") failed: Property not found. retry in 64.277035ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_489d3d8d-d211-4e20-b108-a0ff7b3a7978
11512024-06-25T22:09:56.550ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c1b69c41-cc2f-4b1c-aa33-864a47332b73") failed: Property not found. retry in 57.361359ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c1b69c41-cc2f-4b1c-aa33-864a47332b73
11522024-06-25T22:09:56.814ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_31025c13-8a1b-4681-a5f3-5f5002b54c1e") failed: Property not found. retry in 257.086933ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_31025c13-8a1b-4681-a5f3-5f5002b54c1e
11532024-06-25T22:09:56.828ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bae337bd-17bd-4f85-95ae-43ef570b4825") failed: Property not found. retry in 71.088931ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bae337bd-17bd-4f85-95ae-43ef570b4825
11542024-06-25T22:09:56.842ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_daf287cf-2ef4-4650-8e49-7ff4d72bac03") failed: Property not found. retry in 180.82866ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_daf287cf-2ef4-4650-8e49-7ff4d72bac03
11552024-06-25T22:09:56.857ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_39414697-c0fa-4175-9995-5ce327f254cb") failed: Property not found. retry in 179.541699ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_39414697-c0fa-4175-9995-5ce327f254cb
11562024-06-25T22:09:56.873ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d63f510d-32cb-47e8-bcbc-0fedff2f6b57") failed: Property not found. retry in 100.039287ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d63f510d-32cb-47e8-bcbc-0fedff2f6b57
11572024-06-25T22:09:56.887ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_09790c06-6bd6-40de-90d1-ccdaeb06d637") failed: Property not found. retry in 51.109439ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_09790c06-6bd6-40de-90d1-ccdaeb06d637
11582024-06-25T22:09:56.900ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a9f63144-1150-4d68-bbd0-474799934844") failed: Property not found. retry in 134.806985ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a9f63144-1150-4d68-bbd0-474799934844
11592024-06-25T22:09:56.914ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_57d2d09d-5105-45b1-928c-c7148eba9fbb") failed: Property not found. retry in 111.035365ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_57d2d09d-5105-45b1-928c-c7148eba9fbb
11602024-06-25T22:09:56.929ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_489d3d8d-d211-4e20-b108-a0ff7b3a7978") failed: Property not found. retry in 245.71316ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_489d3d8d-d211-4e20-b108-a0ff7b3a7978
11612024-06-25T22:09:56.944ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c1b69c41-cc2f-4b1c-aa33-864a47332b73") failed: Property not found. retry in 183.751007ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c1b69c41-cc2f-4b1c-aa33-864a47332b73
11622024-06-25T22:09:56.956ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bae337bd-17bd-4f85-95ae-43ef570b4825") failed: Property not found. retry in 158.135178ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bae337bd-17bd-4f85-95ae-43ef570b4825
11632024-06-25T22:09:56.971ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_09790c06-6bd6-40de-90d1-ccdaeb06d637") failed: Property not found. retry in 190.48426ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_09790c06-6bd6-40de-90d1-ccdaeb06d637
11642024-06-25T22:09:56.984ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d63f510d-32cb-47e8-bcbc-0fedff2f6b57") failed: Property not found. retry in 407.778579ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d63f510d-32cb-47e8-bcbc-0fedff2f6b57
11652024-06-25T22:09:57.049ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_daf287cf-2ef4-4650-8e49-7ff4d72bac03") failed: Property not found. retry in 579.838929ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_daf287cf-2ef4-4650-8e49-7ff4d72bac03
11662024-06-25T22:09:57.080ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_39414697-c0fa-4175-9995-5ce327f254cb") failed: Property not found. retry in 494.691547ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_39414697-c0fa-4175-9995-5ce327f254cb
11672024-06-25T22:09:57.119ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a9f63144-1150-4d68-bbd0-474799934844") failed: Property not found. retry in 280.914149ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a9f63144-1150-4d68-bbd0-474799934844
11682024-06-25T22:09:57.149ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_57d2d09d-5105-45b1-928c-c7148eba9fbb") failed: Property not found. retry in 271.966116ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_57d2d09d-5105-45b1-928c-c7148eba9fbb
11692024-06-25T22:09:57.174ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c1b69c41-cc2f-4b1c-aa33-864a47332b73") failed: Property not found. retry in 395.502853ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c1b69c41-cc2f-4b1c-aa33-864a47332b73
11702024-06-25T22:09:57.198ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_31025c13-8a1b-4681-a5f3-5f5002b54c1e") failed: Property not found. retry in 382.003749ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_31025c13-8a1b-4681-a5f3-5f5002b54c1e
11712024-06-25T22:09:57.221ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bae337bd-17bd-4f85-95ae-43ef570b4825") failed: Property not found. retry in 508.403529ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bae337bd-17bd-4f85-95ae-43ef570b4825
11722024-06-25T22:09:57.402ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_09790c06-6bd6-40de-90d1-ccdaeb06d637") failed: Property not found. retry in 414.551981ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_09790c06-6bd6-40de-90d1-ccdaeb06d637
11732024-06-25T22:09:57.481ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a9f63144-1150-4d68-bbd0-474799934844") failed: Property not found. retry in 351.872701ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a9f63144-1150-4d68-bbd0-474799934844
11742024-06-25T22:09:57.504ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_57d2d09d-5105-45b1-928c-c7148eba9fbb") failed: Property not found. retry in 335.779638ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_57d2d09d-5105-45b1-928c-c7148eba9fbb
11752024-06-25T22:09:57.531ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_489d3d8d-d211-4e20-b108-a0ff7b3a7978") failed: Property not found. retry in 532.896791ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_489d3d8d-d211-4e20-b108-a0ff7b3a7978
11762024-06-25T22:09:57.553ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d63f510d-32cb-47e8-bcbc-0fedff2f6b57") failed: Property not found. retry in 721.187568ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d63f510d-32cb-47e8-bcbc-0fedff2f6b57
11772024-06-25T22:09:57.594ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c1b69c41-cc2f-4b1c-aa33-864a47332b73") failed: Property not found. retry in 542.589892ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c1b69c41-cc2f-4b1c-aa33-864a47332b73
11782024-06-25T22:09:57.619ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_39414697-c0fa-4175-9995-5ce327f254cb") failed: Property not found. retry in 849.680904ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_39414697-c0fa-4175-9995-5ce327f254cb
11792024-06-25T22:09:57.641ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_31025c13-8a1b-4681-a5f3-5f5002b54c1e") failed: Property not found. retry in 1.1674728s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_31025c13-8a1b-4681-a5f3-5f5002b54c1e
11802024-06-25T22:09:57.662ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_daf287cf-2ef4-4650-8e49-7ff4d72bac03") failed: Property not found. retry in 1.189217162s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_daf287cf-2ef4-4650-8e49-7ff4d72bac03
11812024-06-25T22:09:57.752ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bae337bd-17bd-4f85-95ae-43ef570b4825") failed: Property not found. retry in 442.806829ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bae337bd-17bd-4f85-95ae-43ef570b4825
11822024-06-25T22:09:57.842ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_09790c06-6bd6-40de-90d1-ccdaeb06d637") failed: Property not found. retry in 609.019079ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_09790c06-6bd6-40de-90d1-ccdaeb06d637
11832024-06-25T22:09:57.866ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a9f63144-1150-4d68-bbd0-474799934844") failed: Property not found. retry in 821.993676ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a9f63144-1150-4d68-bbd0-474799934844
11842024-06-25T22:09:57.899ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_57d2d09d-5105-45b1-928c-c7148eba9fbb") failed: Property not found. retry in 1.188406133s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_57d2d09d-5105-45b1-928c-c7148eba9fbb
11852024-06-25T22:09:57.968ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_ec8d60b8-1950-4791-b741-b3377213babd: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService14"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::10"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::10"/> <propval type="astring" name="listen_port" value="17000"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11862024-06-25T22:09:57.970ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_pantry_ec8d60b8-1950-4791-b741-b3377213babd
11872024-06-25T22:09:58.086ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_489d3d8d-d211-4e20-b108-a0ff7b3a7978") failed: Property not found. retry in 529.723032ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_489d3d8d-d211-4e20-b108-a0ff7b3a7978
11882024-06-25T22:09:58.156ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c1b69c41-cc2f-4b1c-aa33-864a47332b73") failed: Property not found. retry in 1.488434431s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c1b69c41-cc2f-4b1c-aa33-864a47332b73
11892024-06-25T22:09:58.175ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_93169012-721e-458e-8264-ae8f477750e9: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService19"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::12"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_b24fcace-6491-450a-a369-72a4fa2f698d/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::12"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="50d09b95-c912-4312-8450-39c7cd5d1717"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11902024-06-25T22:10:05.870ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bae337bd-17bd-4f85-95ae-43ef570b4825") failed: Property not found. retry in 1.216805897s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bae337bd-17bd-4f85-95ae-43ef570b4825
11912024-06-25T22:10:05.895ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a9f63144-1150-4d68-bbd0-474799934844") failed: Property not found. retry in 1.348005564s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a9f63144-1150-4d68-bbd0-474799934844
11922024-06-25T22:10:05.974ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_57d2d09d-5105-45b1-928c-c7148eba9fbb") failed: Property not found. retry in 1.209230101s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_57d2d09d-5105-45b1-928c-c7148eba9fbb
11932024-06-25T22:10:06.155ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_489d3d8d-d211-4e20-b108-a0ff7b3a7978") failed: Property not found. retry in 609.439113ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_489d3d8d-d211-4e20-b108-a0ff7b3a7978
11942024-06-25T22:10:06.288ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c1b69c41-cc2f-4b1c-aa33-864a47332b73") failed: Property not found. retry in 1.087091077s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c1b69c41-cc2f-4b1c-aa33-864a47332b73
11952024-06-25T22:10:06.288ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_93169012-721e-458e-8264-ae8f477750e9
11962024-06-25T22:10:06.345ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_e76e124b-7516-4909-90c2-5e334a704c61: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService21"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::11"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::11"/> <propval type="astring" name="listen_port" value="17000"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11972024-06-25T22:10:06.442ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_31025c13-8a1b-4681-a5f3-5f5002b54c1e") failed: Property not found. retry in 649.648561ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_31025c13-8a1b-4681-a5f3-5f5002b54c1e
11982024-06-25T22:10:06.518ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_daf287cf-2ef4-4650-8e49-7ff4d72bac03") failed: Property not found. retry in 1.102315031s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_daf287cf-2ef4-4650-8e49-7ff4d72bac03
11992024-06-25T22:10:06.587ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_39414697-c0fa-4175-9995-5ce327f254cb") failed: Property not found. retry in 728.882504ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_39414697-c0fa-4175-9995-5ce327f254cb
12002024-06-25T22:10:06.667ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d63f510d-32cb-47e8-bcbc-0fedff2f6b57") failed: Property not found. retry in 1.395347428s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d63f510d-32cb-47e8-bcbc-0fedff2f6b57
12012024-06-25T22:10:06.737ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_09790c06-6bd6-40de-90d1-ccdaeb06d637") failed: Property not found. retry in 1.020324365s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_09790c06-6bd6-40de-90d1-ccdaeb06d637
12022024-06-25T22:10:06.737ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_b8926782-287c-4933-bfeb-32cf3be7f706: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService25"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::9"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value="vopte1"/> <propval type="astring" name="gateway" value="172.30.1.1"/> <propval type="astring" name="ip" value="172.30.1.6"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value="[fd00:1122:3344:101::9]:5353"/> <propval type="astring" name="dns_address" value="172.30.1.6:53"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12032024-06-25T22:10:06.811ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ec8d60b8-1950-4791-b741-b3377213babd") failed: Property not found. retry in 69.243721ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ec8d60b8-1950-4791-b741-b3377213babd
12042024-06-25T22:10:06.940ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_489d3d8d-d211-4e20-b108-a0ff7b3a7978") failed: Property not found. retry in 783.497016ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_489d3d8d-d211-4e20-b108-a0ff7b3a7978
12052024-06-25T22:10:07.023ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_93169012-721e-458e-8264-ae8f477750e9") failed: Property not found. retry in 39.727012ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_93169012-721e-458e-8264-ae8f477750e9
12062024-06-25T22:10:07.086ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_pantry_e76e124b-7516-4909-90c2-5e334a704c61
12072024-06-25T22:10:07.166ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 125.720937752s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:423 sled_id = 98068951-ddeb-40ca-9677-d05b350bbf94
12082024-06-25T22:10:07.168ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bae337bd-17bd-4f85-95ae-43ef570b4825") failed: Property not found. retry in 1.041272796s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bae337bd-17bd-4f85-95ae-43ef570b4825
12092024-06-25T22:10:07.168ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_090cab3e-c3ab-4330-b9c9-1127a32f39f2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService27"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::8"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value="vopte3"/> <propval type="astring" name="gateway" value="172.30.1.1"/> <propval type="astring" name="ip" value="172.30.1.5"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value="[fd00:1122:3344:101::8]:5353"/> <propval type="astring" name="dns_address" value="172.30.1.5:53"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12102024-06-25T22:10:07.168ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_external_dns_b8926782-287c-4933-bfeb-32cf3be7f706
12112024-06-25T22:10:07.311ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ec8d60b8-1950-4791-b741-b3377213babd") failed: Property not found. retry in 62.633493ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ec8d60b8-1950-4791-b741-b3377213babd
12122024-06-25T22:10:07.382ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a9f63144-1150-4d68-bbd0-474799934844") failed: Property not found. retry in 1.213918141s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a9f63144-1150-4d68-bbd0-474799934844
12132024-06-25T22:10:07.455ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_57d2d09d-5105-45b1-928c-c7148eba9fbb") failed: Property not found. retry in 1.126216835s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_57d2d09d-5105-45b1-928c-c7148eba9fbb
12142024-06-25T22:10:07.524ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c1b69c41-cc2f-4b1c-aa33-864a47332b73") failed: Property not found. retry in 917.107406ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c1b69c41-cc2f-4b1c-aa33-864a47332b73
12152024-06-25T22:10:07.594ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_93169012-721e-458e-8264-ae8f477750e9") failed: Property not found. retry in 118.06179ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_93169012-721e-458e-8264-ae8f477750e9
12162024-06-25T22:10:07.667ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e76e124b-7516-4909-90c2-5e334a704c61") failed: Property not found. retry in 57.190881ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e76e124b-7516-4909-90c2-5e334a704c61
12172024-06-25T22:10:07.738ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_31025c13-8a1b-4681-a5f3-5f5002b54c1e") failed: Property not found. retry in 1.429896075s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_31025c13-8a1b-4681-a5f3-5f5002b54c1e
12182024-06-25T22:10:07.738ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_external_dns_090cab3e-c3ab-4330-b9c9-1127a32f39f2
12192024-06-25T22:10:14.758ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_daf287cf-2ef4-4650-8e49-7ff4d72bac03") failed: Property not found. retry in 1.023463172s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_daf287cf-2ef4-4650-8e49-7ff4d72bac03
12202024-06-25T22:10:14.770ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_39414697-c0fa-4175-9995-5ce327f254cb") failed: Property not found. retry in 946.320529ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_39414697-c0fa-4175-9995-5ce327f254cb
12212024-06-25T22:10:14.779ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d63f510d-32cb-47e8-bcbc-0fedff2f6b57") failed: Property not found. retry in 583.79957ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d63f510d-32cb-47e8-bcbc-0fedff2f6b57
12222024-06-25T22:10:14.787ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_09790c06-6bd6-40de-90d1-ccdaeb06d637") failed: Property not found. retry in 1.106762188s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_09790c06-6bd6-40de-90d1-ccdaeb06d637
12232024-06-25T22:10:14.796ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b8926782-287c-4933-bfeb-32cf3be7f706") failed: Property not found. retry in 30.250767ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_b8926782-287c-4933-bfeb-32cf3be7f706
12242024-06-25T22:10:14.805ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ec8d60b8-1950-4791-b741-b3377213babd") failed: Property not found. retry in 275.82723ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ec8d60b8-1950-4791-b741-b3377213babd
12252024-06-25T22:10:14.813ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a9f63144-1150-4d68-bbd0-474799934844") failed: Property not found. retry in 965.626128ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a9f63144-1150-4d68-bbd0-474799934844
12262024-06-25T22:10:14.822ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_57d2d09d-5105-45b1-928c-c7148eba9fbb") failed: Property not found. retry in 1.319702178s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_57d2d09d-5105-45b1-928c-c7148eba9fbb
12272024-06-25T22:10:14.832ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_489d3d8d-d211-4e20-b108-a0ff7b3a7978") failed: Property not found. retry in 1.197538678s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_489d3d8d-d211-4e20-b108-a0ff7b3a7978
12282024-06-25T22:10:14.841ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c1b69c41-cc2f-4b1c-aa33-864a47332b73") failed: Property not found. retry in 516.329232ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c1b69c41-cc2f-4b1c-aa33-864a47332b73
12292024-06-25T22:10:14.849ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_93169012-721e-458e-8264-ae8f477750e9") failed: Property not found. retry in 191.921167ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_93169012-721e-458e-8264-ae8f477750e9
12302024-06-25T22:10:14.849ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_63818da9-9b47-4961-acee-684195690598: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService26"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::b"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value="vopte2"/> <propval type="astring" name="gateway" value="172.30.2.1"/> <propval type="astring" name="ip" value="172.30.2.6"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12312024-06-25T22:10:14.860ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e76e124b-7516-4909-90c2-5e334a704c61") failed: Property not found. retry in 112.579568ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e76e124b-7516-4909-90c2-5e334a704c61
12322024-06-25T22:10:14.869ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_31025c13-8a1b-4681-a5f3-5f5002b54c1e") failed: Property not found. retry in 1.379149733s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_31025c13-8a1b-4681-a5f3-5f5002b54c1e
12332024-06-25T22:10:14.878ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bae337bd-17bd-4f85-95ae-43ef570b4825") failed: Property not found. retry in 1.306669848s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bae337bd-17bd-4f85-95ae-43ef570b4825
12342024-06-25T22:10:14.888ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_090cab3e-c3ab-4330-b9c9-1127a32f39f2") failed: Property not found. retry in 53.621209ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_090cab3e-c3ab-4330-b9c9-1127a32f39f2
12352024-06-25T22:10:14.888ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_211fbf99-1061-4acf-8e74-43eed5e3a08d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService24"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::a"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value="vopte5"/> <propval type="astring" name="gateway" value="172.30.2.1"/> <propval type="astring" name="ip" value="172.30.2.5"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12362024-06-25T22:10:14.899ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b8926782-287c-4933-bfeb-32cf3be7f706") failed: Property not found. retry in 99.82326ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_b8926782-287c-4933-bfeb-32cf3be7f706
12372024-06-25T22:10:14.899ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_nexus_63818da9-9b47-4961-acee-684195690598
12382024-06-25T22:10:14.904ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_nexus_211fbf99-1061-4acf-8e74-43eed5e3a08d
12392024-06-25T22:10:14.909ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_1767227d-844e-45e4-9835-24fb7251a22f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService28"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::c"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value="vopte4"/> <propval type="astring" name="gateway" value="172.30.2.1"/> <propval type="astring" name="ip" value="172.30.2.7"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12402024-06-25T22:10:14.910ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_nexus_1767227d-844e-45e4-9835-24fb7251a22f
12412024-06-25T22:10:14.952ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_090cab3e-c3ab-4330-b9c9-1127a32f39f2") failed: Property not found. retry in 105.098696ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_090cab3e-c3ab-4330-b9c9-1127a32f39f2
12422024-06-25T22:10:14.985ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e76e124b-7516-4909-90c2-5e334a704c61") failed: Property not found. retry in 264.940095ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e76e124b-7516-4909-90c2-5e334a704c61
12432024-06-25T22:10:15.010ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b8926782-287c-4933-bfeb-32cf3be7f706") failed: Property not found. retry in 169.662513ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_b8926782-287c-4933-bfeb-32cf3be7f706
12442024-06-25T22:10:15.055ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_93169012-721e-458e-8264-ae8f477750e9") failed: Property not found. retry in 462.524899ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_93169012-721e-458e-8264-ae8f477750e9
12452024-06-25T22:10:15.071ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_090cab3e-c3ab-4330-b9c9-1127a32f39f2") failed: Property not found. retry in 288.430717ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_090cab3e-c3ab-4330-b9c9-1127a32f39f2
12462024-06-25T22:10:15.080ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_63818da9-9b47-4961-acee-684195690598") failed: Property not found. retry in 39.304414ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_63818da9-9b47-4961-acee-684195690598
12472024-06-25T22:10:15.093ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ec8d60b8-1950-4791-b741-b3377213babd") failed: Property not found. retry in 363.441344ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ec8d60b8-1950-4791-b741-b3377213babd
12482024-06-25T22:10:15.102ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1767227d-844e-45e4-9835-24fb7251a22f") failed: Property not found. retry in 44.795158ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1767227d-844e-45e4-9835-24fb7251a22f
12492024-06-25T22:10:15.110ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_211fbf99-1061-4acf-8e74-43eed5e3a08d") failed: Property not found. retry in 47.937661ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_211fbf99-1061-4acf-8e74-43eed5e3a08d
12502024-06-25T22:10:15.130ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_63818da9-9b47-4961-acee-684195690598") failed: Property not found. retry in 55.838455ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_63818da9-9b47-4961-acee-684195690598
12512024-06-25T22:10:15.157ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1767227d-844e-45e4-9835-24fb7251a22f") failed: Property not found. retry in 96.454629ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1767227d-844e-45e4-9835-24fb7251a22f
12522024-06-25T22:10:15.168ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_211fbf99-1061-4acf-8e74-43eed5e3a08d") failed: Property not found. retry in 86.844066ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_211fbf99-1061-4acf-8e74-43eed5e3a08d
12532024-06-25T22:10:15.191ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b8926782-287c-4933-bfeb-32cf3be7f706") failed: Property not found. retry in 526.481886ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_b8926782-287c-4933-bfeb-32cf3be7f706
12542024-06-25T22:10:15.199ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_63818da9-9b47-4961-acee-684195690598") failed: Property not found. retry in 113.62095ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_63818da9-9b47-4961-acee-684195690598
12552024-06-25T22:10:15.263ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e76e124b-7516-4909-90c2-5e334a704c61") failed: Property not found. retry in 527.834215ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e76e124b-7516-4909-90c2-5e334a704c61
12562024-06-25T22:10:15.272ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_211fbf99-1061-4acf-8e74-43eed5e3a08d") failed: Property not found. retry in 243.219237ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_211fbf99-1061-4acf-8e74-43eed5e3a08d
12572024-06-25T22:10:15.282ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1767227d-844e-45e4-9835-24fb7251a22f") failed: Property not found. retry in 275.688528ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1767227d-844e-45e4-9835-24fb7251a22f
12582024-06-25T22:10:15.326ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_63818da9-9b47-4961-acee-684195690598") failed: Property not found. retry in 436.393255ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_63818da9-9b47-4961-acee-684195690598
12592024-06-25T22:10:15.366ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c1b69c41-cc2f-4b1c-aa33-864a47332b73") failed: Property not found. retry in 524.84374ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c1b69c41-cc2f-4b1c-aa33-864a47332b73
12602024-06-25T22:10:15.374ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d63f510d-32cb-47e8-bcbc-0fedff2f6b57") failed: Property not found. retry in 507.744114ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d63f510d-32cb-47e8-bcbc-0fedff2f6b57
12612024-06-25T22:10:15.382ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_090cab3e-c3ab-4330-b9c9-1127a32f39f2") failed: Property not found. retry in 376.976285ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_090cab3e-c3ab-4330-b9c9-1127a32f39f2
12622024-06-25T22:10:15.467ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ec8d60b8-1950-4791-b741-b3377213babd") failed: Property not found. retry in 746.496556ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ec8d60b8-1950-4791-b741-b3377213babd
12632024-06-25T22:10:15.528ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_211fbf99-1061-4acf-8e74-43eed5e3a08d") failed: Property not found. retry in 551.084193ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_211fbf99-1061-4acf-8e74-43eed5e3a08d
12642024-06-25T22:10:15.538ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_93169012-721e-458e-8264-ae8f477750e9") failed: Property not found. retry in 883.079053ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_93169012-721e-458e-8264-ae8f477750e9
12652024-06-25T22:10:15.569ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1767227d-844e-45e4-9835-24fb7251a22f") failed: Property not found. retry in 330.742919ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1767227d-844e-45e4-9835-24fb7251a22f
12662024-06-25T22:10:15.729ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_39414697-c0fa-4175-9995-5ce327f254cb") failed: Property not found. retry in 1.421080071s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_39414697-c0fa-4175-9995-5ce327f254cb
12672024-06-25T22:10:15.740ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b8926782-287c-4933-bfeb-32cf3be7f706") failed: Property not found. retry in 1.18874271s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_b8926782-287c-4933-bfeb-32cf3be7f706
12682024-06-25T22:10:15.770ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_090cab3e-c3ab-4330-b9c9-1127a32f39f2") failed: Property not found. retry in 443.730717ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_090cab3e-c3ab-4330-b9c9-1127a32f39f2
12692024-06-25T22:10:15.780ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_63818da9-9b47-4961-acee-684195690598") failed: Property not found. retry in 796.931654ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_63818da9-9b47-4961-acee-684195690598
12702024-06-25T22:10:15.794ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a9f63144-1150-4d68-bbd0-474799934844") failed: Property not found. retry in 1.234386077s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a9f63144-1150-4d68-bbd0-474799934844
12712024-06-25T22:10:15.810ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e76e124b-7516-4909-90c2-5e334a704c61") failed: Property not found. retry in 706.883549ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e76e124b-7516-4909-90c2-5e334a704c61
12722024-06-25T22:10:15.823ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_daf287cf-2ef4-4650-8e49-7ff4d72bac03") failed: Property not found. retry in 980.442959ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_daf287cf-2ef4-4650-8e49-7ff4d72bac03
12732024-06-25T22:10:15.896ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d63f510d-32cb-47e8-bcbc-0fedff2f6b57") failed: Property not found. retry in 936.255102ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d63f510d-32cb-47e8-bcbc-0fedff2f6b57
12742024-06-25T22:10:15.906ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_09790c06-6bd6-40de-90d1-ccdaeb06d637") failed: Property not found. retry in 849.875011ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_09790c06-6bd6-40de-90d1-ccdaeb06d637
12752024-06-25T22:10:15.917ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c1b69c41-cc2f-4b1c-aa33-864a47332b73") failed: Property not found. retry in 1.446263394s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c1b69c41-cc2f-4b1c-aa33-864a47332b73
12762024-06-25T22:10:15.929ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1767227d-844e-45e4-9835-24fb7251a22f") failed: Property not found. retry in 1.021987971s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1767227d-844e-45e4-9835-24fb7251a22f
12772024-06-25T22:10:16.043ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_489d3d8d-d211-4e20-b108-a0ff7b3a7978") failed: Property not found. retry in 1.472831245s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_489d3d8d-d211-4e20-b108-a0ff7b3a7978
12782024-06-25T22:10:16.093ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_211fbf99-1061-4acf-8e74-43eed5e3a08d") failed: Property not found. retry in 1.102078543s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_211fbf99-1061-4acf-8e74-43eed5e3a08d
12792024-06-25T22:10:16.154ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_57d2d09d-5105-45b1-928c-c7148eba9fbb") failed: Property not found. retry in 1.482163793s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_57d2d09d-5105-45b1-928c-c7148eba9fbb
12802024-06-25T22:10:16.197ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bae337bd-17bd-4f85-95ae-43ef570b4825") failed: Property not found. retry in 1.174936242s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bae337bd-17bd-4f85-95ae-43ef570b4825
12812024-06-25T22:10:16.225ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ec8d60b8-1950-4791-b741-b3377213babd") failed: Property not found. retry in 984.557558ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ec8d60b8-1950-4791-b741-b3377213babd
12822024-06-25T22:10:16.235ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_090cab3e-c3ab-4330-b9c9-1127a32f39f2") failed: Property not found. retry in 525.175628ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_090cab3e-c3ab-4330-b9c9-1127a32f39f2
12832024-06-25T22:10:16.259ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_31025c13-8a1b-4681-a5f3-5f5002b54c1e") failed: Property not found. retry in 732.84291ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_31025c13-8a1b-4681-a5f3-5f5002b54c1e
12842024-06-25T22:10:16.436ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_93169012-721e-458e-8264-ae8f477750e9") failed: Property not found. retry in 1.387250132s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_93169012-721e-458e-8264-ae8f477750e9
12852024-06-25T22:10:16.530ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e76e124b-7516-4909-90c2-5e334a704c61") failed: Property not found. retry in 921.255761ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e76e124b-7516-4909-90c2-5e334a704c61
12862024-06-25T22:10:16.591ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_63818da9-9b47-4961-acee-684195690598") failed: Property not found. retry in 846.28453ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_63818da9-9b47-4961-acee-684195690598
12872024-06-25T22:10:16.769ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_09790c06-6bd6-40de-90d1-ccdaeb06d637") failed: Property not found. retry in 648.497837ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_09790c06-6bd6-40de-90d1-ccdaeb06d637
12882024-06-25T22:10:16.780ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_090cab3e-c3ab-4330-b9c9-1127a32f39f2") failed: Property not found. retry in 1.319112904s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_090cab3e-c3ab-4330-b9c9-1127a32f39f2
12892024-06-25T22:10:16.816ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_daf287cf-2ef4-4650-8e49-7ff4d72bac03") failed: Property not found. retry in 1.408736686s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_daf287cf-2ef4-4650-8e49-7ff4d72bac03
12902024-06-25T22:10:16.848ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d63f510d-32cb-47e8-bcbc-0fedff2f6b57") failed: Property not found. retry in 529.543796ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d63f510d-32cb-47e8-bcbc-0fedff2f6b57
12912024-06-25T22:10:16.948ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b8926782-287c-4933-bfeb-32cf3be7f706") failed: Property not found. retry in 1.466984972s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_b8926782-287c-4933-bfeb-32cf3be7f706
12922024-06-25T22:10:16.966ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1767227d-844e-45e4-9835-24fb7251a22f") failed: Property not found. retry in 1.499186524s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1767227d-844e-45e4-9835-24fb7251a22f
12932024-06-25T22:10:17.008ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_31025c13-8a1b-4681-a5f3-5f5002b54c1e") failed: Property not found. retry in 1.017622462s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_31025c13-8a1b-4681-a5f3-5f5002b54c1e
12942024-06-25T22:10:17.042ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a9f63144-1150-4d68-bbd0-474799934844") failed: Property not found. retry in 1.16296667s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a9f63144-1150-4d68-bbd0-474799934844
12952024-06-25T22:10:17.165ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_39414697-c0fa-4175-9995-5ce327f254cb") failed: Property not found. retry in 794.458293ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_39414697-c0fa-4175-9995-5ce327f254cb
12962024-06-25T22:10:17.210ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_211fbf99-1061-4acf-8e74-43eed5e3a08d") failed: Property not found. retry in 1.423650653s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_211fbf99-1061-4acf-8e74-43eed5e3a08d
12972024-06-25T22:10:17.228ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ec8d60b8-1950-4791-b741-b3377213babd") failed: Property not found. retry in 1.066897004s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ec8d60b8-1950-4791-b741-b3377213babd
12982024-06-25T22:10:17.333ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_e3a931fa-0dc4-4413-acff-07a88fa4b22f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService20"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::e"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::e"/> <propval type="astring" name="listen_port" value="8123"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12992024-06-25T22:10:17.334ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_clickhouse_e3a931fa-0dc4-4413-acff-07a88fa4b22f
13002024-06-25T22:10:17.375ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c1b69c41-cc2f-4b1c-aa33-864a47332b73") failed: Property not found. retry in 514.250512ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c1b69c41-cc2f-4b1c-aa33-864a47332b73
13012024-06-25T22:10:17.385ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bae337bd-17bd-4f85-95ae-43ef570b4825") failed: Property not found. retry in 1.143753728s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bae337bd-17bd-4f85-95ae-43ef570b4825
13022024-06-25T22:10:17.396ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d63f510d-32cb-47e8-bcbc-0fedff2f6b57") failed: Property not found. retry in 1.121954451s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d63f510d-32cb-47e8-bcbc-0fedff2f6b57
13032024-06-25T22:10:17.430ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_09790c06-6bd6-40de-90d1-ccdaeb06d637") failed: Property not found. retry in 981.741141ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_09790c06-6bd6-40de-90d1-ccdaeb06d637
13042024-06-25T22:10:17.450ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_63818da9-9b47-4961-acee-684195690598") failed: Property not found. retry in 1.314962508s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_63818da9-9b47-4961-acee-684195690598
13052024-06-25T22:10:17.468ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e76e124b-7516-4909-90c2-5e334a704c61") failed: Property not found. retry in 812.355111ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e76e124b-7516-4909-90c2-5e334a704c61
13062024-06-25T22:10:17.527ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_489d3d8d-d211-4e20-b108-a0ff7b3a7978") failed: Property not found. retry in 1.381585371s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_489d3d8d-d211-4e20-b108-a0ff7b3a7978
13072024-06-25T22:10:17.550ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_e3a931fa-0dc4-4413-acff-07a88fa4b22f") failed: Property not found. retry in 33.717081ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_e3a931fa-0dc4-4413-acff-07a88fa4b22f
13082024-06-25T22:10:17.595ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_e3a931fa-0dc4-4413-acff-07a88fa4b22f") failed: Property not found. retry in 112.503829ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_e3a931fa-0dc4-4413-acff-07a88fa4b22f
13092024-06-25T22:10:17.654ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_57d2d09d-5105-45b1-928c-c7148eba9fbb") failed: Property not found. retry in 1.376501819s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_57d2d09d-5105-45b1-928c-c7148eba9fbb
13102024-06-25T22:10:17.725ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_e3a931fa-0dc4-4413-acff-07a88fa4b22f") failed: Property not found. retry in 203.587162ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_e3a931fa-0dc4-4413-acff-07a88fa4b22f
13112024-06-25T22:10:17.840ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_93169012-721e-458e-8264-ae8f477750e9") failed: Property not found. retry in 1.131809964s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_93169012-721e-458e-8264-ae8f477750e9
13122024-06-25T22:10:17.907ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c1b69c41-cc2f-4b1c-aa33-864a47332b73") failed: Property not found. retry in 1.211904381s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c1b69c41-cc2f-4b1c-aa33-864a47332b73
13132024-06-25T22:10:17.943ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_e3a931fa-0dc4-4413-acff-07a88fa4b22f") failed: Property not found. retry in 308.935791ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_e3a931fa-0dc4-4413-acff-07a88fa4b22f
13142024-06-25T22:10:17.972ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_39414697-c0fa-4175-9995-5ce327f254cb") failed: Property not found. retry in 956.021933ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_39414697-c0fa-4175-9995-5ce327f254cb
13152024-06-25T22:10:18.035ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_31025c13-8a1b-4681-a5f3-5f5002b54c1e") failed: Property not found. retry in 1.055701564s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_31025c13-8a1b-4681-a5f3-5f5002b54c1e
13162024-06-25T22:10:18.108ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_090cab3e-c3ab-4330-b9c9-1127a32f39f2") failed: Property not found. retry in 597.311782ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_090cab3e-c3ab-4330-b9c9-1127a32f39f2
13172024-06-25T22:10:18.215ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a9f63144-1150-4d68-bbd0-474799934844") failed: Property not found. retry in 1.440410107s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a9f63144-1150-4d68-bbd0-474799934844
13182024-06-25T22:10:18.236ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_daf287cf-2ef4-4650-8e49-7ff4d72bac03") failed: Property not found. retry in 1.135773211s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_daf287cf-2ef4-4650-8e49-7ff4d72bac03
13192024-06-25T22:10:18.262ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_e3a931fa-0dc4-4413-acff-07a88fa4b22f") failed: Property not found. retry in 1.111339951s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_e3a931fa-0dc4-4413-acff-07a88fa4b22f
13202024-06-25T22:10:18.290ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e76e124b-7516-4909-90c2-5e334a704c61") failed: Property not found. retry in 1.114552246s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e76e124b-7516-4909-90c2-5e334a704c61
13212024-06-25T22:10:18.304ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ec8d60b8-1950-4791-b741-b3377213babd") failed: Property not found. retry in 1.045370936s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ec8d60b8-1950-4791-b741-b3377213babd
13222024-06-25T22:10:18.423ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_09790c06-6bd6-40de-90d1-ccdaeb06d637") failed: Property not found. retry in 1.426611574s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_09790c06-6bd6-40de-90d1-ccdaeb06d637
13232024-06-25T22:10:18.433ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b8926782-287c-4933-bfeb-32cf3be7f706") failed: Property not found. retry in 1.28693187s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_b8926782-287c-4933-bfeb-32cf3be7f706
13242024-06-25T22:10:18.476ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1767227d-844e-45e4-9835-24fb7251a22f") failed: Property not found. retry in 830.690755ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1767227d-844e-45e4-9835-24fb7251a22f
13252024-06-25T22:10:18.530ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d63f510d-32cb-47e8-bcbc-0fedff2f6b57") failed: Property not found. retry in 708.448883ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d63f510d-32cb-47e8-bcbc-0fedff2f6b57
13262024-06-25T22:10:18.539ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bae337bd-17bd-4f85-95ae-43ef570b4825") failed: Property not found. retry in 1.055447517s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bae337bd-17bd-4f85-95ae-43ef570b4825
13272024-06-25T22:10:18.649ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_211fbf99-1061-4acf-8e74-43eed5e3a08d") failed: Property not found. retry in 1.228250011s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_211fbf99-1061-4acf-8e74-43eed5e3a08d
13282024-06-25T22:10:18.720ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_090cab3e-c3ab-4330-b9c9-1127a32f39f2") failed: Property not found. retry in 1.351748649s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_090cab3e-c3ab-4330-b9c9-1127a32f39f2
13292024-06-25T22:10:18.783ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_63818da9-9b47-4961-acee-684195690598") failed: Property not found. retry in 1.311306785s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_63818da9-9b47-4961-acee-684195690598
13302024-06-25T22:10:18.923ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_489d3d8d-d211-4e20-b108-a0ff7b3a7978") failed: Property not found. retry in 1.020945072s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_489d3d8d-d211-4e20-b108-a0ff7b3a7978
13312024-06-25T22:10:18.943ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_39414697-c0fa-4175-9995-5ce327f254cb") failed: Property not found. retry in 1.440478016s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_39414697-c0fa-4175-9995-5ce327f254cb
13322024-06-25T22:10:18.984ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_93169012-721e-458e-8264-ae8f477750e9") failed: Property not found. retry in 1.135338699s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_93169012-721e-458e-8264-ae8f477750e9
13332024-06-25T22:10:19.045ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_57d2d09d-5105-45b1-928c-c7148eba9fbb") failed: Property not found. retry in 1.067268213s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_57d2d09d-5105-45b1-928c-c7148eba9fbb
13342024-06-25T22:10:19.105ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_31025c13-8a1b-4681-a5f3-5f5002b54c1e") failed: Property not found. retry in 746.685598ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_31025c13-8a1b-4681-a5f3-5f5002b54c1e
13352024-06-25T22:10:19.130ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c1b69c41-cc2f-4b1c-aa33-864a47332b73") failed: Property not found. retry in 1.499929988s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c1b69c41-cc2f-4b1c-aa33-864a47332b73
13362024-06-25T22:10:19.254ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d63f510d-32cb-47e8-bcbc-0fedff2f6b57") failed: Property not found. retry in 1.247600748s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d63f510d-32cb-47e8-bcbc-0fedff2f6b57
13372024-06-25T22:10:19.324ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1767227d-844e-45e4-9835-24fb7251a22f") failed: Property not found. retry in 661.879498ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1767227d-844e-45e4-9835-24fb7251a22f
13382024-06-25T22:10:19.363ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ec8d60b8-1950-4791-b741-b3377213babd") failed: Property not found. retry in 1.05055817s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ec8d60b8-1950-4791-b741-b3377213babd
13392024-06-25T22:10:19.387ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_daf287cf-2ef4-4650-8e49-7ff4d72bac03") failed: Property not found. retry in 1.039812656s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_daf287cf-2ef4-4650-8e49-7ff4d72bac03
13402024-06-25T22:10:19.400ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_e3a931fa-0dc4-4413-acff-07a88fa4b22f") failed: Property not found. retry in 1.259380277s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_e3a931fa-0dc4-4413-acff-07a88fa4b22f
13412024-06-25T22:10:19.419ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e76e124b-7516-4909-90c2-5e334a704c61") failed: Property not found. retry in 547.428667ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e76e124b-7516-4909-90c2-5e334a704c61
13422024-06-25T22:10:19.611ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bae337bd-17bd-4f85-95ae-43ef570b4825") failed: Property not found. retry in 890.664186ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bae337bd-17bd-4f85-95ae-43ef570b4825
13432024-06-25T22:10:19.671ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a9f63144-1150-4d68-bbd0-474799934844") failed: Property not found. retry in 912.502343ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a9f63144-1150-4d68-bbd0-474799934844
13442024-06-25T22:10:19.737ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b8926782-287c-4933-bfeb-32cf3be7f706") failed: Property not found. retry in 875.612993ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_b8926782-287c-4933-bfeb-32cf3be7f706
13452024-06-25T22:10:19.860ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_09790c06-6bd6-40de-90d1-ccdaeb06d637") failed: Property not found. retry in 825.360789ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_09790c06-6bd6-40de-90d1-ccdaeb06d637
13462024-06-25T22:10:19.871ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_31025c13-8a1b-4681-a5f3-5f5002b54c1e") failed: Property not found. retry in 873.347307ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_31025c13-8a1b-4681-a5f3-5f5002b54c1e
13472024-06-25T22:10:19.891ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_211fbf99-1061-4acf-8e74-43eed5e3a08d") failed: Property not found. retry in 851.698922ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_211fbf99-1061-4acf-8e74-43eed5e3a08d
13482024-06-25T22:10:19.957ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_489d3d8d-d211-4e20-b108-a0ff7b3a7978") failed: Property not found. retry in 527.200019ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_489d3d8d-d211-4e20-b108-a0ff7b3a7978
13492024-06-25T22:10:19.979ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e76e124b-7516-4909-90c2-5e334a704c61") failed: Property not found. retry in 1.466902586s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e76e124b-7516-4909-90c2-5e334a704c61
13502024-06-25T22:10:20.002ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1767227d-844e-45e4-9835-24fb7251a22f") failed: Property not found. retry in 728.816229ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1767227d-844e-45e4-9835-24fb7251a22f
13512024-06-25T22:10:20.092ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_090cab3e-c3ab-4330-b9c9-1127a32f39f2") failed: Property not found. retry in 1.452897119s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_090cab3e-c3ab-4330-b9c9-1127a32f39f2
13522024-06-25T22:10:20.109ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_63818da9-9b47-4961-acee-684195690598") failed: Property not found. retry in 590.015702ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_63818da9-9b47-4961-acee-684195690598
13532024-06-25T22:10:20.127ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_57d2d09d-5105-45b1-928c-c7148eba9fbb") failed: Property not found. retry in 1.135339301s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_57d2d09d-5105-45b1-928c-c7148eba9fbb
13542024-06-25T22:10:20.141ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_93169012-721e-458e-8264-ae8f477750e9") failed: Property not found. retry in 1.40102111s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_93169012-721e-458e-8264-ae8f477750e9
13552024-06-25T22:10:20.400ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_39414697-c0fa-4175-9995-5ce327f254cb") failed: Property not found. retry in 1.023444436s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_39414697-c0fa-4175-9995-5ce327f254cb
13562024-06-25T22:10:20.426ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ec8d60b8-1950-4791-b741-b3377213babd") failed: Property not found. retry in 598.260512ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ec8d60b8-1950-4791-b741-b3377213babd
13572024-06-25T22:10:20.438ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_daf287cf-2ef4-4650-8e49-7ff4d72bac03") failed: Property not found. retry in 585.861765ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_daf287cf-2ef4-4650-8e49-7ff4d72bac03
13582024-06-25T22:10:20.501ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_489d3d8d-d211-4e20-b108-a0ff7b3a7978") failed: Property not found. retry in 1.474310167s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_489d3d8d-d211-4e20-b108-a0ff7b3a7978
13592024-06-25T22:10:20.515ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d63f510d-32cb-47e8-bcbc-0fedff2f6b57") failed: Property not found. retry in 1.022102194s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d63f510d-32cb-47e8-bcbc-0fedff2f6b57
13602024-06-25T22:10:20.526ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bae337bd-17bd-4f85-95ae-43ef570b4825") failed: Property not found. retry in 1.289027682s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bae337bd-17bd-4f85-95ae-43ef570b4825
13612024-06-25T22:10:20.599ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a9f63144-1150-4d68-bbd0-474799934844") failed: Property not found. retry in 1.273714082s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a9f63144-1150-4d68-bbd0-474799934844
13622024-06-25T22:10:20.625ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b8926782-287c-4933-bfeb-32cf3be7f706") failed: Property not found. retry in 1.047526573s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_b8926782-287c-4933-bfeb-32cf3be7f706
13632024-06-25T22:10:20.644ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c1b69c41-cc2f-4b1c-aa33-864a47332b73") failed: Property not found. retry in 849.136853ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c1b69c41-cc2f-4b1c-aa33-864a47332b73
13642024-06-25T22:10:20.674ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_e3a931fa-0dc4-4413-acff-07a88fa4b22f") failed: Property not found. retry in 1.322957754s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_e3a931fa-0dc4-4413-acff-07a88fa4b22f
13652024-06-25T22:10:20.698ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_09790c06-6bd6-40de-90d1-ccdaeb06d637") failed: Property not found. retry in 544.012001ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_09790c06-6bd6-40de-90d1-ccdaeb06d637
13662024-06-25T22:10:20.714ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_63818da9-9b47-4961-acee-684195690598") failed: Property not found. retry in 919.823757ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_63818da9-9b47-4961-acee-684195690598
13672024-06-25T22:10:20.743ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1767227d-844e-45e4-9835-24fb7251a22f") failed: Property not found. retry in 1.38402339s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1767227d-844e-45e4-9835-24fb7251a22f
13682024-06-25T22:10:20.756ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_211fbf99-1061-4acf-8e74-43eed5e3a08d") failed: Property not found. retry in 868.229309ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_211fbf99-1061-4acf-8e74-43eed5e3a08d
13692024-06-25T22:10:20.768ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_31025c13-8a1b-4681-a5f3-5f5002b54c1e") failed: Property not found. retry in 701.793576ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_31025c13-8a1b-4681-a5f3-5f5002b54c1e
13702024-06-25T22:10:21.038ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_daf287cf-2ef4-4650-8e49-7ff4d72bac03") failed: Property not found. retry in 985.361703ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_daf287cf-2ef4-4650-8e49-7ff4d72bac03
13712024-06-25T22:10:21.049ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ec8d60b8-1950-4791-b741-b3377213babd") failed: Property not found. retry in 1.092583586s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ec8d60b8-1950-4791-b741-b3377213babd
13722024-06-25T22:10:21.255ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_09790c06-6bd6-40de-90d1-ccdaeb06d637") failed: Property not found. retry in 861.258245ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_09790c06-6bd6-40de-90d1-ccdaeb06d637
13732024-06-25T22:10:21.278ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_57d2d09d-5105-45b1-928c-c7148eba9fbb") failed: Property not found. retry in 1.30634206s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_57d2d09d-5105-45b1-928c-c7148eba9fbb
13742024-06-25T22:10:21.436ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_39414697-c0fa-4175-9995-5ce327f254cb") failed: Property not found. retry in 777.389643ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_39414697-c0fa-4175-9995-5ce327f254cb
13752024-06-25T22:10:21.459ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e76e124b-7516-4909-90c2-5e334a704c61") failed: Property not found. retry in 1.220540537s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e76e124b-7516-4909-90c2-5e334a704c61
13762024-06-25T22:10:21.483ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_31025c13-8a1b-4681-a5f3-5f5002b54c1e") failed: Property not found. retry in 763.300941ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_31025c13-8a1b-4681-a5f3-5f5002b54c1e
13772024-06-25T22:10:21.503ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c1b69c41-cc2f-4b1c-aa33-864a47332b73") failed: Property not found. retry in 673.592983ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c1b69c41-cc2f-4b1c-aa33-864a47332b73
13782024-06-25T22:10:21.549ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d63f510d-32cb-47e8-bcbc-0fedff2f6b57") failed: Property not found. retry in 653.612299ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d63f510d-32cb-47e8-bcbc-0fedff2f6b57
13792024-06-25T22:10:21.561ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_93169012-721e-458e-8264-ae8f477750e9") failed: Property not found. retry in 1.36798868s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_93169012-721e-458e-8264-ae8f477750e9
13802024-06-25T22:10:21.574ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_090cab3e-c3ab-4330-b9c9-1127a32f39f2") failed: Property not found. retry in 1.472663768s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_090cab3e-c3ab-4330-b9c9-1127a32f39f2
13812024-06-25T22:10:21.635ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_211fbf99-1061-4acf-8e74-43eed5e3a08d") failed: Property not found. retry in 612.022668ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_211fbf99-1061-4acf-8e74-43eed5e3a08d
13822024-06-25T22:10:21.646ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_63818da9-9b47-4961-acee-684195690598") failed: Property not found. retry in 1.349423065s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_63818da9-9b47-4961-acee-684195690598
13832024-06-25T22:10:21.683ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b8926782-287c-4933-bfeb-32cf3be7f706") failed: Property not found. retry in 756.720927ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_b8926782-287c-4933-bfeb-32cf3be7f706
13842024-06-25T22:10:21.897ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a9f63144-1150-4d68-bbd0-474799934844") failed: Property not found. retry in 591.111333ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a9f63144-1150-4d68-bbd0-474799934844
13852024-06-25T22:10:21.991ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_489d3d8d-d211-4e20-b108-a0ff7b3a7978") failed: Property not found. retry in 1.012807073s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_489d3d8d-d211-4e20-b108-a0ff7b3a7978
13862024-06-25T22:10:22.016ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_e3a931fa-0dc4-4413-acff-07a88fa4b22f") failed: Property not found. retry in 964.432484ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_e3a931fa-0dc4-4413-acff-07a88fa4b22f
13872024-06-25T22:10:22.039ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_daf287cf-2ef4-4650-8e49-7ff4d72bac03") failed: Property not found. retry in 522.412204ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_daf287cf-2ef4-4650-8e49-7ff4d72bac03
13882024-06-25T22:10:22.161ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ec8d60b8-1950-4791-b741-b3377213babd") failed: Property not found. retry in 1.115252133s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ec8d60b8-1950-4791-b741-b3377213babd
13892024-06-25T22:10:22.178ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1767227d-844e-45e4-9835-24fb7251a22f") failed: Property not found. retry in 788.347468ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1767227d-844e-45e4-9835-24fb7251a22f
13902024-06-25T22:10:22.198ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c1b69c41-cc2f-4b1c-aa33-864a47332b73") failed: Property not found. retry in 1.26208458s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c1b69c41-cc2f-4b1c-aa33-864a47332b73
13912024-06-25T22:10:22.284ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_211fbf99-1061-4acf-8e74-43eed5e3a08d") failed: Property not found. retry in 1.169201948s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_211fbf99-1061-4acf-8e74-43eed5e3a08d
13922024-06-25T22:10:22.984ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1767227d-844e-45e4-9835-24fb7251a22f") failed: Property not found. retry in 1.030519775s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1767227d-844e-45e4-9835-24fb7251a22f
13932024-06-25T22:10:22.999ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_e3a931fa-0dc4-4413-acff-07a88fa4b22f") failed: Property not found. retry in 1.485703473s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_e3a931fa-0dc4-4413-acff-07a88fa4b22f
13942024-06-25T22:10:23.016ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_63818da9-9b47-4961-acee-684195690598") failed: Property not found. retry in 1.123119294s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_63818da9-9b47-4961-acee-684195690598
13952024-06-25T22:10:23.070ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_090cab3e-c3ab-4330-b9c9-1127a32f39f2") failed: Property not found. retry in 587.994738ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_090cab3e-c3ab-4330-b9c9-1127a32f39f2
13962024-06-25T22:10:23.475ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_211fbf99-1061-4acf-8e74-43eed5e3a08d") failed: Property not found. retry in 1.032112876s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_211fbf99-1061-4acf-8e74-43eed5e3a08d
13972024-06-25T22:10:23.683ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_090cab3e-c3ab-4330-b9c9-1127a32f39f2") failed: Property not found. retry in 1.148569441s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_090cab3e-c3ab-4330-b9c9-1127a32f39f2
13982024-06-25T22:10:24.036ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1767227d-844e-45e4-9835-24fb7251a22f") failed: Property not found. retry in 1.377789275s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1767227d-844e-45e4-9835-24fb7251a22f
13992024-06-25T22:10:24.164ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_63818da9-9b47-4961-acee-684195690598") failed: Property not found. retry in 1.111957127s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_63818da9-9b47-4961-acee-684195690598
14002024-06-25T22:10:24.514ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_e3a931fa-0dc4-4413-acff-07a88fa4b22f") failed: Property not found. retry in 574.346619ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_e3a931fa-0dc4-4413-acff-07a88fa4b22f
14012024-06-25T22:10:24.535ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_211fbf99-1061-4acf-8e74-43eed5e3a08d") failed: Property not found. retry in 591.057197ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_211fbf99-1061-4acf-8e74-43eed5e3a08d
14022024-06-25T22:10:24.851ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_090cab3e-c3ab-4330-b9c9-1127a32f39f2") failed: Property not found. retry in 1.296638938s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_090cab3e-c3ab-4330-b9c9-1127a32f39f2
14032024-06-25T22:10:25.103ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_e3a931fa-0dc4-4413-acff-07a88fa4b22f") failed: Property not found. retry in 1.419960095s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_e3a931fa-0dc4-4413-acff-07a88fa4b22f
14042024-06-25T22:10:25.143ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_211fbf99-1061-4acf-8e74-43eed5e3a08d") failed: Property not found. retry in 1.1150278s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_211fbf99-1061-4acf-8e74-43eed5e3a08d
14052024-06-25T22:10:25.288ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_63818da9-9b47-4961-acee-684195690598") failed: Property not found. retry in 838.172519ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_63818da9-9b47-4961-acee-684195690598
14062024-06-25T22:10:25.427ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1767227d-844e-45e4-9835-24fb7251a22f") failed: Property not found. retry in 1.28352569s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1767227d-844e-45e4-9835-24fb7251a22f
14072024-06-25T22:10:26.207ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:61045
14082024-06-25T22:10:26.208ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 707 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:61045 req_id = 5c0ade57-f946-45e5-8984-ee2714a2cea6 response_code = 200 uri = /baseboard
14092024-06-25T22:10:26.738ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2956 zone = oxz_nexus_211fbf99-1061-4acf-8e74-43eed5e3a08d
14102024-06-25T22:10:26.738ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2956 zone = oxz_crucible_pantry_daf287cf-2ef4-4650-8e49-7ff4d72bac03
14112024-06-25T22:10:26.738ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2956 zone = oxz_crucible_39414697-c0fa-4175-9995-5ce327f254cb
14122024-06-25T22:10:26.738ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2956 zone = oxz_crucible_d63f510d-32cb-47e8-bcbc-0fedff2f6b57
14132024-06-25T22:10:26.738ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2956 zone = oxz_crucible_09790c06-6bd6-40de-90d1-ccdaeb06d637
14142024-06-25T22:10:26.738ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2956 zone = oxz_external_dns_b8926782-287c-4933-bfeb-32cf3be7f706
14152024-06-25T22:10:26.738ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2956 zone = oxz_crucible_pantry_ec8d60b8-1950-4791-b741-b3377213babd
14162024-06-25T22:10:26.738ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2956 zone = oxz_crucible_a9f63144-1150-4d68-bbd0-474799934844
14172024-06-25T22:10:26.738ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2956 zone = oxz_oximeter_57d2d09d-5105-45b1-928c-c7148eba9fbb
14182024-06-25T22:10:26.738ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2956 zone = oxz_crucible_489d3d8d-d211-4e20-b108-a0ff7b3a7978
14192024-06-25T22:10:26.738ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2956 zone = oxz_crucible_c1b69c41-cc2f-4b1c-aa33-864a47332b73
14202024-06-25T22:10:26.738ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2956 zone = oxz_crucible_93169012-721e-458e-8264-ae8f477750e9
14212024-06-25T22:10:26.738ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2956 zone = oxz_nexus_63818da9-9b47-4961-acee-684195690598
14222024-06-25T22:10:26.738ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2956 zone = oxz_clickhouse_e3a931fa-0dc4-4413-acff-07a88fa4b22f
14232024-06-25T22:10:26.738ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2956 zone = oxz_crucible_pantry_e76e124b-7516-4909-90c2-5e334a704c61
14242024-06-25T22:10:26.738ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2956 zone = oxz_crucible_31025c13-8a1b-4681-a5f3-5f5002b54c1e
14252024-06-25T22:10:26.738ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2956 zone = oxz_crucible_bae337bd-17bd-4f85-95ae-43ef570b4825
14262024-06-25T22:10:26.738ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2956 zone = oxz_external_dns_090cab3e-c3ab-4330-b9c9-1127a32f39f2
14272024-06-25T22:10:26.738ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2956 zone = oxz_nexus_1767227d-844e-45e4-9835-24fb7251a22f
14282024-06-25T22:10:26.745ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/c1b4be1d-f4e3-4e74-a94a-e989f58db5ee/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
14292024-06-25T22:10:26.746ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/d56b00ad-a3b5-4f85-a7d9-5f806111674c/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
14302024-06-25T22:10:26.748ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 41076966 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:55920 req_id = d11f9196-09ec-4a1c-bf98-4d814c16242d response_code = 204 uri = /omicron-zones
14312024-06-25T22:10:26.756ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1244
14322024-06-25T22:10:26.756ZINFOSledAgent (RSS): Writing ledger to /pool/int/c1b4be1d-f4e3-4e74-a94a-e989f58db5ee/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
14332024-06-25T22:10:26.757ZINFOSledAgent (RSS): Writing ledger to /pool/int/d56b00ad-a3b5-4f85-a7d9-5f806111674c/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
14342024-06-25T22:10:26.760ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:681
14352024-06-25T22:10:26.764ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::c]:12221 file = sled-agent/src/rack_setup/service.rs:694
14362024-06-25T22:10:26.798ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, vlan_id: None, }, ], switch: Switch0, uplink_port_fec: None, uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:825
14372024-06-25T22:10:26.966ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/12e1b358-d02a-47e8-a15a-e969cbfdb178/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:887
14382024-06-25T22:10:27.111ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/12e1b358-d02a-47e8-a15a-e969cbfdb178/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:887
14392024-06-25T22:10:27.173ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/12e1b358-d02a-47e8-a15a-e969cbfdb178/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:887
14402024-06-25T22:10:27.260ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/12e1b358-d02a-47e8-a15a-e969cbfdb178/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:887
14412024-06-25T22:10:27.509ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/12e1b358-d02a-47e8-a15a-e969cbfdb178/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:887
14422024-06-25T22:10:27.739ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/12e1b358-d02a-47e8-a15a-e969cbfdb178/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:887
14432024-06-25T22:10:28.051ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/12e1b358-d02a-47e8-a15a-e969cbfdb178/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:887
14442024-06-25T22:10:28.420ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/12e1b358-d02a-47e8-a15a-e969cbfdb178/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:887
14452024-06-25T22:10:28.721ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/12e1b358-d02a-47e8-a15a-e969cbfdb178/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:887
14462024-06-25T22:10:29.363ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/12e1b358-d02a-47e8-a15a-e969cbfdb178/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:887
14472024-06-25T22:10:29.770ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/12e1b358-d02a-47e8-a15a-e969cbfdb178/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:887
14482024-06-25T22:10:30.550ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/12e1b358-d02a-47e8-a15a-e969cbfdb178/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:887
14492024-06-25T22:10:31.072ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/98068951-ddeb-40ca-9677-d05b350bbf94): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/probe_manager.rs:169 sled_id = 98068951-ddeb-40ca-9677-d05b350bbf94
14502024-06-25T22:10:31.446ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/12e1b358-d02a-47e8-a15a-e969cbfdb178/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:887
14512024-06-25T22:10:31.959ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/12e1b358-d02a-47e8-a15a-e969cbfdb178/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:887
14522024-06-25T22:10:32.050ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/98068951-ddeb-40ca-9677-d05b350bbf94): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/nexus.rs:619 sled_id = 98068951-ddeb-40ca-9677-d05b350bbf94
14532024-06-25T22:10:32.077ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/98068951-ddeb-40ca-9677-d05b350bbf94): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/probe_manager.rs:169 sled_id = 98068951-ddeb-40ca-9677-d05b350bbf94
14542024-06-25T22:10:32.756ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/98068951-ddeb-40ca-9677-d05b350bbf94): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/nexus.rs:619 sled_id = 98068951-ddeb-40ca-9677-d05b350bbf94
14552024-06-25T22:10:32.904ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/12e1b358-d02a-47e8-a15a-e969cbfdb178/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:887
14562024-06-25T22:10:33.080ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/98068951-ddeb-40ca-9677-d05b350bbf94): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/probe_manager.rs:169 sled_id = 98068951-ddeb-40ca-9677-d05b350bbf94
14572024-06-25T22:10:34.084ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/98068951-ddeb-40ca-9677-d05b350bbf94): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/probe_manager.rs:169 sled_id = 98068951-ddeb-40ca-9677-d05b350bbf94
14582024-06-25T22:10:34.647ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/12e1b358-d02a-47e8-a15a-e969cbfdb178/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:887
14592024-06-25T22:10:34.756ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/98068951-ddeb-40ca-9677-d05b350bbf94): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/nexus.rs:619 sled_id = 98068951-ddeb-40ca-9677-d05b350bbf94
14602024-06-25T22:10:35.087ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/98068951-ddeb-40ca-9677-d05b350bbf94): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/probe_manager.rs:169 sled_id = 98068951-ddeb-40ca-9677-d05b350bbf94
14612024-06-25T22:10:36.091ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/98068951-ddeb-40ca-9677-d05b350bbf94): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/probe_manager.rs:169 sled_id = 98068951-ddeb-40ca-9677-d05b350bbf94
14622024-06-25T22:10:36.959ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "a1904be4-6d96-4430-9ea6-cc500a353af5", "content-length": "173", "date": "Tue, 25 Jun 2024 22:10:36 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"12e1b358-d02a-47e8-a15a-e969cbfdb178\"", request_id: "a1904be4-6d96-4430-9ea6-cc500a353af5" } file = sled-agent/src/rack_setup/service.rs:887
14632024-06-25T22:10:38.780ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:592 new_generation = 1 old_generation = 1 sled_id = 98068951-ddeb-40ca-9677-d05b350bbf94
14642024-06-25T22:10:39.070ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53798
14652024-06-25T22:10:39.070ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
14662024-06-25T22:10:39.156ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 86524 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53798 req_id = ac2ccdbe-cfd7-433c-b781-03fd6b9ad679 response_code = 200 uri = /inventory
14672024-06-25T22:10:39.157ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
14682024-06-25T22:10:39.157ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/c1b4be1d-f4e3-4e74-a94a-e989f58db5ee/config/omicron-zones.json file = common/src/ledger.rs:177
14692024-06-25T22:10:39.162ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/d56b00ad-a3b5-4f85-a7d9-5f806111674c/config/omicron-zones.json file = common/src/ledger.rs:177
14702024-06-25T22:10:39.162ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 6064 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53798 req_id = 012c92d0-6b62-49bd-9b94-74ddb7e93ab5 response_code = 200 uri = /omicron-zones
14712024-06-25T22:10:39.175ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36812
14722024-06-25T22:10:39.179ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:524 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0e5c0224-5418-43a7-a584-d49561dc9b2f, kind: Service { id: b8926782-287c-4933-bfeb-32cf3be7f706 }, name: Name("external-dns-b8926782-287c-4933-bfeb-32cf3be7f706"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 163, 72])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 9112163e-3dcb-4580-845f-2c99d0c20231, kind: Service { id: 090cab3e-c3ab-4330-b9c9-1127a32f39f2 }, name: Name("external-dns-090cab3e-c3ab-4330-b9c9-1127a32f39f2"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 159, 39])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 94ed2baf-348c-4487-85a2-b16ce8ce33a8, kind: Service { id: 1767227d-844e-45e4-9835-24fb7251a22f }, name: Name("nexus-1767227d-844e-45e4-9835-24fb7251a22f"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 234, 65])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: c3eb96b1-13ec-4977-b5bb-24ab91071404, kind: Service { id: 211fbf99-1061-4acf-8e74-43eed5e3a08d }, name: Name("nexus-211fbf99-1061-4acf-8e74-43eed5e3a08d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 135, 241])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: f408d23f-8ca5-4b0c-ab98-3078caa08f15, kind: Service { id: 63818da9-9b47-4961-acee-684195690598 }, name: Name("nexus-63818da9-9b47-4961-acee-684195690598"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 0])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
14732024-06-25T22:10:39.179ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
14742024-06-25T22:10:39.179ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte0" rules = []
14752024-06-25T22:10:39.179ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
14762024-06-25T22:10:39.179ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
14772024-06-25T22:10:39.179ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
14782024-06-25T22:10:39.179ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
14792024-06-25T22:10:39.179ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 4382 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36812 req_id = 2b3db55f-55a0-452d-891d-79bfcd703a95 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
14802024-06-25T22:10:39.181ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:897
14812024-06-25T22:10:39.521ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55696
14822024-06-25T22:10:39.521ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
14832024-06-25T22:10:39.602ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 80611 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55696 req_id = 064fddde-a03d-4d29-9a7a-4cb607e6913c response_code = 200 uri = /inventory
14842024-06-25T22:10:39.602ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
14852024-06-25T22:10:39.602ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/c1b4be1d-f4e3-4e74-a94a-e989f58db5ee/config/omicron-zones.json file = common/src/ledger.rs:177
14862024-06-25T22:10:39.603ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/d56b00ad-a3b5-4f85-a7d9-5f806111674c/config/omicron-zones.json file = common/src/ledger.rs:177
14872024-06-25T22:10:39.603ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 936 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55696 req_id = cc18d570-bb93-4c63-8b1a-52c91421cf66 response_code = 200 uri = /omicron-zones
14882024-06-25T22:10:40.734ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54648
14892024-06-25T22:10:40.734ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:524 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0e5c0224-5418-43a7-a584-d49561dc9b2f, kind: Service { id: b8926782-287c-4933-bfeb-32cf3be7f706 }, name: Name("external-dns-b8926782-287c-4933-bfeb-32cf3be7f706"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 163, 72])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 9112163e-3dcb-4580-845f-2c99d0c20231, kind: Service { id: 090cab3e-c3ab-4330-b9c9-1127a32f39f2 }, name: Name("external-dns-090cab3e-c3ab-4330-b9c9-1127a32f39f2"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 159, 39])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 94ed2baf-348c-4487-85a2-b16ce8ce33a8, kind: Service { id: 1767227d-844e-45e4-9835-24fb7251a22f }, name: Name("nexus-1767227d-844e-45e4-9835-24fb7251a22f"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 234, 65])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: c3eb96b1-13ec-4977-b5bb-24ab91071404, kind: Service { id: 211fbf99-1061-4acf-8e74-43eed5e3a08d }, name: Name("nexus-211fbf99-1061-4acf-8e74-43eed5e3a08d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 135, 241])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: f408d23f-8ca5-4b0c-ab98-3078caa08f15, kind: Service { id: 63818da9-9b47-4961-acee-684195690598 }, name: Name("nexus-63818da9-9b47-4961-acee-684195690598"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 0])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
14902024-06-25T22:10:40.734ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
14912024-06-25T22:10:40.735ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte0" rules = []
14922024-06-25T22:10:40.735ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
14932024-06-25T22:10:40.735ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
14942024-06-25T22:10:40.735ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
14952024-06-25T22:10:40.735ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
14962024-06-25T22:10:40.735ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 662 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54648 req_id = ecf5d7c3-301d-40dc-90ac-6ebff5b5ff45 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
14972024-06-25T22:10:40.735ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59712
14982024-06-25T22:10:40.735ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:524 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0e5c0224-5418-43a7-a584-d49561dc9b2f, kind: Service { id: b8926782-287c-4933-bfeb-32cf3be7f706 }, name: Name("external-dns-b8926782-287c-4933-bfeb-32cf3be7f706"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 163, 72])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 9112163e-3dcb-4580-845f-2c99d0c20231, kind: Service { id: 090cab3e-c3ab-4330-b9c9-1127a32f39f2 }, name: Name("external-dns-090cab3e-c3ab-4330-b9c9-1127a32f39f2"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 159, 39])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 94ed2baf-348c-4487-85a2-b16ce8ce33a8, kind: Service { id: 1767227d-844e-45e4-9835-24fb7251a22f }, name: Name("nexus-1767227d-844e-45e4-9835-24fb7251a22f"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 234, 65])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: c3eb96b1-13ec-4977-b5bb-24ab91071404, kind: Service { id: 211fbf99-1061-4acf-8e74-43eed5e3a08d }, name: Name("nexus-211fbf99-1061-4acf-8e74-43eed5e3a08d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 135, 241])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: f408d23f-8ca5-4b0c-ab98-3078caa08f15, kind: Service { id: 63818da9-9b47-4961-acee-684195690598 }, name: Name("nexus-63818da9-9b47-4961-acee-684195690598"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 0])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
14992024-06-25T22:10:40.735ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15002024-06-25T22:10:40.735ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte0" rules = []
15012024-06-25T22:10:40.735ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15022024-06-25T22:10:40.735ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15032024-06-25T22:10:40.735ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15042024-06-25T22:10:40.735ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15052024-06-25T22:10:40.735ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59712 req_id = f2406550-17f8-475d-9b7d-985b85260000 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
15062024-06-25T22:10:40.811ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35500
15072024-06-25T22:10:40.811ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:524 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0e5c0224-5418-43a7-a584-d49561dc9b2f, kind: Service { id: b8926782-287c-4933-bfeb-32cf3be7f706 }, name: Name("external-dns-b8926782-287c-4933-bfeb-32cf3be7f706"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 163, 72])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 9112163e-3dcb-4580-845f-2c99d0c20231, kind: Service { id: 090cab3e-c3ab-4330-b9c9-1127a32f39f2 }, name: Name("external-dns-090cab3e-c3ab-4330-b9c9-1127a32f39f2"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 159, 39])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 94ed2baf-348c-4487-85a2-b16ce8ce33a8, kind: Service { id: 1767227d-844e-45e4-9835-24fb7251a22f }, name: Name("nexus-1767227d-844e-45e4-9835-24fb7251a22f"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 234, 65])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: c3eb96b1-13ec-4977-b5bb-24ab91071404, kind: Service { id: 211fbf99-1061-4acf-8e74-43eed5e3a08d }, name: Name("nexus-211fbf99-1061-4acf-8e74-43eed5e3a08d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 135, 241])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: f408d23f-8ca5-4b0c-ab98-3078caa08f15, kind: Service { id: 63818da9-9b47-4961-acee-684195690598 }, name: Name("nexus-63818da9-9b47-4961-acee-684195690598"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 0])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
15082024-06-25T22:10:40.811ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15092024-06-25T22:10:40.811ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte0" rules = []
15102024-06-25T22:10:40.811ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15112024-06-25T22:10:40.811ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15122024-06-25T22:10:40.811ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15132024-06-25T22:10:40.811ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15142024-06-25T22:10:40.811ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 235 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35500 req_id = 7cbbcd18-0f4b-4877-a9d0-dcdcfa13a0e2 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
15152024-06-25T22:10:56.243ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:64652
15162024-06-25T22:10:56.243ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 36 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:64652 req_id = d06255cd-2598-402e-90d5-b69b28af2a4c response_code = 200 uri = /baseboard
15172024-06-25T22:11:06.561ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56236
15182024-06-25T22:11:06.561ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56236 req_id = eb7a3ffe-a787-407a-816f-631ff642992e response_code = 200 uri = /v2p
15192024-06-25T22:11:06.656ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40094
15202024-06-25T22:11:06.657ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 811 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40094 req_id = b2a02455-d578-4378-a39b-f7b68848c36c response_code = 200 uri = /v2p
15212024-06-25T22:11:06.662ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55871
15222024-06-25T22:11:06.663ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55871 req_id = 85c8e31c-a7a1-4570-a703-58935682b672 response_code = 200 uri = /v2p
15232024-06-25T22:11:06.684ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60625
15242024-06-25T22:11:06.776ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 91495 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:60625 req_id = 508d1517-49a9-4c16-8153-52520555e92a response_code = 204 uri = /switch-ports
15252024-06-25T22:11:06.776ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55799
15262024-06-25T22:11:06.776ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47810
15272024-06-25T22:11:06.781ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1303 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60625 req_id = 6700c694-97c9-4c71-af0f-f00fa2c31e0c response_code = 200 uri = /network-bootstore-config
15282024-06-25T22:11:06.807ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
15292024-06-25T22:11:06.808ZINFOSledAgent (bootstore): Writing ledger to /pool/int/c1b4be1d-f4e3-4e74-a94a-e989f58db5ee/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
15302024-06-25T22:11:06.809ZINFOSledAgent (bootstore): Writing ledger to /pool/int/d56b00ad-a3b5-4f85-a7d9-5f806111674c/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
15312024-06-25T22:11:06.809ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
15322024-06-25T22:11:06.809ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 6078 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60625 req_id = 9023daa8-8279-49e7-9b36-97369d261971 response_code = 204 uri = /network-bootstore-config
15332024-06-25T22:11:06.831ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 54964 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:55799 req_id = 854878fe-62f2-413f-b239-c2e5a2be2808 response_code = 204 uri = /switch-ports
15342024-06-25T22:11:06.835ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 573 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55799 req_id = fcc90844-ea4c-4bae-aea0-84b2f4e7ff82 response_code = 200 uri = /network-bootstore-config
15352024-06-25T22:11:06.880ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 104103 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:47810 req_id = 36c13fec-024d-49d8-a622-d651ec10973b response_code = 204 uri = /switch-ports
15362024-06-25T22:11:06.882ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47810 req_id = e5f8cc55-61c8-4930-8bf9-8f6ac36da02e response_code = 200 uri = /network-bootstore-config
15372024-06-25T22:11:26.278ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58609
15382024-06-25T22:11:26.278ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 40 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58609 req_id = c55693b8-2291-407f-b32c-364c62bb4d8a response_code = 200 uri = /baseboard
15392024-06-25T22:11:36.596ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48155
15402024-06-25T22:11:36.596ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48155 req_id = 1a3b4d6d-4250-4e32-8fcc-c976655861b2 response_code = 200 uri = /v2p
15412024-06-25T22:11:36.615ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34275
15422024-06-25T22:11:36.615ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34275 req_id = afedd5a3-0a18-4e95-a4be-db776027ee68 response_code = 200 uri = /v2p
15432024-06-25T22:11:36.719ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41457
15442024-06-25T22:11:36.719ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41457 req_id = 40cea167-22c5-4028-ad6d-ee015831f188 response_code = 200 uri = /v2p
15452024-06-25T22:11:36.816ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43716
15462024-06-25T22:11:36.859ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 42723 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:43716 req_id = e0b1b510-37dd-4638-b0f4-f71140c03c8d response_code = 204 uri = /switch-ports
15472024-06-25T22:11:36.859ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43716 req_id = 15f3ef6f-c0f5-4e65-989b-4b47da7b897c response_code = 200 uri = /network-bootstore-config
15482024-06-25T22:11:36.930ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51631
15492024-06-25T22:11:36.978ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 47538 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:51631 req_id = 34a1f6da-29ec-4537-95b0-2e55080deb96 response_code = 204 uri = /switch-ports
15502024-06-25T22:11:36.978ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51631 req_id = 853a810a-a773-4d7c-9c68-05c0c529f5f2 response_code = 200 uri = /network-bootstore-config
15512024-06-25T22:11:36.980ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34232
15522024-06-25T22:11:37.023ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 43069 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:34232 req_id = ae180abf-afc8-49c8-9e22-04e5d595011f response_code = 204 uri = /switch-ports
15532024-06-25T22:11:37.024ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 793 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34232 req_id = 77389af4-7f55-4069-aafa-bbeb8b8a2393 response_code = 200 uri = /network-bootstore-config
15542024-06-25T22:11:56.310ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54466
15552024-06-25T22:11:56.310ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 44 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54466 req_id = 96dc45b7-ee27-4036-81f8-a3b28ca2b112 response_code = 200 uri = /baseboard
15562024-06-25T22:12:06.504ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:32925
15572024-06-25T22:12:06.505ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1076 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:32925 req_id = 48ba664d-f213-45a3-8e6d-da7ebd37856c response_code = 200 uri = /v2p
15582024-06-25T22:12:06.526ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61271
15592024-06-25T22:12:06.526ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61271 req_id = aa17904b-40b1-4c7f-8fb5-f3adf49a7823 response_code = 200 uri = /v2p
15602024-06-25T22:12:06.579ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40291
15612024-06-25T22:12:06.579ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40291 req_id = 5a16cd97-6ff5-479b-a777-ce77ce51b8bc response_code = 200 uri = /v2p
15622024-06-25T22:12:06.599ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37107
15632024-06-25T22:12:06.648ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 49421 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:37107 req_id = 5ecd7d91-30c7-4ec6-bb5c-0baf9748986c response_code = 204 uri = /switch-ports
15642024-06-25T22:12:06.649ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38933
15652024-06-25T22:12:06.649ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64597
15662024-06-25T22:12:06.653ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 4249 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37107 req_id = fedb1603-b951-40e7-a938-24820d7f8a36 response_code = 200 uri = /network-bootstore-config
15672024-06-25T22:12:06.694ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 45668 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:38933 req_id = 47d4670f-2e7e-47c2-9357-61d19ec596e6 response_code = 204 uri = /switch-ports
15682024-06-25T22:12:06.698ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 619 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38933 req_id = 2f90bebb-f50d-49dd-aff8-fddd6691ad0f response_code = 200 uri = /network-bootstore-config
15692024-06-25T22:12:06.743ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 94251 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:64597 req_id = 78a7e460-72cc-4f63-b2b2-093db5562cb6 response_code = 204 uri = /switch-ports
15702024-06-25T22:12:06.744ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 750 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64597 req_id = 434d2d31-ad5b-4096-aa4a-17178bea3c2d response_code = 200 uri = /network-bootstore-config
15712024-06-25T22:12:26.342ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:47841
15722024-06-25T22:12:26.343ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 921 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:47841 req_id = 865bbcbf-a08e-4555-ba89-9b1930f88a54 response_code = 200 uri = /baseboard
15732024-06-25T22:12:36.582ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44480
15742024-06-25T22:12:36.583ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44480 req_id = 050a7005-58bf-4e61-83d2-3b12d9b228d4 response_code = 200 uri = /v2p
15752024-06-25T22:12:36.626ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46667
15762024-06-25T22:12:36.626ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46667 req_id = 442d38ff-cd7d-4a15-a698-a2ecd8966182 response_code = 200 uri = /v2p
15772024-06-25T22:12:36.663ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65267
15782024-06-25T22:12:36.664ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65267 req_id = 930a1a4a-710c-4dca-9ff9-81d70e0a3914 response_code = 200 uri = /v2p
15792024-06-25T22:12:36.791ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52552
15802024-06-25T22:12:36.838ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 47015 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:52552 req_id = 6259e6ed-21aa-492a-9aef-00058611f066 response_code = 204 uri = /switch-ports
15812024-06-25T22:12:36.838ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38582
15822024-06-25T22:12:36.838ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33343
15832024-06-25T22:12:36.843ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 3762 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52552 req_id = 19052ce4-8be0-4601-8cf3-23d66189dc9a response_code = 200 uri = /network-bootstore-config
15842024-06-25T22:12:36.883ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 43891 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:38582 req_id = f875d059-c923-4065-84be-851334778b4b response_code = 204 uri = /switch-ports
15852024-06-25T22:12:36.885ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 528 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38582 req_id = e986feb9-c86f-4447-a77e-a4b6820110d7 response_code = 200 uri = /network-bootstore-config
15862024-06-25T22:12:36.926ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 87360 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:33343 req_id = 6f83757b-6507-47d0-8898-24961f37fc72 response_code = 204 uri = /switch-ports
15872024-06-25T22:12:36.927ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 698 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33343 req_id = e03db2f2-4c51-4a9a-9ad9-f63b03033e4d response_code = 200 uri = /network-bootstore-config
15882024-06-25T22:12:43.033ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:35461 remote_addr = [fd00:1122:3344:101::d]:58983 sled_id = 98068951-ddeb-40ca-9677-d05b350bbf94
15892024-06-25T22:12:43.053ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 19339 local_addr = [fd00:1122:3344:101::1]:35461 method = GET remote_addr = [fd00:1122:3344:101::d]:58983 req_id = 73924dcc-d7e6-47f9-8a90-aa30bd01771b response_code = 200 sled_id = 98068951-ddeb-40ca-9677-d05b350bbf94 uri = /98068951-ddeb-40ca-9677-d05b350bbf94
15902024-06-25T22:12:56.376ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:51683
15912024-06-25T22:12:56.376ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 43 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:51683 req_id = 0cd11439-019a-43ea-a4c3-b61a2eabab43 response_code = 200 uri = /baseboard
15922024-06-25T22:13:06.443ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62607
15932024-06-25T22:13:06.443ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 186 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62607 req_id = 079132c4-cb90-45f9-b54d-0c8000cf3c8c response_code = 200 uri = /v2p
15942024-06-25T22:13:06.505ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41918
15952024-06-25T22:13:06.505ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41918 req_id = 78449f40-1690-4260-90c6-8ccd887467d1 response_code = 200 uri = /v2p
15962024-06-25T22:13:06.631ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60709
15972024-06-25T22:13:06.679ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 48376 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:60709 req_id = 2d71cef8-11e9-4e3f-96a1-85395a085f63 response_code = 204 uri = /switch-ports
15982024-06-25T22:13:06.679ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35563
15992024-06-25T22:13:06.682ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 3140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60709 req_id = aad057d9-8390-4758-83b2-fc665c206185 response_code = 200 uri = /network-bootstore-config
16002024-06-25T22:13:06.707ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36002
16012024-06-25T22:13:06.708ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36002 req_id = c3aec2c6-6d5f-4fb5-8028-cde2e8f4dc4b response_code = 200 uri = /v2p
16022024-06-25T22:13:06.722ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 43124 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:35563 req_id = 7dbe4f18-5ef0-48f1-9dc0-081489b40bee response_code = 204 uri = /switch-ports
16032024-06-25T22:13:06.723ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35563 req_id = fd3891b0-d622-42e7-b516-4908976a8aa8 response_code = 200 uri = /network-bootstore-config
16042024-06-25T22:13:06.839ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45009
16052024-06-25T22:13:06.885ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 46554 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:45009 req_id = 274a7280-a53f-4337-88d8-cf411cbbe025 response_code = 204 uri = /switch-ports
16062024-06-25T22:13:06.886ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45009 req_id = 9b939bf4-1e9a-4cb8-83e1-b0071ef50e3b response_code = 200 uri = /network-bootstore-config
16072024-06-25T22:13:13.036ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1793 local_addr = [fd00:1122:3344:101::1]:35461 method = GET remote_addr = [fd00:1122:3344:101::d]:58983 req_id = 673190f3-a0b1-4e84-bfb1-2ef8e316ff4d response_code = 200 sled_id = 98068951-ddeb-40ca-9677-d05b350bbf94 uri = /98068951-ddeb-40ca-9677-d05b350bbf94
16082024-06-25T22:13:26.410ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:65146
16092024-06-25T22:13:26.410ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 42 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:65146 req_id = 087fe517-6a99-46f4-b2f6-073eac522c33 response_code = 200 uri = /baseboard
16102024-06-25T22:13:36.522ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33167
16112024-06-25T22:13:36.523ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1395 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33167 req_id = a3fdf980-d89d-458f-992f-a29acd9b4d07 response_code = 200 uri = /v2p
16122024-06-25T22:13:36.575ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35017
16132024-06-25T22:13:36.575ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35017 req_id = c3d03071-dfbd-4578-b6a7-ce9408efd9a5 response_code = 200 uri = /v2p
16142024-06-25T22:13:36.707ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51235
16152024-06-25T22:13:36.707ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51235 req_id = c112349a-2280-462a-a08a-3095aa16f626 response_code = 200 uri = /v2p
16162024-06-25T22:13:36.810ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62821
16172024-06-25T22:13:36.855ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 45532 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:62821 req_id = 9cd00e4f-7c10-4efe-8723-530825ddb57d response_code = 204 uri = /switch-ports
16182024-06-25T22:13:36.855ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39142
16192024-06-25T22:13:36.855ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41780
16202024-06-25T22:13:36.859ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 3715 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62821 req_id = 968ce9f4-e296-4aa6-80b8-3f51fff280b0 response_code = 200 uri = /network-bootstore-config
16212024-06-25T22:13:36.901ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 45313 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:39142 req_id = d8e5e0ae-1696-4be8-aacf-41f5d947f235 response_code = 204 uri = /switch-ports
16222024-06-25T22:13:36.905ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 237 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39142 req_id = 7e1af61a-d037-4f40-aa4f-c3ef90989092 response_code = 200 uri = /network-bootstore-config
16232024-06-25T22:13:36.946ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 89801 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:41780 req_id = 4b44fef5-0f7c-4a22-bece-8455b2f478a3 response_code = 204 uri = /switch-ports
16242024-06-25T22:13:36.946ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41780 req_id = 1a47a423-4e1b-494f-a2fb-35d02c035431 response_code = 200 uri = /network-bootstore-config
16252024-06-25T22:13:43.033ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 566 local_addr = [fd00:1122:3344:101::1]:35461 method = GET remote_addr = [fd00:1122:3344:101::d]:58983 req_id = a4e7869c-aa92-4367-b0e1-4c9b211ebf2d response_code = 200 sled_id = 98068951-ddeb-40ca-9677-d05b350bbf94 uri = /98068951-ddeb-40ca-9677-d05b350bbf94
16262024-06-25T22:13:56.444ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38905
16272024-06-25T22:13:56.445ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 98 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38905 req_id = 25629c97-1242-43a6-8d5f-e2f8d25e44fd response_code = 200 uri = /baseboard
16282024-06-25T22:14:06.431ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42661
16292024-06-25T22:14:06.431ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42661 req_id = e75d90e8-12f8-4299-8799-d63fe669fd5e response_code = 200 uri = /v2p
16302024-06-25T22:14:06.455ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34539
16312024-06-25T22:14:06.455ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34539 req_id = 54f69676-7c61-45a5-abc8-9f9d09f67142 response_code = 200 uri = /v2p
16322024-06-25T22:14:06.579ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45229
16332024-06-25T22:14:06.625ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 45396 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:45229 req_id = 800c15a6-8557-4036-97f6-8e231b9a059a response_code = 204 uri = /switch-ports
16342024-06-25T22:14:06.625ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50487
16352024-06-25T22:14:06.628ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 2678 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45229 req_id = 8bc6c82e-2dc0-455c-9d65-f23f1b398637 response_code = 200 uri = /network-bootstore-config
16362024-06-25T22:14:06.629ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63068
16372024-06-25T22:14:06.630ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63068 req_id = 146d41cc-b9c9-4601-8709-78ad2622128d response_code = 200 uri = /v2p
16382024-06-25T22:14:06.671ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 46541 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:50487 req_id = 7d8f2c3d-d9f3-4c3f-ac4b-26343692c4f9 response_code = 204 uri = /switch-ports
16392024-06-25T22:14:06.672ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 781 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50487 req_id = 4e5d2a12-83d0-4d63-a37c-684e78c3804e response_code = 200 uri = /network-bootstore-config
16402024-06-25T22:14:06.720ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65375
16412024-06-25T22:14:06.765ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 45381 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:65375 req_id = fe820355-11b5-4c1b-8621-fb18e1335bd5 response_code = 204 uri = /switch-ports
16422024-06-25T22:14:06.766ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65375 req_id = fd78107b-91a8-40b3-b457-c3e4e643abdf response_code = 200 uri = /network-bootstore-config
16432024-06-25T22:14:13.035ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1082 local_addr = [fd00:1122:3344:101::1]:35461 method = GET remote_addr = [fd00:1122:3344:101::d]:58983 req_id = e9832dc3-07b3-4149-89d0-971b298b885d response_code = 200 sled_id = 98068951-ddeb-40ca-9677-d05b350bbf94 uri = /98068951-ddeb-40ca-9677-d05b350bbf94
16442024-06-25T22:14:26.477ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36317
16452024-06-25T22:14:26.477ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 58 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36317 req_id = 38b6ded9-32aa-4eb3-97d1-43b5408911f7 response_code = 200 uri = /baseboard
16462024-06-25T22:14:30.099ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:300
16472024-06-25T22:14:30.099ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
16482024-06-25T22:14:30.142ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:289 next_cleanup = Instant { tv_sec: 1806, tv_nsec: 31152955 } time_to_next_cleanup = 599.99999687s
16492024-06-25T22:14:36.537ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59182
16502024-06-25T22:14:36.538ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59182 req_id = 8dd11be4-5c50-4651-8818-f17556b406c5 response_code = 200 uri = /v2p
16512024-06-25T22:14:36.540ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64346
16522024-06-25T22:14:36.540ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64346 req_id = 6b4f6d3a-6a57-4483-860d-d02ca3f5689b response_code = 200 uri = /v2p
16532024-06-25T22:14:36.644ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45420
16542024-06-25T22:14:36.644ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45420 req_id = ebae161f-cf5d-4c59-9c3d-e28e32e424f7 response_code = 200 uri = /v2p
16552024-06-25T22:14:36.760ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59824
16562024-06-25T22:14:36.822ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 62113 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:59824 req_id = daffa676-93dd-4dfa-9805-9a878c1b2491 response_code = 204 uri = /switch-ports
16572024-06-25T22:14:36.823ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59824 req_id = 27810f06-da7c-4ccc-ab3d-c1e8ae15194f response_code = 200 uri = /network-bootstore-config
16582024-06-25T22:14:36.873ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35140
16592024-06-25T22:14:36.922ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 48472 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:35140 req_id = 39084fbd-5618-41f4-b87d-4699f74303f0 response_code = 204 uri = /switch-ports
16602024-06-25T22:14:36.922ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45548
16612024-06-25T22:14:36.925ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 3251 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35140 req_id = 6ca7a786-db6a-4507-9eda-5fc13c3886fb response_code = 200 uri = /network-bootstore-config
16622024-06-25T22:14:36.965ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 42684 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:45548 req_id = a1ce7e52-c0c9-411f-b04e-f45b05b28b6e response_code = 204 uri = /switch-ports
16632024-06-25T22:14:36.965ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45548 req_id = d384be7c-c544-4c57-a09d-9379156b36a5 response_code = 200 uri = /network-bootstore-config
16642024-06-25T22:14:43.045ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1054 local_addr = [fd00:1122:3344:101::1]:35461 method = GET remote_addr = [fd00:1122:3344:101::d]:58983 req_id = ea82762d-70ae-4ec6-a99f-2e32be97e24f response_code = 200 sled_id = 98068951-ddeb-40ca-9677-d05b350bbf94 uri = /98068951-ddeb-40ca-9677-d05b350bbf94
16652024-06-25T22:14:45.568ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
16662024-06-25T22:14:56.514ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41152
16672024-06-25T22:14:56.514ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 46 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41152 req_id = ba9002fc-8d4b-45c9-8154-f3b6857fb23c response_code = 200 uri = /baseboard
16682024-06-25T22:15:06.426ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52544
16692024-06-25T22:15:06.427ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1003 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52544 req_id = 518ce2ed-bb90-4dac-a68b-c5f40c2eda74 response_code = 200 uri = /v2p
16702024-06-25T22:15:06.484ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60804
16712024-06-25T22:15:06.484ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60804 req_id = 01e2e1d7-6e46-4345-98a3-15042729f852 response_code = 200 uri = /v2p
16722024-06-25T22:15:06.533ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41583
16732024-06-25T22:15:06.533ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41583 req_id = 2cc21093-0444-41d3-baa6-1b41ed54c26f response_code = 200 uri = /v2p
16742024-06-25T22:15:06.543ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46067
16752024-06-25T22:15:06.589ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 45569 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:46067 req_id = 8c37616c-0003-4be4-b851-5cbb79a57f58 response_code = 204 uri = /switch-ports
16762024-06-25T22:15:06.590ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 850 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46067 req_id = ac19595d-1fad-4dbc-9331-6db0cf281d1b response_code = 200 uri = /network-bootstore-config
16772024-06-25T22:15:06.594ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37754
16782024-06-25T22:15:06.638ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 43925 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:37754 req_id = 7c7afe70-ae30-47a3-a7ef-a16cae0f3c40 response_code = 204 uri = /switch-ports
16792024-06-25T22:15:06.638ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47266
16802024-06-25T22:15:06.641ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 3069 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37754 req_id = dd20e3c8-ae86-4ad3-9cbf-24c533fb7572 response_code = 200 uri = /network-bootstore-config
16812024-06-25T22:15:06.687ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 48441 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:47266 req_id = 511c56cb-0e33-403d-b5bf-bd02825badcc response_code = 204 uri = /switch-ports
16822024-06-25T22:15:06.687ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47266 req_id = a644e7a9-1fcd-4f56-887d-dda5ecaa9db9 response_code = 200 uri = /network-bootstore-config
16832024-06-25T22:15:13.095ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1093 local_addr = [fd00:1122:3344:101::1]:35461 method = GET remote_addr = [fd00:1122:3344:101::d]:58983 req_id = eb86df55-6c8f-4321-b9a3-8ec2eacb136d response_code = 200 sled_id = 98068951-ddeb-40ca-9677-d05b350bbf94 uri = /98068951-ddeb-40ca-9677-d05b350bbf94
16842024-06-25T22:15:26.546ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41024
16852024-06-25T22:15:26.547ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 787 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41024 req_id = 76278c46-1d3b-432a-b1bc-ee7fe64c0c77 response_code = 200 uri = /baseboard
16862024-06-25T22:15:36.552ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40665
16872024-06-25T22:15:36.552ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 203 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40665 req_id = b9698787-5c17-4421-8811-bde7b6a7d85c response_code = 200 uri = /v2p
16882024-06-25T22:15:36.683ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62187
16892024-06-25T22:15:36.684ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:524 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0e5c0224-5418-43a7-a584-d49561dc9b2f, kind: Service { id: b8926782-287c-4933-bfeb-32cf3be7f706 }, name: Name("external-dns-b8926782-287c-4933-bfeb-32cf3be7f706"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 163, 72])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 9112163e-3dcb-4580-845f-2c99d0c20231, kind: Service { id: 090cab3e-c3ab-4330-b9c9-1127a32f39f2 }, name: Name("external-dns-090cab3e-c3ab-4330-b9c9-1127a32f39f2"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 159, 39])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 94ed2baf-348c-4487-85a2-b16ce8ce33a8, kind: Service { id: 1767227d-844e-45e4-9835-24fb7251a22f }, name: Name("nexus-1767227d-844e-45e4-9835-24fb7251a22f"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 234, 65])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: c3eb96b1-13ec-4977-b5bb-24ab91071404, kind: Service { id: 211fbf99-1061-4acf-8e74-43eed5e3a08d }, name: Name("nexus-211fbf99-1061-4acf-8e74-43eed5e3a08d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 135, 241])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: f408d23f-8ca5-4b0c-ab98-3078caa08f15, kind: Service { id: 63818da9-9b47-4961-acee-684195690598 }, name: Name("nexus-63818da9-9b47-4961-acee-684195690598"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 0])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16902024-06-25T22:15:36.684ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16912024-06-25T22:15:36.684ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte0" rules = []
16922024-06-25T22:15:36.684ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16932024-06-25T22:15:36.684ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16942024-06-25T22:15:36.684ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16952024-06-25T22:15:36.684ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16962024-06-25T22:15:36.684ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 272 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62187 req_id = 9c35b41f-a270-42ff-ba9d-ae7d9e8dbdd3 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16972024-06-25T22:15:36.691ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57766
16982024-06-25T22:15:36.691ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57766 req_id = 024e289f-1148-4211-a8c2-def59d89cc1c response_code = 200 uri = /v2p
16992024-06-25T22:15:36.726ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47975
17002024-06-25T22:15:36.726ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47975 req_id = e57548b7-7033-4dc6-9a61-a2313a387957 response_code = 200 uri = /v2p
17012024-06-25T22:15:36.791ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44771
17022024-06-25T22:15:36.791ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:524 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0e5c0224-5418-43a7-a584-d49561dc9b2f, kind: Service { id: b8926782-287c-4933-bfeb-32cf3be7f706 }, name: Name("external-dns-b8926782-287c-4933-bfeb-32cf3be7f706"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 163, 72])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 9112163e-3dcb-4580-845f-2c99d0c20231, kind: Service { id: 090cab3e-c3ab-4330-b9c9-1127a32f39f2 }, name: Name("external-dns-090cab3e-c3ab-4330-b9c9-1127a32f39f2"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 159, 39])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 94ed2baf-348c-4487-85a2-b16ce8ce33a8, kind: Service { id: 1767227d-844e-45e4-9835-24fb7251a22f }, name: Name("nexus-1767227d-844e-45e4-9835-24fb7251a22f"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 234, 65])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: c3eb96b1-13ec-4977-b5bb-24ab91071404, kind: Service { id: 211fbf99-1061-4acf-8e74-43eed5e3a08d }, name: Name("nexus-211fbf99-1061-4acf-8e74-43eed5e3a08d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 135, 241])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: f408d23f-8ca5-4b0c-ab98-3078caa08f15, kind: Service { id: 63818da9-9b47-4961-acee-684195690598 }, name: Name("nexus-63818da9-9b47-4961-acee-684195690598"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 0])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17032024-06-25T22:15:36.791ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17042024-06-25T22:15:36.791ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte0" rules = []
17052024-06-25T22:15:36.791ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17062024-06-25T22:15:36.791ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17072024-06-25T22:15:36.791ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17082024-06-25T22:15:36.791ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17092024-06-25T22:15:36.791ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 234 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44771 req_id = 28050f91-f739-46c0-b668-208a7a05ea6e response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17102024-06-25T22:15:36.829ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61165
17112024-06-25T22:15:36.830ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:524 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0e5c0224-5418-43a7-a584-d49561dc9b2f, kind: Service { id: b8926782-287c-4933-bfeb-32cf3be7f706 }, name: Name("external-dns-b8926782-287c-4933-bfeb-32cf3be7f706"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 163, 72])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 9112163e-3dcb-4580-845f-2c99d0c20231, kind: Service { id: 090cab3e-c3ab-4330-b9c9-1127a32f39f2 }, name: Name("external-dns-090cab3e-c3ab-4330-b9c9-1127a32f39f2"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 159, 39])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 94ed2baf-348c-4487-85a2-b16ce8ce33a8, kind: Service { id: 1767227d-844e-45e4-9835-24fb7251a22f }, name: Name("nexus-1767227d-844e-45e4-9835-24fb7251a22f"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 234, 65])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: c3eb96b1-13ec-4977-b5bb-24ab91071404, kind: Service { id: 211fbf99-1061-4acf-8e74-43eed5e3a08d }, name: Name("nexus-211fbf99-1061-4acf-8e74-43eed5e3a08d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 135, 241])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: f408d23f-8ca5-4b0c-ab98-3078caa08f15, kind: Service { id: 63818da9-9b47-4961-acee-684195690598 }, name: Name("nexus-63818da9-9b47-4961-acee-684195690598"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 0])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17122024-06-25T22:15:36.830ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17132024-06-25T22:15:36.830ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte0" rules = []
17142024-06-25T22:15:36.830ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17152024-06-25T22:15:36.830ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17162024-06-25T22:15:36.830ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17172024-06-25T22:15:36.830ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17182024-06-25T22:15:36.830ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 241 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61165 req_id = 5f3f7fa2-c86a-4a87-8845-f901109db178 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17192024-06-25T22:15:36.852ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45585
17202024-06-25T22:15:36.899ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 46974 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:45585 req_id = 54b588e6-b474-4e17-a41d-387542d1edec response_code = 204 uri = /switch-ports
17212024-06-25T22:15:36.899ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45585 req_id = 4ca99367-7704-43c2-990a-c8e90154712f response_code = 200 uri = /network-bootstore-config
17222024-06-25T22:15:36.960ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59779
17232024-06-25T22:15:37.004ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 43980 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:59779 req_id = 26c707a0-90c1-4d20-b0c0-459a313e3369 response_code = 204 uri = /switch-ports
17242024-06-25T22:15:37.004ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59779 req_id = a3fc6cda-1b0d-4974-9177-ed2ec5ce5dfa response_code = 200 uri = /network-bootstore-config
17252024-06-25T22:15:37.005ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33782
17262024-06-25T22:15:37.054ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 48167 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:33782 req_id = 03b7d508-8516-428d-bd3c-e3e9a53f86e9 response_code = 204 uri = /switch-ports
17272024-06-25T22:15:37.054ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33782 req_id = 472c5e39-87df-4f75-a3f2-fc8723cfbc43 response_code = 200 uri = /network-bootstore-config
17282024-06-25T22:15:43.095ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 526 local_addr = [fd00:1122:3344:101::1]:35461 method = GET remote_addr = [fd00:1122:3344:101::d]:58983 req_id = 354bed5c-f964-450a-add0-202b2511671d response_code = 200 sled_id = 98068951-ddeb-40ca-9677-d05b350bbf94 uri = /98068951-ddeb-40ca-9677-d05b350bbf94
17292024-06-25T22:15:56.581ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43823
17302024-06-25T22:15:56.581ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 53 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43823 req_id = 5ff3e1ee-4093-479e-963d-a065bd27d28c response_code = 200 uri = /baseboard
17312024-06-25T22:16:06.416ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40009
17322024-06-25T22:16:06.416ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40009 req_id = dc9f0b9d-a75a-499f-8bd5-58c8df01abf2 response_code = 200 uri = /v2p
17332024-06-25T22:16:06.484ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63151
17342024-06-25T22:16:06.484ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63151 req_id = 76c0d5f5-6ac6-4c7a-b6b4-32ace6204c11 response_code = 200 uri = /v2p
17352024-06-25T22:16:06.521ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49810
17362024-06-25T22:16:06.521ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49810 req_id = e09f7d22-1ed4-4c23-9332-5c2936f1b8d9 response_code = 200 uri = /v2p
17372024-06-25T22:16:06.537ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43163
17382024-06-25T22:16:06.584ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 47191 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:43163 req_id = 182daa42-6091-4ff0-a426-4ccec325aec3 response_code = 204 uri = /switch-ports
17392024-06-25T22:16:06.584ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59755
17402024-06-25T22:16:06.588ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 2979 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43163 req_id = 2d7ce15c-e376-4c21-908c-db1b75e3d334 response_code = 200 uri = /network-bootstore-config
17412024-06-25T22:16:06.629ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 44709 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:59755 req_id = 0ecf7e81-c775-4490-970c-f8b4672a5ed8 response_code = 204 uri = /switch-ports
17422024-06-25T22:16:06.630ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59755 req_id = e0f30bb1-3d42-4490-91bc-5af16a25e3fd response_code = 200 uri = /network-bootstore-config
17432024-06-25T22:16:06.658ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56414
17442024-06-25T22:16:06.702ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 43915 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:56414 req_id = a7e5ce6d-a413-4d0c-99b8-c8117ae04363 response_code = 204 uri = /switch-ports
17452024-06-25T22:16:06.702ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56414 req_id = 516d0096-de06-4f5e-90dc-cf6aca0c2ac4 response_code = 200 uri = /network-bootstore-config
17462024-06-25T22:16:13.096ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1158 local_addr = [fd00:1122:3344:101::1]:35461 method = GET remote_addr = [fd00:1122:3344:101::d]:58983 req_id = 93f32b66-0999-4b29-af00-996fe152ac8f response_code = 200 sled_id = 98068951-ddeb-40ca-9677-d05b350bbf94 uri = /98068951-ddeb-40ca-9677-d05b350bbf94
17472024-06-25T22:16:26.614ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:39019
17482024-06-25T22:16:26.614ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 48 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:39019 req_id = 5c7d3d13-7c30-4405-8e06-2ac951cd5b8d response_code = 200 uri = /baseboard
17492024-06-25T22:16:36.500ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52000
17502024-06-25T22:16:36.500ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52000 req_id = e49e1e74-4dc9-4a3f-a276-0c687beb94b7 response_code = 200 uri = /v2p
17512024-06-25T22:16:36.512ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52225
17522024-06-25T22:16:36.512ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52225 req_id = 0f76e3da-507c-4bb2-a3ac-dce9f70fde1b response_code = 200 uri = /v2p
17532024-06-25T22:16:36.675ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40388
17542024-06-25T22:16:36.675ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40388 req_id = 17c97018-64c4-4c83-b905-252d2944c1ce response_code = 200 uri = /v2p
17552024-06-25T22:16:36.761ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41324
17562024-06-25T22:16:36.807ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 46089 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:41324 req_id = ded46bb0-6308-41bc-ae69-9b2a7687aef1 response_code = 204 uri = /switch-ports
17572024-06-25T22:16:36.807ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38765
17582024-06-25T22:16:36.807ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41324 req_id = 69aa4441-4550-4e4f-a32a-9c5c28a25e41 response_code = 200 uri = /network-bootstore-config
17592024-06-25T22:16:36.853ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 46005 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:38765 req_id = c3f2c55f-0581-4967-8f5f-458da8fa1e15 response_code = 204 uri = /switch-ports
17602024-06-25T22:16:36.854ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 799 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38765 req_id = 9aadd0b3-d911-400b-95e8-3b5e0ea94a06 response_code = 200 uri = /network-bootstore-config
17612024-06-25T22:16:36.965ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44619
17622024-06-25T22:16:37.010ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 44209 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:44619 req_id = 275caa02-d2a2-4c43-9de7-c66f41cfb391 response_code = 204 uri = /switch-ports
17632024-06-25T22:16:37.010ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44619 req_id = 81e26f95-f772-47f5-a67d-b6edf4c56fb2 response_code = 200 uri = /network-bootstore-config
17642024-06-25T22:16:43.096ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 464 local_addr = [fd00:1122:3344:101::1]:35461 method = GET remote_addr = [fd00:1122:3344:101::d]:58983 req_id = 99c49741-7bda-4c56-b8c2-2456ed9148f5 response_code = 200 sled_id = 98068951-ddeb-40ca-9677-d05b350bbf94 uri = /98068951-ddeb-40ca-9677-d05b350bbf94
17652024-06-25T22:16:56.647ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:61790
17662024-06-25T22:16:56.647ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 35 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:61790 req_id = f21854ed-77f0-464e-b6d3-8f69d4357a23 response_code = 200 uri = /baseboard
17672024-06-25T22:17:00.698ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64200
17682024-06-25T22:17:00.698ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 861 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64200 req_id = c0cb21ce-b56d-4a95-a353-08a577fa737e response_code = 200 uri = /v2p
17692024-06-25T22:17:00.699ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:631 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 251, 205, 55])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(8989710) }
17702024-06-25T22:17:00.699ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64200 req_id = 70772e34-5ac7-4983-8593-2e8783cec004 response_code = 204 uri = /v2p
17712024-06-25T22:17:00.823ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36758
17722024-06-25T22:17:00.834ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:548 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: a2685ab7-7e3f-4ec7-aa13-1303e9cab12d, kind: Instance { id: 198fe6d1-d4c7-47d8-b549-afdaf8c46a68 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 251, 205, 55])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(8989710), primary: true, slot: 0 }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a2685ab7-7e3f-4ec7-aa13-1303e9cab12d, kind: Instance { id: 198fe6d1-d4c7-47d8-b549-afdaf8c46a68 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 251, 205, 55])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(8989710), primary: true, slot: 0 }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a2685ab7-7e3f-4ec7-aa13-1303e9cab12d, kind: Instance { id: 198fe6d1-d4c7-47d8-b549-afdaf8c46a68 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 251, 205, 55])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(8989710), primary: true, slot: 0 }], filter_hosts: Some([Vpc(Vni(8989710))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a2685ab7-7e3f-4ec7-aa13-1303e9cab12d, kind: Instance { id: 198fe6d1-d4c7-47d8-b549-afdaf8c46a68 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 251, 205, 55])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(8989710), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-ead6dc554e3", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 8d496bcc-a675-4f60-b36d-4f42eb80b142, read_only_parent: Some(Volume { block_size: 512, id: 17acbc5e-37a7-43bf-aaaf-4053b346b902, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 10f22eed-a985-4b52-99df-6f373dd7578f, key: Some("ZWQecptZYrQT4ztSRNtEWDPYe3q01MQX33hZRZzIyJM="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::12]:19002", "[fd00:1122:3344:101::15]:19001", "[fd00:1122:3344:101::17]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 8d496bcc-a675-4f60-b36d-4f42eb80b142, key: Some("57I0ZsX6+QDiKpViNnk1aByYhWY48/k5lfdLl8f4IJY="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::1a]:19001", "[fd00:1122:3344:101::13]:19001", "[fd00:1122:3344:101::18]:19000"] } }] } }], cloud_init_bytes: Some("6zyQTVNXSU40LjEAAgEBAAIAAioA+AEAKgBAAAAAAAAAAAAAAAApeFY0EmNpZGF0YSAgICAgRkFUMTIgICAOH75bfKwiwHQLVrQOuwcAzRBe6/Ay5M0WzRnr/lRoaXMgaXMgbm90IGEgYm9vdGFibGUgZGlzay4gIFBsZWFzZSBpbnNlcnQgYSBib290YWJsZSBmbG9wcHkgYW5kDQpwcmVzcyBhbnkga2V5IHRvIHRyeSBhZ2FpbiAuLi4gDQoAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAVar4////DwAAAAAAAAAA8P//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////D/j///8PAAAAAAAAAADw//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////8PY2lkYXRhICAgICAIAAAAAAAAAAAAAAAAAAAAAAAAAABBbQBlAHQAYQAtAA8A1GQAYQB0AGEAAAD//wAA/////01FVEEtRH4xICAgAABOILLZWNlYAAAgstlYAgC3AAAAQXUAcwBlAHIALQAPALBkAGEAdABhAAAA//8AAP////9VU0VSLUR+MSAgIAAATiCy2VjZWAAAILLZWAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAHsiaW5zdGFuY2UtaWQiOiIxOThmZTZkMS1kNGM3LTQ3ZDgtYjU0OS1hZmRhZjhjNDZhNjgiLCJsb2NhbC1ob3N0bmFtZSI6ImxvY2Fsc2hhcmsiLCJwdWJsaWMta2V5cyI6WyJzc2gtZWQyNTUxOSBBQUFBQzNOemFDMWxaREkxTlRFNUFBQUFJUGNYYVYydFB1WFkvK3YrbitNdjY2SGdlWnMyUEhlR3psblEvcXJHNVNubCJdfQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA") } instance_id = 198fe6d1-d4c7-47d8-b549-afdaf8c46a68 instance_runtime = InstanceRuntimeState { propolis_id: Some(f21cd626-04bd-4681-9e51-15963967a710 (propolis)), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-06-25T22:17:00.517338983Z } metadata = InstanceMetadata { silo_id: cbaaf28d-b8de-4ae4-8ab9-f2ec2ce2bae6, project_id: 1ff28b95-1f83-463b-a97f-5dade79d26e9 } propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = f21cd626-04bd-4681-9e51-15963967a710 vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(1), time_updated: 2024-06-25T22:17:00.495926Z }
17732024-06-25T22:17:00.835ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:582 instance_id = 198fe6d1-d4c7-47d8-b549-afdaf8c46a68 (instance)
17742024-06-25T22:17:00.835ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:942 instance_id = 198fe6d1-d4c7-47d8-b549-afdaf8c46a68 propolis_id = f21cd626-04bd-4681-9e51-15963967a710 state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: a2685ab7-7e3f-4ec7-aa13-1303e9cab12d, kind: Instance { id: 198fe6d1-d4c7-47d8-b549-afdaf8c46a68 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 251, 205, 55])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(8989710), primary: true, slot: 0 }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a2685ab7-7e3f-4ec7-aa13-1303e9cab12d, kind: Instance { id: 198fe6d1-d4c7-47d8-b549-afdaf8c46a68 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 251, 205, 55])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(8989710), primary: true, slot: 0 }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a2685ab7-7e3f-4ec7-aa13-1303e9cab12d, kind: Instance { id: 198fe6d1-d4c7-47d8-b549-afdaf8c46a68 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 251, 205, 55])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(8989710), primary: true, slot: 0 }], filter_hosts: Some([Vpc(Vni(8989710))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a2685ab7-7e3f-4ec7-aa13-1303e9cab12d, kind: Instance { id: 198fe6d1-d4c7-47d8-b549-afdaf8c46a68 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 251, 205, 55])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(8989710), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-ead6dc554e3", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 8d496bcc-a675-4f60-b36d-4f42eb80b142, read_only_parent: Some(Volume { block_size: 512, id: 17acbc5e-37a7-43bf-aaaf-4053b346b902, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 10f22eed-a985-4b52-99df-6f373dd7578f, key: Some("ZWQecptZYrQT4ztSRNtEWDPYe3q01MQX33hZRZzIyJM="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::12]:19002", "[fd00:1122:3344:101::15]:19001", "[fd00:1122:3344:101::17]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 8d496bcc-a675-4f60-b36d-4f42eb80b142, key: Some("57I0ZsX6+QDiKpViNnk1aByYhWY48/k5lfdLl8f4IJY="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::1a]:19001", "[fd00:1122:3344:101::13]:19001", "[fd00:1122:3344:101::18]:19000"] } }] } }], cloud_init_bytes: Some("6zyQTVNXSU40LjEAAgEBAAIAAioA+AEAKgBAAAAAAAAAAAAAAAApeFY0EmNpZGF0YSAgICAgRkFUMTIgICAOH75bfKwiwHQLVrQOuwcAzRBe6/Ay5M0WzRnr/lRoaXMgaXMgbm90IGEgYm9vdGFibGUgZGlzay4gIFBsZWFzZSBpbnNlcnQgYSBib290YWJsZSBmbG9wcHkgYW5kDQpwcmVzcyBhbnkga2V5IHRvIHRyeSBhZ2FpbiAuLi4gDQoAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAVar4////DwAAAAAAAAAA8P//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////D/j///8PAAAAAAAAAADw//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////8PY2lkYXRhICAgICAIAAAAAAAAAAAAAAAAAAAAAAAAAABBbQBlAHQAYQAtAA8A1GQAYQB0AGEAAAD//wAA/////01FVEEtRH4xICAgAABOILLZWNlYAAAgstlYAgC3AAAAQXUAcwBlAHIALQAPALBkAGEAdABhAAAA//8AAP////9VU0VSLUR+MSAgIAAATiCy2VjZWAAAILLZWAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAHsiaW5zdGFuY2UtaWQiOiIxOThmZTZkMS1kNGM3LTQ3ZDgtYjU0OS1hZmRhZjhjNDZhNjgiLCJsb2NhbC1ob3N0bmFtZSI6ImxvY2Fsc2hhcmsiLCJwdWJsaWMta2V5cyI6WyJzc2gtZWQyNTUxOSBBQUFBQzNOemFDMWxaREkxTlRFNUFBQUFJUGNYYVYydFB1WFkvK3YrbitNdjY2SGdlWnMyUEhlR3psblEvcXJHNVNubCJdfQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA") }, instance_runtime: InstanceRuntimeState { propolis_id: Some(f21cd626-04bd-4681-9e51-15963967a710 (propolis)), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-06-25T22:17:00.517338983Z }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(1), time_updated: 2024-06-25T22:17:00.495926Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400 }
17752024-06-25T22:17:00.835ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 11879 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36758 req_id = f9d7b802-3fa2-4c2d-b683-d8fac65d9e93 response_code = 200 uri = /instances/198fe6d1-d4c7-47d8-b549-afdaf8c46a68
17762024-06-25T22:17:00.969ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49659
17772024-06-25T22:17:00.970ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 405 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49659 req_id = b97e872a-a966-4673-ac16-4df46bee7855 response_code = 200 uri = /instances/198fe6d1-d4c7-47d8-b549-afdaf8c46a68/state
17782024-06-25T22:17:00.994ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:393 port = Port { inner: PortInner { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 251, 205, 55]), slot: 0, vni: Vni { inner: 8989710 }, gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 }, vnic: "vopte6" } }
17792024-06-25T22:17:00.994ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
17802024-06-25T22:17:01.029ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_f21cd626-04bd-4681-9e51-15963967a710 file = illumos-utils/src/zone.rs:315 instance_id = 198fe6d1-d4c7-47d8-b549-afdaf8c46a68
17812024-06-25T22:17:01.049ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_f21cd626-04bd-4681-9e51-15963967a710 file = illumos-utils/src/zone.rs:354 instance_id = 198fe6d1-d4c7-47d8-b549-afdaf8c46a68
17822024-06-25T22:17:02.286ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_f21cd626-04bd-4681-9e51-15963967a710: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlInstance0"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::1:0"/> <propval type="astring" name="listen_port" value="12400"/> <propval type="astring" name="metric_addr" value="[fd00:1122:3344:101::b]:12221"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = 198fe6d1-d4c7-47d8-b549-afdaf8c46a68
17832024-06-25T22:17:02.286ZINFOSledAgent (InstanceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 instance_id = 198fe6d1-d4c7-47d8-b549-afdaf8c46a68 zone = oxz_propolis-server_f21cd626-04bd-4681-9e51-15963967a710
17842024-06-25T22:17:02.474ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_f21cd626-04bd-4681-9e51-15963967a710") failed: Property not found. retry in 50.001587ms file = illumos-utils/src/svc.rs:36 instance_id = 198fe6d1-d4c7-47d8-b549-afdaf8c46a68 zone = oxz_propolis-server_f21cd626-04bd-4681-9e51-15963967a710
17852024-06-25T22:17:02.533ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_f21cd626-04bd-4681-9e51-15963967a710") failed: Property not found. retry in 118.796624ms file = illumos-utils/src/svc.rs:36 instance_id = 198fe6d1-d4c7-47d8-b549-afdaf8c46a68 zone = oxz_propolis-server_f21cd626-04bd-4681-9e51-15963967a710
17862024-06-25T22:17:02.670ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_f21cd626-04bd-4681-9e51-15963967a710") failed: Property not found. retry in 182.50104ms file = illumos-utils/src/svc.rs:36 instance_id = 198fe6d1-d4c7-47d8-b549-afdaf8c46a68 zone = oxz_propolis-server_f21cd626-04bd-4681-9e51-15963967a710
17872024-06-25T22:17:02.869ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_f21cd626-04bd-4681-9e51-15963967a710") failed: Property not found. retry in 257.564315ms file = illumos-utils/src/svc.rs:36 instance_id = 198fe6d1-d4c7-47d8-b549-afdaf8c46a68 zone = oxz_propolis-server_f21cd626-04bd-4681-9e51-15963967a710
17882024-06-25T22:17:03.143ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_f21cd626-04bd-4681-9e51-15963967a710") failed: Property not found. retry in 1.009774615s file = illumos-utils/src/svc.rs:36 instance_id = 198fe6d1-d4c7-47d8-b549-afdaf8c46a68 zone = oxz_propolis-server_f21cd626-04bd-4681-9e51-15963967a710
17892024-06-25T22:17:04.164ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_f21cd626-04bd-4681-9e51-15963967a710") failed: Property not found. retry in 1.10476979s file = illumos-utils/src/svc.rs:36 instance_id = 198fe6d1-d4c7-47d8-b549-afdaf8c46a68 zone = oxz_propolis-server_f21cd626-04bd-4681-9e51-15963967a710
17902024-06-25T22:17:05.281ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_f21cd626-04bd-4681-9e51-15963967a710") failed: Property not found. retry in 835.628303ms file = illumos-utils/src/svc.rs:36 instance_id = 198fe6d1-d4c7-47d8-b549-afdaf8c46a68 zone = oxz_propolis-server_f21cd626-04bd-4681-9e51-15963967a710
17912024-06-25T22:17:06.127ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_f21cd626-04bd-4681-9e51-15963967a710") failed: Property not found. retry in 819.833472ms file = illumos-utils/src/svc.rs:36 instance_id = 198fe6d1-d4c7-47d8-b549-afdaf8c46a68 zone = oxz_propolis-server_f21cd626-04bd-4681-9e51-15963967a710
17922024-06-25T22:17:06.426ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46599
17932024-06-25T22:17:06.450ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39107
17942024-06-25T22:17:06.452ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34186
17952024-06-25T22:17:06.453ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34186 req_id = 4bfe85d4-2c4f-4688-9890-2730605e52ce response_code = 200 uri = /v2p
17962024-06-25T22:17:06.458ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61453
17972024-06-25T22:17:06.458ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61453 req_id = 272d6dee-6201-4fb7-b3de-d3e719b10260 response_code = 200 uri = /v2p
17982024-06-25T22:17:06.583ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40502
17992024-06-25T22:17:06.627ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 43774 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:40502 req_id = 48d87994-115e-4920-a23f-157783a776a3 response_code = 204 uri = /switch-ports
18002024-06-25T22:17:06.627ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52067
18012024-06-25T22:17:06.627ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43369
18022024-06-25T22:17:06.627ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 249 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40502 req_id = 84d850ee-d439-4ef1-9b5d-d945aceb1f61 response_code = 200 uri = /network-bootstore-config
18032024-06-25T22:17:06.628ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1051 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52067 req_id = a55b299c-c6e0-4244-aed0-d57ff2469a7c response_code = 200 uri = /v2p
18042024-06-25T22:17:06.658ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52188
18052024-06-25T22:17:06.706ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 47584 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:52188 req_id = a1be99c9-779c-4e7c-b9e8-6b5ba3ce7810 response_code = 204 uri = /switch-ports
18062024-06-25T22:17:06.706ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62248
18072024-06-25T22:17:06.709ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 3045 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52188 req_id = a8d6fb40-e490-489d-bdde-f9db7074b481 response_code = 200 uri = /network-bootstore-config
18082024-06-25T22:17:06.747ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 41231 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:62248 req_id = 2e58e266-51bd-4caf-9050-c6798da65c7a response_code = 204 uri = /switch-ports
18092024-06-25T22:17:06.747ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62248 req_id = 43c0fe36-5f31-4041-8775-6927d26f37eb response_code = 200 uri = /network-bootstore-config
18102024-06-25T22:17:06.956ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_f21cd626-04bd-4681-9e51-15963967a710") failed: Property not found. retry in 557.526652ms file = illumos-utils/src/svc.rs:36 instance_id = 198fe6d1-d4c7-47d8-b549-afdaf8c46a68 zone = oxz_propolis-server_f21cd626-04bd-4681-9e51-15963967a710
18112024-06-25T22:17:07.542ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_f21cd626-04bd-4681-9e51-15963967a710 file = sled-agent/src/instance.rs:1427 instance_id = 198fe6d1-d4c7-47d8-b549-afdaf8c46a68
18122024-06-25T22:17:07.552ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_f21cd626-04bd-4681-9e51-15963967a710") failed: Property not found. retry in 44.245262ms file = illumos-utils/src/svc.rs:36 instance_id = 198fe6d1-d4c7-47d8-b549-afdaf8c46a68
18132024-06-25T22:17:07.606ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_f21cd626-04bd-4681-9e51-15963967a710") failed: Property not found. retry in 91.035743ms file = illumos-utils/src/svc.rs:36 instance_id = 198fe6d1-d4c7-47d8-b549-afdaf8c46a68
18142024-06-25T22:17:07.706ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_f21cd626-04bd-4681-9e51-15963967a710") failed: Property not found. retry in 271.186083ms file = illumos-utils/src/svc.rs:36 instance_id = 198fe6d1-d4c7-47d8-b549-afdaf8c46a68
18152024-06-25T22:17:07.989ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:1436 instance_id = 198fe6d1-d4c7-47d8-b549-afdaf8c46a68
18162024-06-25T22:17:08.024ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:1450 instance_id = 198fe6d1-d4c7-47d8-b549-afdaf8c46a68
18172024-06-25T22:17:08.026ZINFOSledAgent (InstanceManager): Sending ensure request to propolis: InstanceEnsureRequest { cloud_init_bytes: Some("6zyQTVNXSU40LjEAAgEBAAIAAioA+AEAKgBAAAAAAAAAAAAAAAApeFY0EmNpZGF0YSAgICAgRkFUMTIgICAOH75bfKwiwHQLVrQOuwcAzRBe6/Ay5M0WzRnr/lRoaXMgaXMgbm90IGEgYm9vdGFibGUgZGlzay4gIFBsZWFzZSBpbnNlcnQgYSBib290YWJsZSBmbG9wcHkgYW5kDQpwcmVzcyBhbnkga2V5IHRvIHRyeSBhZ2FpbiAuLi4gDQoAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAVar4////DwAAAAAAAAAA8P//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////D/j///8PAAAAAAAAAADw//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////8PY2lkYXRhICAgICAIAAAAAAAAAAAAAAAAAAAAAAAAAABBbQBlAHQAYQAtAA8A1GQAYQB0AGEAAAD//wAA/////01FVEEtRH4xICAgAABOILLZWNlYAAAgstlYAgC3AAAAQXUAcwBlAHIALQAPALBkAGEAdABhAAAA//8AAP////9VU0VSLUR+MSAgIAAATiCy2VjZWAAAILLZWAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAHsiaW5zdGFuY2UtaWQiOiIxOThmZTZkMS1kNGM3LTQ3ZDgtYjU0OS1hZmRhZjhjNDZhNjgiLCJsb2NhbC1ob3N0bmFtZSI6ImxvY2Fsc2hhcmsiLCJwdWJsaWMta2V5cyI6WyJzc2gtZWQyNTUxOSBBQUFBQzNOemFDMWxaREkxTlRFNUFBQUFJUGNYYVYydFB1WFkvK3YrbitNdjY2SGdlWnMyUEhlR3psblEvcXJHNVNubCJdfQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA"), disks: [DiskRequest { device: "nvme", name: "disk-ead6dc554e3", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 8d496bcc-a675-4f60-b36d-4f42eb80b142, read_only_parent: Some(Volume { block_size: 512, id: 17acbc5e-37a7-43bf-aaaf-4053b346b902, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 10f22eed-a985-4b52-99df-6f373dd7578f, key: Some("ZWQecptZYrQT4ztSRNtEWDPYe3q01MQX33hZRZzIyJM="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::12]:19002", "[fd00:1122:3344:101::15]:19001", "[fd00:1122:3344:101::17]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 8d496bcc-a675-4f60-b36d-4f42eb80b142, key: Some("57I0ZsX6+QDiKpViNnk1aByYhWY48/k5lfdLl8f4IJY="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::1a]:19001", "[fd00:1122:3344:101::13]:19001", "[fd00:1122:3344:101::18]:19000"] } }] } }], migrate: None, nics: [NetworkInterfaceRequest { name: "vopte6", slot: Slot(0) }], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Test description", id: 198fe6d1-d4c7-47d8-b549-afdaf8c46a68, image_id: 00000000-0000-0000-0000-000000000000, memory: 1024, metadata: InstanceMetadata { project_id: 1ff28b95-1f83-463b-a97f-5dade79d26e9, silo_id: cbaaf28d-b8de-4ae4-8ab9-f2ec2ce2bae6 }, name: "localshark", vcpus: 2 } } file = sled-agent/src/instance.rs:689 instance_id = 198fe6d1-d4c7-47d8-b549-afdaf8c46a68
18182024-06-25T22:17:08.135ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:691 instance_id = 198fe6d1-d4c7-47d8-b549-afdaf8c46a68
18192024-06-25T22:17:08.136ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1709554 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46599 req_id = ce5d4404-aa06-4508-b498-c52c79639baf response_code = 200 uri = /instances/198fe6d1-d4c7-47d8-b549-afdaf8c46a68/state
18202024-06-25T22:17:08.136ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1508699 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43369 req_id = 802cabaf-d89a-4bf8-b564-d8499800486f response_code = 200 uri = /instances/198fe6d1-d4c7-47d8-b549-afdaf8c46a68/state
18212024-06-25T22:17:08.136ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1685684 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39107 req_id = 4a2e5fc1-e06e-44c5-b2af-9f79890cf0f7 response_code = 200 uri = /instances/198fe6d1-d4c7-47d8-b549-afdaf8c46a68/state
18222024-06-25T22:17:08.136ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Starting), migration_status: NoMigration, time: 2024-06-25T22:17:08.136240166Z } file = sled-agent/src/instance.rs:573 instance_id = 198fe6d1-d4c7-47d8-b549-afdaf8c46a68
18232024-06-25T22:17:08.136ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:595 instance_id = 198fe6d1-d4c7-47d8-b549-afdaf8c46a68 new_instance_state = InstanceRuntimeState { propolis_id: Some(f21cd626-04bd-4681-9e51-15963967a710 (propolis)), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-06-25T22:17:00.517338983Z } new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-06-25T22:17:08.136240166Z } propolis_id = f21cd626-04bd-4681-9e51-15963967a710
18242024-06-25T22:17:08.136ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:492 instance_id = 198fe6d1-d4c7-47d8-b549-afdaf8c46a68 state = SledInstanceState { instance_state: InstanceRuntimeState { propolis_id: Some(f21cd626-04bd-4681-9e51-15963967a710 (propolis)), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-06-25T22:17:00.517338983Z }, propolis_id: f21cd626-04bd-4681-9e51-15963967a710 (propolis), vmm_state: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-06-25T22:17:08.136240166Z }, migration_state: None }
18252024-06-25T22:17:08.222ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_status: NoMigration, time: 2024-06-25T22:17:08.222552803Z } file = sled-agent/src/instance.rs:573 instance_id = 198fe6d1-d4c7-47d8-b549-afdaf8c46a68
18262024-06-25T22:17:08.222ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:595 instance_id = 198fe6d1-d4c7-47d8-b549-afdaf8c46a68 new_instance_state = InstanceRuntimeState { propolis_id: Some(f21cd626-04bd-4681-9e51-15963967a710 (propolis)), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-06-25T22:17:00.517338983Z } new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(3), time_updated: 2024-06-25T22:17:08.222552803Z } propolis_id = f21cd626-04bd-4681-9e51-15963967a710
18272024-06-25T22:17:08.222ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:492 instance_id = 198fe6d1-d4c7-47d8-b549-afdaf8c46a68 state = SledInstanceState { instance_state: InstanceRuntimeState { propolis_id: Some(f21cd626-04bd-4681-9e51-15963967a710 (propolis)), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-06-25T22:17:00.517338983Z }, propolis_id: f21cd626-04bd-4681-9e51-15963967a710 (propolis), vmm_state: VmmRuntimeState { state: Running, gen: Generation(3), time_updated: 2024-06-25T22:17:08.222552803Z }, migration_state: None }
18282024-06-25T22:17:13.096ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 513 local_addr = [fd00:1122:3344:101::1]:35461 method = GET remote_addr = [fd00:1122:3344:101::d]:58983 req_id = 8bce7859-1fa2-4930-9532-0005df738d01 response_code = 200 sled_id = 98068951-ddeb-40ca-9677-d05b350bbf94 uri = /98068951-ddeb-40ca-9677-d05b350bbf94
18292024-06-25T22:17:18.259ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41974
18302024-06-25T22:17:18.260ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1240 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41974 req_id = e2dc497e-9289-4061-97a8-ed014bdb4cd1 response_code = 200 uri = /instances/198fe6d1-d4c7-47d8-b549-afdaf8c46a68/state
18312024-06-25T22:17:18.260ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_status: NoMigration, time: 2024-06-25T22:17:18.260805554Z } file = sled-agent/src/instance.rs:573 instance_id = 198fe6d1-d4c7-47d8-b549-afdaf8c46a68
18322024-06-25T22:17:18.260ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:595 instance_id = 198fe6d1-d4c7-47d8-b549-afdaf8c46a68 new_instance_state = InstanceRuntimeState { propolis_id: Some(f21cd626-04bd-4681-9e51-15963967a710 (propolis)), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-06-25T22:17:00.517338983Z } new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(5), time_updated: 2024-06-25T22:17:18.260805554Z } propolis_id = f21cd626-04bd-4681-9e51-15963967a710
18332024-06-25T22:17:18.260ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:492 instance_id = 198fe6d1-d4c7-47d8-b549-afdaf8c46a68 state = SledInstanceState { instance_state: InstanceRuntimeState { propolis_id: Some(f21cd626-04bd-4681-9e51-15963967a710 (propolis)), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-06-25T22:17:00.517338983Z }, propolis_id: f21cd626-04bd-4681-9e51-15963967a710 (propolis), vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(5), time_updated: 2024-06-25T22:17:18.260805554Z }, migration_state: None }
18342024-06-25T22:17:18.325ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_status: NoMigration, time: 2024-06-25T22:17:18.325293161Z } file = sled-agent/src/instance.rs:573 instance_id = 198fe6d1-d4c7-47d8-b549-afdaf8c46a68
18352024-06-25T22:17:18.325ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:595 instance_id = 198fe6d1-d4c7-47d8-b549-afdaf8c46a68 new_instance_state = InstanceRuntimeState { propolis_id: None, dst_propolis_id: None, migration_id: None, gen: Generation(5), time_updated: 2024-06-25T22:17:18.325293161Z } new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(6), time_updated: 2024-06-25T22:17:18.325293161Z } propolis_id = f21cd626-04bd-4681-9e51-15963967a710
18362024-06-25T22:17:18.325ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:610 instance_id = 198fe6d1-d4c7-47d8-b549-afdaf8c46a68
18372024-06-25T22:17:18.325ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
18382024-06-25T22:17:18.325ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
18392024-06-25T22:17:18.325ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/c1b4be1d-f4e3-4e74-a94a-e989f58db5ee/debug/bundle/zone", "/pool/int/d56b00ad-a3b5-4f85-a7d9-5f806111674c/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/b24fcace-6491-450a-a369-72a4fa2f698d/crypt/debug", "/pool/ext/bbe28fca-3fd1-4387-a7f4-68f98c1de91a/crypt/debug", "/pool/ext/2d7d2d68-0dff-4e99-8278-b931af9c51f9/crypt/debug", "/pool/ext/a53379c5-166a-4c1c-987d-bc15e7c6ea9a/crypt/debug", "/pool/ext/d48dc185-6776-4e11-be12-99d059cde9ba/crypt/debug", "/pool/ext/e5688a20-d1b3-481e-838c-caf5db3530b8/crypt/debug", "/pool/ext/312c3038-d536-4c5a-9806-84746920ad0d/crypt/debug", "/pool/ext/97cef6c3-7be9-4f86-b962-06f70386b56f/crypt/debug", "/pool/ext/facb4ef1-3898-4a96-a381-88ad4e3fa4e0/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:437 zone_name = oxz_propolis-server_f21cd626-04bd-4681-9e51-15963967a710
18402024-06-25T22:17:18.961ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1230 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_f21cd626-04bd-4681-9e51-15963967a710", bundle_id: 9b66ab5d-41e9-42fe-833a-45e14ac48dde }, time_created: 2024-06-25T22:17:18.326837303Z, version: 0, cause: TerminatedInstance }
18412024-06-25T22:17:18.961ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_f21cd626-04bd-4681-9e51-15963967a710 file = sled-agent/src/instance.rs:784 instance_id = 198fe6d1-d4c7-47d8-b549-afdaf8c46a68
18422024-06-25T22:17:20.714ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:269 instance_id = 198fe6d1-d4c7-47d8-b549-afdaf8c46a68
18432024-06-25T22:17:20.744ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:492 instance_id = 198fe6d1-d4c7-47d8-b549-afdaf8c46a68 state = SledInstanceState { instance_state: InstanceRuntimeState { propolis_id: None, dst_propolis_id: None, migration_id: None, gen: Generation(5), time_updated: 2024-06-25T22:17:18.325293161Z }, propolis_id: f21cd626-04bd-4681-9e51-15963967a710 (propolis), vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-06-25T22:17:20.744081001Z }, migration_state: None }
18442024-06-25T22:17:20.838ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55912
18452024-06-25T22:17:20.838ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55912 req_id = 99374e3c-1e67-4c6b-99f5-517a105abd16 response_code = 200 uri = /v2p
18462024-06-25T22:17:20.839ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:631 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 251, 205, 55])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(8989710) }
18472024-06-25T22:17:20.839ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55912 req_id = c4006470-0a36-4ce8-a18c-172ed7d468ca response_code = 204 uri = /v2p
18482024-06-25T22:17:21.038ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:492 instance_id = 198fe6d1-d4c7-47d8-b549-afdaf8c46a68 state = SledInstanceState { instance_state: InstanceRuntimeState { propolis_id: None, dst_propolis_id: None, migration_id: None, gen: Generation(5), time_updated: 2024-06-25T22:17:18.325293161Z }, propolis_id: f21cd626-04bd-4681-9e51-15963967a710 (propolis), vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-06-25T22:17:20.744081001Z }, migration_state: None }
18492024-06-25T22:17:21.043ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:727 instance_id = 198fe6d1-d4c7-47d8-b549-afdaf8c46a68
18502024-06-25T22:17:22.452ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57488
18512024-06-25T22:17:22.453ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 699 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57488 req_id = d8ad5423-8b8a-4e15-95f0-2e2ce700b02f response_code = 200 uri = /v2p
18522024-06-25T22:17:22.453ZINFOSledAgent (PortManager): Clearing mapping of virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:671 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 251, 205, 55])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(8989710) }
18532024-06-25T22:17:22.453ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:57488 req_id = 3b0a3583-b97a-4c2a-8eac-66c7428d072b response_code = 204 uri = /v2p